Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A controller configured to: obtain information about a gaze direction for an eye; and determine a pixel intensity value for at least one pixel in a portion of a plurality of pixels of a plurality of displays to generate content for presentation, based at least in part on the information about the gaze direction and decomposition of a scene related to the content displayed across the plurality of displays.
This invention relates to gaze-tracking systems for multi-display environments, addressing the challenge of optimizing visual content presentation based on a user's gaze direction. The controller obtains gaze direction data for an eye and uses this information to adjust pixel intensity values in a specific portion of pixels across multiple displays. The adjustment is based on both the gaze direction and a decomposition of the scene displayed across the displays. This decomposition likely involves analyzing the visual content to determine how it is distributed or segmented across the displays. The controller dynamically modifies pixel intensity to enhance visibility or reduce eye strain, particularly in scenarios where multiple displays are used, such as in extended reality (XR) or multi-monitor setups. The system ensures that the content remains clear and properly rendered for the user's current gaze position, improving visual comfort and performance. The invention may also involve preprocessing the scene to determine optimal intensity adjustments for different regions of the displays, ensuring seamless integration of gaze-tracking data with display rendering.
2. The controller of claim 1 , wherein the information about the gaze direction includes at least one of: a vector gaze direction of the eye, and a distance between a center point of the eye and an origin point perpendicular to a center of a display of the plurality of displays.
This invention relates to gaze tracking systems for multi-display environments, addressing the challenge of accurately determining a user's gaze direction across multiple displays. The system includes a controller that processes information about the gaze direction of a user's eye to determine which of the displays the user is looking at. The gaze direction information includes either a vector representing the direction of the eye's gaze or a distance measurement between a center point of the eye and an origin point perpendicular to the center of one of the displays. The controller uses this data to identify the specific display being viewed, enabling applications such as adaptive content display, user interaction tracking, or attention monitoring. The system may also include an eye tracking device that captures eye movement data, which the controller analyzes to derive the gaze direction. The invention improves upon existing gaze tracking methods by providing a more precise and reliable way to determine display focus in multi-display setups, particularly in scenarios where displays are arranged in close proximity or at varying angles. This enhances user experience in applications like virtual reality, augmented reality, or multi-monitor workstations.
3. The controller of claim 2 , wherein the controller is further configured to adjust the pixel intensity value based on the distance and the vector gaze direction.
A system for adjusting display output based on viewer gaze tracking involves a controller that modifies pixel intensity values in real-time to optimize visual perception. The system addresses the problem of fixed display settings that do not account for variations in viewing distance and angle, leading to suboptimal brightness, contrast, or clarity for individual users. The controller receives input from gaze-tracking sensors to determine the viewer's distance from the display and the direction of their gaze relative to the screen. Using this data, the controller dynamically adjusts pixel intensity values to enhance visibility and reduce eye strain. The adjustments may include increasing brightness for distant viewers or dimming specific areas when the gaze is directed elsewhere to improve contrast. The system may also incorporate additional display parameters, such as color correction or resolution scaling, to further refine the visual output based on the viewer's position. By continuously monitoring and adapting to the viewer's gaze, the system ensures a more personalized and comfortable viewing experience.
4. The controller of claim 1 , wherein the controller is further configured to: determine at least one kernel for the at least one pixel based in part on an initial pixel intensity for the at least one pixel; and determine the pixel intensity value for the at least one pixel based in part on the at least one kernel.
This invention relates to image processing, specifically to a controller that enhances image quality by dynamically adjusting pixel intensity values. The problem addressed is the need for improved image clarity and detail, particularly in low-light or high-noise conditions, where traditional fixed-intensity processing fails to capture fine details. The controller determines at least one kernel for each pixel based on the initial pixel intensity. A kernel is a matrix of weights used to modify pixel values, and its selection depends on the pixel's brightness level. For example, darker pixels may use a kernel optimized for noise reduction, while brighter pixels may use a kernel that enhances contrast. The controller then calculates the final pixel intensity value by applying the selected kernel to the original pixel data. This adaptive approach ensures that each pixel is processed according to its specific characteristics, improving overall image quality without introducing artifacts. The invention builds on a broader system that includes capturing image data and processing it to generate an output image. The controller dynamically adjusts processing parameters in real-time, allowing for efficient and accurate image enhancement. This method is particularly useful in applications like medical imaging, surveillance, and consumer electronics, where high-quality visual output is critical. The adaptive kernel selection and intensity adjustment provide a more refined and detailed image compared to static processing techniques.
5. The controller of claim 1 , wherein at least two of the displays are located at a different focal distance from one another.
This invention relates to a controller system for managing multiple displays in a computing environment, particularly addressing the challenge of optimizing user interaction with displays positioned at varying focal distances. The system includes a controller that dynamically adjusts display parameters based on the physical arrangement of the displays, ensuring consistent and efficient user interaction. The controller monitors the spatial configuration of the displays, including their relative positions and focal distances, to adapt content presentation accordingly. For example, if two displays are positioned at different focal distances from the user, the controller adjusts brightness, contrast, or resolution to compensate for the varying distances, enhancing readability and reducing eye strain. The system may also prioritize content on displays closer to the user or adjust input responsiveness based on focal distance. Additionally, the controller can synchronize interactions across multiple displays, ensuring seamless transitions and consistent performance regardless of their physical arrangement. This invention improves usability in multi-display setups by dynamically adapting to the spatial constraints of the environment, making it particularly useful in workstations, control rooms, or collaborative workspaces where displays are often positioned at different distances from the user.
6. The controller of claim 1 , wherein an optical distance between the eye and at least one display in the plurality of displays is adjustable, and the controller is further configured to change the optical distance based on a measured accommodation of the eye.
This invention relates to an adjustable optical display system designed to enhance visual comfort and clarity for users, particularly in augmented or virtual reality applications. The system addresses the problem of eye strain and visual discomfort caused by fixed focal distances in conventional displays, which do not accommodate natural eye adjustments (accommodation) when viewing objects at varying distances. The system includes a plurality of displays positioned at different optical distances from the user's eye. A controller dynamically adjusts the optical distance between the eye and at least one of these displays based on real-time measurements of the eye's accommodation. This adjustment ensures that the displayed content aligns with the eye's natural focusing mechanism, reducing strain and improving visual clarity. The controller may also manage other display parameters, such as brightness or resolution, to further optimize the viewing experience. By dynamically adjusting the display distance in response to eye accommodation, the system provides a more ergonomic and comfortable viewing experience compared to static displays. This is particularly useful in applications requiring prolonged use, such as virtual reality headsets or augmented reality devices, where fixed focal distances can lead to fatigue and discomfort. The invention improves upon prior art by integrating real-time accommodation tracking with adjustable display positioning, creating a more adaptive and user-friendly visual interface.
7. The controller of claim 1 , wherein the controller is further configured to: determine information about an accommodation of the eye responsive to decomposition of the scene related to the content displayed across the plurality of displays, based on the determined pixel intensity value for each pixel in at least the portion of the plurality of pixels; and modify the information about the gaze direction based in part on the determined information about the accommodation of the eye.
This invention relates to eye-tracking systems that adjust gaze direction measurements based on eye accommodation, particularly in multi-display environments. The problem addressed is the inaccuracy of conventional eye-tracking systems when a user views content across multiple displays, as these systems often fail to account for changes in eye accommodation (the adjustment of the eye's lens to focus on objects at different distances). This leads to errors in gaze direction estimation, especially when displays are at varying depths or angles relative to the user. The system includes a controller that processes visual content displayed across multiple displays. The controller analyzes pixel intensity values for at least a portion of the pixels in the displays to decompose the scene and determine how the eye accommodates to different parts of the content. Using this accommodation information, the controller refines the estimated gaze direction, improving accuracy. The accommodation data is derived from the pixel intensity values, which help identify which parts of the scene the eye is focusing on. By incorporating this accommodation information, the system corrects for distortions caused by multi-display setups, ensuring more precise gaze tracking. This approach is particularly useful in applications like virtual reality, augmented reality, and multi-monitor workstations where accurate eye tracking is critical.
8. The controller of claim 1 , wherein the controller is further configured to: determine a plurality of correlation values related to the plurality of pixels of the plurality of displays; determine a first pixel intensity value for the at least one pixel by modifying an initial pixel intensity value for the at least one pixel using at least one numerical iteration applied on blur gradient correlation values obtained based on the plurality of correlation values; determine a second pixel intensity value for the at least one pixel by applying at least one numerical iteration on the first intensity value; and determine the pixel intensity value for the at least one pixel by modifying the second pixel intensity value based on the information about the gaze direction.
This invention relates to display systems that adjust pixel intensity based on viewer gaze direction to improve visual clarity and reduce blur. The problem addressed is the distortion and blurring of displayed images when viewed from off-center angles, which degrades visual quality. The system includes a controller that processes pixel data to compensate for these distortions dynamically. The controller first determines correlation values for pixels across multiple displays, analyzing how pixel intensities interact spatially. It then calculates a first pixel intensity value by modifying an initial intensity using numerical iterations applied to blur gradient correlation values derived from the correlation data. This step refines the intensity to account for spatial blur effects. Next, the controller computes a second pixel intensity value by applying additional numerical iterations to the first intensity value, further optimizing the display output. Finally, the controller adjusts the pixel intensity based on the viewer's gaze direction, ensuring the displayed image appears sharp and clear from the viewer's perspective. The system dynamically adapts to changes in gaze direction, enhancing visual quality for off-axis viewing. This approach improves image clarity in multi-display environments by compensating for geometric and optical distortions.
9. The controller of claim 8 , wherein the controller is further configured to: apply a mapping transformation to the second pixel intensity value for the at least one pixel to map the second pixel intensity value from a focal plane of a display in the plurality of displays to a focal plane perpendicular to the gaze direction for the eye.
This invention relates to a controller for a multi-display system that adjusts pixel intensity values based on a user's gaze direction to enhance visual perception. The system includes multiple displays arranged at different focal planes, each capable of displaying content at varying depths. The controller receives a first pixel intensity value for at least one pixel in the display system and determines a gaze direction of a user's eye relative to the displays. Based on the gaze direction, the controller calculates a second pixel intensity value for the pixel, which compensates for differences in perceived brightness due to the angle of incidence of light on the eye. The controller then applies a mapping transformation to the second pixel intensity value to adjust it from the focal plane of the original display to a focal plane perpendicular to the gaze direction. This transformation ensures that the pixel intensity appears consistent regardless of the display's position relative to the user's line of sight, improving visual comfort and clarity. The system may also include eye-tracking hardware to monitor gaze direction in real-time, allowing dynamic adjustments as the user moves. The invention addresses the problem of varying brightness perception when viewing content at different depths in multi-display environments, particularly in augmented or virtual reality applications.
10. The controller of claim 1 , wherein the controller is further configured to: instruct the plurality of displays to display the content across the plurality of displays, based in part on the determined pixel intensity value for the at least one pixel in the portion of the plurality of pixels.
This invention relates to a controller for managing content display across multiple displays, addressing the challenge of maintaining visual consistency and quality when content is distributed across a tiled or multi-display setup. The controller determines pixel intensity values for at least one pixel in a portion of the pixels within the content, then uses these values to instruct the displays to render the content. The controller ensures that the content is displayed coherently across the displays, accounting for variations in pixel intensity to optimize visual output. This may involve adjusting brightness, contrast, or other display parameters to minimize discrepancies between adjacent displays. The system is designed to enhance the viewing experience in multi-display environments, such as video walls, digital signage, or large-scale visual installations, where seamless and uniform content presentation is critical. The controller dynamically adapts the display output based on real-time pixel intensity analysis, improving visual fidelity and reducing artifacts at display boundaries. The invention focuses on improving the synchronization and uniformity of content across multiple displays, addressing issues like brightness mismatches or color inconsistencies that can arise in such setups.
11. The controller of claim 1 , wherein the controller and the plurality of displays are part of a head-mounted display (HMD).
A head-mounted display (HMD) system includes a controller and multiple displays configured to present visual content to a user. The controller is designed to dynamically adjust the display of visual content across the multiple displays based on user interactions or environmental conditions. This adjustment may involve modifying the content's position, size, or visibility to enhance user experience or optimize performance. The system may also incorporate sensors to detect user movements or environmental factors, allowing the controller to adapt the display output in real-time. The multiple displays could be arranged in a way that provides a seamless or overlapping field of view, ensuring continuous and immersive visual presentation. The controller may further integrate with other HMD components, such as tracking systems or input devices, to refine the display adjustments. The overall system aims to improve visual clarity, reduce latency, and enhance user engagement in applications like virtual reality, augmented reality, or mixed reality environments.
12. A head-mounted display (HMD) comprising: a plurality of displays configured to emit image light; and a controller configured to: obtain information about a gaze direction for an eye, and determine a pixel intensity value for at least one pixel in a portion of a plurality of pixels of a plurality of displays to generate content for presentation, based at least in part on the information about the gaze direction and decomposition of a scene related to the content displayed across the plurality of displays.
A head-mounted display (HMD) system addresses the challenge of optimizing image quality and power efficiency in multi-display HMDs by dynamically adjusting pixel intensity based on user gaze direction. The system includes multiple displays that emit image light and a controller that processes gaze tracking data to determine the viewing direction of the user's eye. The controller then adjusts the pixel intensity of specific pixels in the displays, focusing on the portion of the scene being viewed by the user. This adjustment is based on both the gaze direction and a decomposition of the displayed scene across the multiple displays. By selectively enhancing pixel intensity in the viewed area while potentially reducing it in peripheral regions, the system improves visual fidelity where it matters most while conserving power. The decomposition of the scene ensures that the adjustments are contextually relevant to the content being displayed, allowing for a more efficient and adaptive rendering process. This approach enhances the overall user experience by maintaining high-quality visuals in the focal area while optimizing system performance.
13. The HMD of claim 12 , wherein the controller is further configured to: determine information about an accommodation of the eye responsive to decomposition of the scene related to the content displayed across the plurality of displays, based on the determined pixel intensity value for the at least one pixel; and modify the information about the gaze direction based in part on the determined information about the accommodation of the eye.
This invention relates to head-mounted displays (HMDs) and addresses the challenge of accurately tracking eye gaze direction while accounting for eye accommodation, which is the adjustment of the eye's lens to focus on objects at different distances. The HMD includes multiple displays that present content to a user, and a controller that processes visual information from the displays to determine the gaze direction of the user's eye. The controller analyzes the scene displayed across the displays, decomposing it to extract relevant visual data. It then determines the pixel intensity value for at least one pixel in the scene, which is used to assess the accommodation state of the eye—how the eye is focusing on the displayed content. The controller adjusts the gaze direction information based on this accommodation data, improving the accuracy of gaze tracking. This approach enhances the HMD's ability to interpret user interaction with virtual or augmented reality environments by providing more precise gaze direction measurements that account for the eye's natural focusing behavior. The invention is particularly useful in applications requiring high-fidelity eye tracking, such as virtual reality, augmented reality, and medical diagnostics.
14. The HMD of claim 12 , wherein the controller is further configured to: determine a plurality of correlation values related to the plurality of pixels of the plurality of displays; determine a first pixel intensity value for the at least one pixel by modifying an initial pixel intensity value for the at least one pixel using at least one numerical iteration applied on blur gradient correlation values obtained based on the plurality of correlation values; determine a second pixel intensity value for the at least one pixel by applying at least one numerical iteration on the first intensity value; and determine the pixel intensity value for the at least one pixel by modifying the second pixel intensity value based on the information about the gaze direction.
This invention relates to head-mounted displays (HMDs) and addresses the challenge of improving image clarity and reducing visual artifacts, particularly when displaying content to a user whose gaze direction is tracked. The system includes a controller that processes pixel intensity values to enhance image quality based on gaze direction and blur effects. The controller calculates correlation values for multiple pixels across multiple displays, then adjusts an initial pixel intensity value through numerical iterations using blur gradient correlation data. This produces a first pixel intensity value, which is further refined through additional numerical iterations to generate a second pixel intensity value. Finally, the controller modifies this second value based on gaze direction information to determine the final pixel intensity for display. The process ensures that the displayed image accounts for both the user's gaze position and optical distortions, improving visual fidelity. The invention is particularly useful in virtual reality (VR) and augmented reality (AR) applications where precise image rendering is critical for user experience.
15. The HMD of claim 14 , wherein the controller is further configured to: apply a mapping transformation to the second pixel intensity value for the at least one pixel to map the second pixel intensity value from a focal plane of a display in the plurality of displays to a focal plane perpendicular to the gaze direction for the eye.
This invention relates to head-mounted displays (HMDs) designed to enhance visual clarity and reduce eye strain by dynamically adjusting focal planes based on a user's gaze direction. The problem addressed is the mismatch between the fixed focal planes of traditional HMD displays and the varying focal demands of the human eye, which can cause discomfort and visual fatigue during prolonged use. The HMD includes multiple displays, each with adjustable focal planes, and a controller that tracks the user's gaze direction. The controller determines a second pixel intensity value for at least one pixel in the display based on the gaze direction, which differs from the original pixel intensity value. This adjustment compensates for optical distortions or intensity variations introduced by the display's focal plane adjustments. Additionally, the controller applies a mapping transformation to the second pixel intensity value to map it from the focal plane of the display to a focal plane perpendicular to the gaze direction. This ensures that the perceived image remains sharp and consistent regardless of where the user is looking, reducing eye strain and improving visual comfort. The system dynamically adapts to the user's gaze in real-time, providing a more natural and comfortable viewing experience.
16. The HMD of claim 12 , wherein the information about the gaze direction includes at least one of a vector gaze direction of the eye, and a distance between a center point of the eye and an origin point perpendicular to a center of a display of the plurality of displays, and the controller is further configured to: adjust the pixel intensity value based on the distance and a change in the vector gaze direction.
This invention relates to head-mounted displays (HMDs) and addresses the challenge of optimizing visual clarity and reducing eye strain by dynamically adjusting display output based on the user's gaze direction. The HMD includes multiple displays and a controller that processes gaze tracking data to determine the user's gaze direction. The gaze direction information includes a vector representing the eye's gaze direction and a distance measurement between the eye's center point and a reference origin perpendicular to the display center. The controller uses this data to adjust pixel intensity values in real-time, compensating for changes in gaze angle and distance to enhance image sharpness and reduce distortion. This adaptive adjustment ensures that the displayed content remains clear and comfortable for the user, even as their gaze shifts across the display. The system improves upon traditional HMDs by incorporating precise gaze tracking to dynamically optimize visual output, addressing issues like peripheral blur and eye strain in immersive environments.
17. A computer program product comprising a non-transitory computer-readable storage medium having instructions encoded thereon that, when executed by one or more processors, cause the one or more processors to: obtain information about a gaze direction for an eye; and determine a pixel intensity value for at least one pixel in a portion of a plurality of pixels of a plurality of displays to generate content for presentation, based at least in part on the information about the gaze direction and decomposition of a scene related to the content displayed across the plurality of displays.
This invention relates to gaze-tracking systems for multi-display environments, addressing the challenge of optimizing content presentation based on a user's gaze direction. The system uses gaze tracking to determine where a user is looking and adjusts pixel intensity values in specific display regions to enhance visual quality or reduce power consumption. The solution involves analyzing the gaze direction of an eye and decomposing a scene displayed across multiple displays to dynamically adjust pixel intensity in targeted areas. By focusing adjustments on the portion of the displays where the user is looking, the system improves visual fidelity or energy efficiency without uniformly altering all displays. The invention is implemented via a computer program that processes gaze data and modifies pixel intensity values accordingly, enabling adaptive display control in multi-screen setups. This approach is particularly useful in applications requiring high-resolution visual output or energy-efficient display management, such as virtual reality, augmented reality, or multi-monitor workstations. The system ensures that content is optimized for the user's current focus area while maintaining performance across all displays.
18. The computer program product of claim 17 , wherein an optical distance between the eye and at least one display in the plurality of displays is adjustable, and the instructions further cause the one or more processors to change the optical distance based on a measured accommodation of the eye.
This invention relates to an optical display system designed to enhance visual comfort and reduce eye strain by dynamically adjusting the optical distance between a user's eye and a display based on the eye's accommodation. The system includes multiple displays, each capable of presenting visual content at different focal planes. The optical distance between the eye and at least one display is adjustable, allowing the system to modify the perceived depth of the displayed content. The system measures the eye's accommodation, which refers to the eye's ability to focus on objects at varying distances, and adjusts the optical distance accordingly. This adjustment ensures that the displayed content aligns with the eye's natural focusing mechanism, reducing the need for excessive accommodation and minimizing visual fatigue. The system may also include eye-tracking sensors to monitor the user's gaze and further refine the adjustment of the optical distance. By dynamically adapting the display's focal plane to the user's eye, the invention aims to improve visual comfort, particularly during prolonged use of electronic devices. The technology is applicable to virtual reality, augmented reality, and other display systems where maintaining proper focus is critical.
19. The computer program product of claim 17 , wherein the instructions further cause the one or more processors to: determine information about an accommodation of the eye responsive to decomposition of the scene related to the content displayed across the plurality of displays, based on the determined pixel intensity value for the at least one pixel; and modify the information about the gaze direction based in part on the determined information about the accommodation of the eye.
This invention relates to eye-tracking systems that analyze gaze direction and accommodation (eye focus) to improve accuracy in multi-display environments. The problem addressed is the challenge of accurately tracking gaze direction when a user views content displayed across multiple displays, as traditional eye-tracking systems may not account for changes in eye accommodation when shifting focus between displays at different distances or angles. The system decomposes a scene displayed across multiple displays to determine pixel intensity values for at least one pixel in the scene. Using these values, it calculates information about the eye's accommodation, such as the depth or focus point of the eye. This accommodation data is then used to refine the estimated gaze direction, improving tracking accuracy. The system may also adjust the gaze direction based on the relative positions of the displays and the user's head pose, ensuring precise gaze estimation even when the user shifts attention between displays. By integrating accommodation data with traditional gaze-tracking methods, the invention enhances the reliability of eye-tracking in multi-display setups, which is useful for applications like virtual reality, augmented reality, and multi-monitor workstations. The system dynamically adapts to changes in eye focus, reducing errors caused by parallax or misalignment between displays.
20. The computer program product of claim 17 , wherein the instructions further cause the one or more processors to: determine a plurality of correlation values related to the plurality of pixels of the plurality of displays; determine a first pixel intensity value for the at least one pixel by modifying an initial pixel intensity value for the at least one pixel using at least one numerical iteration applied on blur gradient correlation values obtained based on the plurality of correlation values; determine a second pixel intensity value for the at least one pixel by applying at least one numerical iteration on the first intensity value; and determine the pixel intensity value for the at least one pixel by modifying the second pixel intensity value based on the information about the gaze direction.
This invention relates to image processing for display systems, specifically improving visual clarity for viewers based on gaze tracking. The technology addresses the problem of optimizing pixel intensity in multi-display environments to enhance perceived image quality while accounting for human visual perception and gaze direction. The system calculates correlation values for pixels across multiple displays to analyze spatial relationships and blur effects. For a selected pixel, an initial intensity value is refined through iterative numerical methods applied to blur gradient correlation data derived from the correlation values. This produces a first adjusted intensity value. A second iteration is then applied to this first value to further refine the pixel intensity. Finally, the system modifies the second intensity value based on gaze direction information, ensuring the pixel's brightness aligns with where the viewer is looking, improving visual fidelity. The method dynamically adjusts pixel intensities to reduce visual artifacts and enhance clarity in multi-display setups, particularly for applications requiring high visual precision, such as virtual reality or high-resolution imaging systems. The iterative refinement and gaze-dependent adjustments optimize the balance between computational efficiency and perceptual quality.
Unknown
September 15, 2020
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.