Systems and methods are described for extended reality environment interaction. An extended reality environment including an object is generated for display, and a sensor is used to detect a gaze directed to a first portion of the extended reality environment, where the object is included in the first portion of the extended reality environment. Opacity-based indicators are generated for display in the vicinity of the first portion of the extended reality environment, and a boundary of the object is identified. Based on the identified boundary of the object, an opacity of the at least one of the opacity-based indicators is varied.
Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A method for extended reality environment interaction, comprising: generating for display an extended reality environment comprising an object; detecting, by using a sensor, a gaze is directed to a first portion of the extended reality environment, the object being included in the first portion of the extended reality environment; generating for display within the extended reality environment a plurality of opacity-based indicators in the vicinity of the first portion of the extended reality environment; identifying a boundary of the object; and varying an opacity of the at least one of the plurality of opacity-based indicators based on the identified boundary of the object.
Extended reality (XR) technology. Problem: Providing intuitive and informative feedback to users interacting with virtual objects in an XR environment. This invention describes a method for interacting within an extended reality environment. The method involves creating an XR environment that includes a virtual object. A sensor is used to detect when a user's gaze is focused on a specific area within this environment, particularly when that area contains the virtual object. In response to this detected gaze, the system generates multiple visual indicators within the XR environment, positioned near the area of focus. These indicators are designed to change their transparency (opacity). The method also involves determining the outline or boundary of the virtual object. The transparency of at least one of these generated indicators is then adjusted based on the identified boundary of the object. This allows for dynamic visual feedback that can inform the user about the object's shape or extent within the XR space.
2. The method of claim 1 , further comprising: determining whether the at least one of the plurality of opacity-based indicators overlaps the boundary of the object; wherein varying the opacity of the at least one of the plurality of opacity-based indicators based on the boundary of the object comprises varying respective opacities of the at least one plurality of opacity-based indicators that overlap the boundary.
This invention relates to a method for visually representing data in a graphical user interface, particularly for enhancing the clarity of data indicators when they overlap or interact with object boundaries. The problem addressed is the visual ambiguity that arises when data indicators, such as markers or annotations, are displayed near or over object boundaries, making it difficult for users to discern the relationship between the indicators and the underlying objects. The method involves displaying a plurality of opacity-based indicators in association with an object in a graphical user interface. These indicators are used to represent data or metadata related to the object. The method further includes determining whether any of these indicators overlap the boundary of the object. If an overlap is detected, the opacity of the overlapping indicators is varied to distinguish them from the object boundary. This variation in opacity helps users visually separate the indicators from the object, improving clarity and reducing visual clutter. The method ensures that only the indicators that overlap the object boundary have their opacity adjusted, while non-overlapping indicators remain unaffected. This selective adjustment prevents unnecessary visual modifications and maintains the integrity of the data representation. The technique is particularly useful in applications where precise visual differentiation between indicators and object boundaries is critical, such as in medical imaging, engineering diagrams, or data visualization tools.
3. The method of claim 1 , wherein the plurality of opacity-based indicators are arrows directed towards the object.
A system and method for enhancing visual perception of objects in a display environment addresses the challenge of effectively conveying information about objects, particularly in complex or cluttered visual fields. The invention provides a plurality of opacity-based indicators that dynamically adjust their transparency to improve visibility and reduce visual clutter. These indicators are arrows directed toward an object, ensuring clear directional guidance while maintaining a balanced visual presentation. The opacity of the indicators is modulated based on factors such as user interaction, environmental conditions, or object relevance, allowing for adaptive visibility. The arrows are positioned relative to the object to provide intuitive directional cues, enhancing user comprehension and interaction efficiency. The system may also incorporate additional visual or auditory feedback to further assist in object identification and navigation. By dynamically adjusting the opacity and directionality of the indicators, the invention ensures that critical information remains accessible without overwhelming the user, thereby improving usability in various applications, including augmented reality, user interfaces, and navigation systems.
4. The method of claim 1 , further comprising: detecting, by using the sensor, whether the gaze has shifted to a second portion of the extended reality environment; and in response to determining that the gaze has shifted to the second portion, causing the plurality of opacity-based indicators to be overlaid in a vicinity of the second portion of the display.
This invention relates to extended reality (XR) systems, specifically methods for dynamically adjusting visual indicators based on user gaze tracking. The problem addressed is the need to provide intuitive and context-aware visual feedback in XR environments, where users interact with digital content overlaid on real or virtual surroundings. The solution involves detecting a user's gaze direction using sensors and dynamically updating opacity-based indicators in response to gaze shifts. The method includes tracking the user's gaze within the XR environment to determine when it shifts from a first portion to a second portion of the display. Upon detecting this shift, the system overlays a plurality of opacity-based indicators near the second portion. These indicators are visual elements that vary in transparency to guide the user's attention or interaction. The indicators may include markers, highlights, or other visual cues that help users navigate or interact with the XR environment more effectively. The system ensures that the indicators are contextually relevant by adjusting their position and opacity based on real-time gaze data, enhancing user experience and reducing cognitive load. The method may also involve pre-processing the XR environment to identify regions of interest where indicators should be placed, ensuring seamless integration with the user's field of view.
5. The method of claim 1 , wherein the respective opacities are varied based on a distance from the object.
This invention relates to a method for adjusting the opacity of visual elements in a display system, particularly for enhancing the visibility of objects in a three-dimensional (3D) environment. The problem addressed is the difficulty in clearly perceiving objects in complex 3D scenes where overlapping elements can obscure important information. The solution involves dynamically varying the opacity of visual elements based on their distance from a target object, ensuring that closer elements remain more transparent while farther elements become more opaque. This technique improves depth perception and reduces visual clutter, making it easier for users to focus on the primary object of interest. The method can be applied in various applications, including augmented reality (AR), virtual reality (VR), medical imaging, and computer-aided design (CAD), where depth and clarity are critical. The opacity adjustment is performed in real-time, allowing seamless interaction with the 3D environment. The invention ensures that the visual hierarchy is maintained, enhancing user experience and efficiency in tasks requiring spatial awareness.
6. The method of claim 5 , wherein the respective opacities of the indicators increase as the distance between the respective indicator and the object decreases.
This invention relates to a system for visually representing spatial relationships between objects in a three-dimensional environment, particularly for enhancing user awareness of proximity and interaction potential. The problem addressed is the difficulty in intuitively perceiving distances and spatial relationships in virtual or augmented reality environments, where traditional two-dimensional indicators may not effectively convey depth or proximity. The system includes a display device that renders a plurality of indicators in a three-dimensional space, each associated with a distinct object. The indicators are visually distinct from the objects they represent, allowing users to easily identify and track them. The indicators are positioned at fixed offsets relative to their respective objects, ensuring consistent spatial relationships regardless of the objects' movements. A key feature is the dynamic adjustment of indicator opacity based on proximity. As an indicator moves closer to its associated object, its opacity increases, creating a visual cue that highlights the decreasing distance. This progressive opacity change helps users quickly assess spatial relationships without requiring precise measurements. The indicators may also vary in other visual properties, such as size or color, to further enhance clarity. The system is particularly useful in applications like virtual reality navigation, augmented reality interfaces, or collaborative environments where spatial awareness is critical. By providing intuitive, visually distinct indicators with proximity-based opacity adjustments, the invention improves user interaction and reduces cognitive load in complex three-dimensional spaces.
7. The method of claim 5 , wherein the respective opacities of the indicators increase as the distance between the respective indicator and the object increases.
This invention relates to a method for visually representing spatial relationships between objects in a three-dimensional environment, particularly for enhancing depth perception and user interaction in augmented or virtual reality systems. The problem addressed is the difficulty in accurately perceiving distances and spatial relationships between objects in immersive digital environments, which can lead to confusion or inefficiency in user interactions. The method involves displaying indicators associated with objects in the environment, where each indicator's opacity varies based on its distance from the object it represents. Specifically, the opacity of an indicator increases as the distance between the indicator and the object increases. This creates a visual gradient where closer objects have more transparent indicators, while farther objects have more opaque indicators, providing a clear and intuitive depth cue. The indicators may be visual markers, lines, or other graphical elements that help users distinguish between objects at different depths. The method may also include dynamically adjusting the indicators in real-time as the user's position or the objects' positions change, ensuring consistent spatial awareness. This approach improves user experience by reducing visual clutter and enhancing the perception of depth, making it particularly useful in applications such as navigation, object selection, or spatial data visualization in augmented or virtual reality.
8. The method of claim 1 , wherein an interactive media guide is provided on the display, and an action related to a media asset accessible via the interactive media guide is received at least in part based on the detected gaze.
This invention relates to interactive media systems that use gaze detection to enhance user interaction with media content. The problem addressed is the need for more intuitive and efficient ways to navigate and control media assets, such as videos, images, or applications, without relying solely on traditional input methods like remote controls or touchscreens. The system provides an interactive media guide displayed on a screen, allowing users to browse and select media assets. A gaze-tracking system detects the user's eye movements, determining where they are looking on the display. When the user focuses on a specific media asset within the guide, the system interprets this gaze as an intent to perform an action, such as selecting, playing, or pausing the content. The system may also combine gaze detection with other inputs, like voice commands or physical gestures, to confirm or refine the action. The method ensures that media interactions are more natural and responsive, reducing the need for manual navigation. By analyzing gaze patterns, the system can predict user preferences and prioritize relevant content, improving the overall media consumption experience. This approach is particularly useful in environments where traditional input methods are inconvenient, such as large displays or hands-free setups. The invention aims to streamline media access while minimizing user effort, making it ideal for smart TVs, digital signage, or virtual reality applications.
9. The method of claim 1 , wherein the display is presented via an extended reality head-mounted device.
This invention relates to extended reality (XR) systems, specifically methods for presenting displays via head-mounted devices (HMDs) to enhance user interaction with digital content. The technology addresses challenges in immersive computing, such as maintaining user engagement and providing intuitive interfaces in virtual, augmented, or mixed reality environments. The method involves generating a display that includes a virtual object and a user interface element, where the virtual object is positioned relative to the user's gaze or head movement. The user interface element is dynamically adjusted based on the user's interaction, such as gaze duration or head pose, to improve accessibility and responsiveness. The display is rendered through an XR HMD, which may include sensors to track the user's position and orientation in real time. The system ensures that the virtual object and interface remain aligned with the user's field of view, reducing cognitive load and enhancing immersion. Additional features include adaptive scaling of the user interface based on interaction patterns and context-aware adjustments to the virtual object's behavior. The method may also incorporate haptic feedback or audio cues to reinforce visual interactions, further improving user experience in XR applications. The invention is applicable in gaming, training simulations, and productivity tools where seamless interaction with digital content is critical.
10. The method of claim 1 , wherein the display is presented without the use of an extended reality head-mounted device.
A system and method for presenting a display without requiring an extended reality (XR) head-mounted device (HMD) addresses the need for immersive or augmented visual experiences in environments where traditional HMDs are impractical or undesirable. The invention provides a display system that generates a visual output, such as a virtual or augmented reality scene, using a non-HMD interface. This may include a flat-panel display, a projection system, or other screen-based output. The system processes input data, such as user interactions or environmental sensors, to dynamically adjust the displayed content in real time. The display may incorporate depth perception, spatial mapping, or other XR-like features without the need for a head-worn device. This approach enables immersive experiences in settings like public spaces, workplaces, or shared environments where HMDs are not feasible. The method ensures seamless integration of virtual elements with the physical world, enhancing user engagement while maintaining accessibility. The invention may also include tracking mechanisms, such as eye or hand tracking, to personalize the display experience further. By eliminating the need for an HMD, the system broadens the applicability of XR technologies to a wider range of use cases.
11. A system for extended reality environment interaction, comprising: a display; control circuitry configured to: generate for display an extended reality environment comprising an object; detect, by using a sensor, a gaze is directed to a first portion of the extended reality environment, the object being included in the first portion of the extended reality environment; generate for display within the extended reality environment a plurality of opacity-based indicators in the vicinity of the first portion of the extended reality environment; identify a boundary of the object; and vary an opacity of the at least one of the plurality of opacity-based indicators based on the identified boundary of the object.
This system relates to extended reality (XR) environments, addressing the challenge of enhancing user interaction by providing visual feedback for object selection. The system includes a display and control circuitry that generates an XR environment containing an object. A sensor detects when a user's gaze is directed toward a specific portion of the environment where the object is located. In response, the system displays multiple opacity-based indicators near that portion. These indicators are visual cues that help users identify and select objects in the XR space. The control circuitry identifies the boundary of the object and adjusts the opacity of the indicators based on this boundary, ensuring the indicators align with the object's edges. This dynamic adjustment improves user awareness of the object's position and boundaries, facilitating more precise interactions. The system enhances usability in XR applications by providing clear, adaptive visual feedback that responds to user gaze and object characteristics.
12. The system of claim 11 , wherein the control circuitry is further configured to: determine whether the at least one of the plurality of opacity-based indicators overlaps the boundary of the object; in varying the opacity of the at least one of the plurality of opacity-based indicators based on the boundary of the object, vary respective opacities of the at least one plurality of opacity-based indicators that overlap the boundary.
This invention relates to a system for displaying opacity-based indicators in relation to an object, particularly focusing on adjusting the opacity of these indicators when they overlap the object's boundary. The system addresses the challenge of visually representing data or annotations in a way that maintains clarity and avoids visual clutter when indicators intersect with the edges of an object. The control circuitry in the system is designed to detect whether any of the opacity-based indicators overlap the boundary of the object. When such an overlap occurs, the system dynamically adjusts the opacity of the overlapping indicators to enhance visibility and reduce visual interference. This adjustment ensures that the indicators remain distinguishable while maintaining a clean and unobstructed view of the object. The system may be used in applications such as graphical user interfaces, data visualization, or augmented reality, where clear and adaptive visual feedback is essential. The opacity variation is applied specifically to the indicators that overlap the boundary, allowing for precise control over the visual presentation. This approach improves user experience by preventing visual conflicts and ensuring that important information remains accessible.
13. The system of claim 11 , wherein the plurality of opacity-based indicators are arrows directed towards the object.
A system for visualizing data in a three-dimensional (3D) environment addresses the challenge of effectively conveying directional information in complex spatial datasets. The system includes a display device that renders a 3D environment containing an object and a plurality of opacity-based indicators. These indicators are arrows that point toward the object, with their opacity levels adjusted based on their relevance or importance to the object. The arrows are dynamically rendered to ensure they remain visible and distinguishable from the background and other objects in the environment. The system may also include a processing unit that calculates the opacity values for the indicators based on predefined criteria, such as distance, angle, or user-defined parameters. The indicators are positioned in the 3D space to provide clear directional guidance without obstructing the view of the object. This approach enhances user comprehension of spatial relationships and improves navigation in 3D datasets. The system may further include user input mechanisms to adjust the opacity or other visual properties of the indicators in real time. The overall design ensures that the directional cues are both informative and unobtrusive, supporting applications in fields such as medical imaging, engineering simulations, and virtual reality.
14. The system of claim 11 , wherein the control circuitry is further configured to: detect, by using the sensor, whether the gaze has shifted to a second portion of the extended reality environment; and in response to determining that the gaze has shifted to the second portion, cause the plurality of opacity-based indicators to be overlaid in a vicinity of the second portion of the display.
This invention relates to extended reality (XR) systems, specifically improving user interaction by dynamically adjusting visual indicators based on gaze tracking. The problem addressed is the difficulty in navigating and interacting with XR environments, where users may struggle to identify interactive elements or understand spatial relationships. The system includes a display for presenting an XR environment, a sensor for detecting user gaze direction, and control circuitry. The control circuitry generates a plurality of opacity-based indicators, which are visual markers that vary in transparency to guide the user. These indicators are overlaid near interactive elements or areas of interest in the XR environment. The system detects when the user's gaze shifts to a second portion of the environment and, in response, updates the position of the opacity-based indicators to remain in the vicinity of the newly focused area. This dynamic adjustment ensures that the indicators remain relevant to the user's current focus, enhancing usability and reducing cognitive load. The indicators may be used to highlight interactive objects, navigation paths, or other contextual information, improving the user's ability to interact with the XR environment efficiently. The system may also include additional features such as adjusting indicator opacity based on user proximity or interaction history to further refine the user experience.
15. The system of claim 11 , wherein the respective opacities are varied based on a distance from the object.
A system for visualizing objects in a three-dimensional space adjusts the opacity of graphical elements based on their distance from a reference object. The system includes a display device, a processor, and a memory storing instructions that, when executed, cause the processor to render a graphical representation of an object in a three-dimensional space. The graphical representation includes multiple graphical elements, each with an adjustable opacity. The system determines the distance of each graphical element from the reference object and adjusts the opacity of each element proportionally to this distance. Closer elements may appear more opaque, while farther elements may appear more transparent, enhancing depth perception and clarity in the visualization. This technique is particularly useful in applications such as medical imaging, architectural modeling, or virtual reality, where distinguishing overlapping or densely packed structures is critical. The system dynamically updates the opacities in real-time as the reference object or the viewer's perspective changes, ensuring continuous visual clarity. The method improves user interaction by reducing visual clutter and improving the ability to focus on specific regions of interest within the three-dimensional space.
16. The system of claim 15 , wherein the respective opacities of the indicators increase as the distance between the respective indicator and the object decreases.
This invention relates to a visual indicator system for displaying proximity information between objects in a graphical user interface. The system addresses the challenge of effectively conveying spatial relationships in digital environments where users may need to understand the relative positions of objects, such as in augmented reality, navigation systems, or data visualization tools. The system includes a display device that renders a graphical user interface containing at least one object and multiple indicators. Each indicator is associated with a specific object and visually represents its position relative to other objects. The indicators are displayed with varying opacities, where the opacity of an indicator increases as its distance to the associated object decreases. This dynamic opacity adjustment enhances visual clarity by making nearby indicators more prominent while reducing clutter from distant indicators. The system may also include a processor that calculates the distances between objects and adjusts the opacities of the indicators accordingly. Additionally, the indicators may be color-coded or shaped differently to further distinguish them from one another. The system ensures that users can quickly and accurately perceive spatial relationships, improving usability in applications requiring precise positional awareness.
17. The system of claim 15 , wherein the respective opacities of the indicators increase as the distance between the respective indicator and the object increases.
This invention relates to a system for visually representing spatial relationships between objects in a three-dimensional environment, particularly for enhancing user awareness of proximity and distance in augmented or virtual reality applications. The system addresses the challenge of effectively conveying depth and spatial positioning in immersive digital environments, where traditional two-dimensional indicators may fail to provide intuitive distance cues. The system includes a display device that renders a plurality of indicators in a three-dimensional space, each indicator corresponding to a distinct object. The indicators are visually distinct from the objects they represent, allowing users to easily identify and track multiple objects simultaneously. The indicators are positioned relative to their corresponding objects in a manner that preserves spatial relationships, ensuring that the arrangement of indicators accurately reflects the actual positions of the objects in the environment. A key feature of the system is the dynamic adjustment of indicator opacity based on distance. The opacity of each indicator increases as the distance between the indicator and its corresponding object grows. This visual cue helps users quickly assess relative distances, with more distant objects having more opaque indicators, making them stand out more prominently. The system may also include additional visual or auditory feedback to further enhance spatial awareness, such as color changes, size variations, or sound cues that vary with distance. The overall design aims to improve user interaction and navigation in complex three-dimensional environments by providing clear, intuitive spatial information.
18. The system of claim 11 , wherein an interactive media guide is provided on the display, and an action related to a media asset accessible via the interactive media guide is received at least in part based on the detected gaze.
This invention relates to interactive media systems that use gaze detection to enhance user interaction with media content. The system includes a display for presenting an interactive media guide, which allows users to browse and select media assets such as videos, shows, or other content. A gaze detection mechanism tracks the user's eye movements to determine where they are looking on the display. The system then interprets these gaze inputs as commands or selections related to the media guide. For example, if the user gazes at a specific media asset in the guide, the system may highlight, select, or initiate playback of that asset. The system may also combine gaze detection with other input methods, such as voice or touch, to refine the user's intent. This approach improves accessibility and reduces the need for traditional input devices, making media navigation more intuitive and efficient. The invention aims to solve the problem of cumbersome or inefficient media selection by leveraging natural eye movements as a primary or supplementary input method.
19. The system of claim 11 , wherein the display is presented via an extended reality head-mounted device.
This invention relates to a system for presenting visual information through an extended reality (XR) head-mounted device (HMD). The system addresses the challenge of effectively displaying data in immersive environments, particularly where traditional screens may be impractical or distracting. The XR HMD provides a wearable interface that overlays digital content onto the user's field of view, enhancing situational awareness and interaction in real-world or virtual settings. The system includes a processing unit that generates visual content, such as augmented reality (AR) overlays or virtual reality (VR) scenes, and a display module integrated into the HMD. The display module renders the visual content in a manner that aligns with the user's perspective, ensuring seamless integration with the physical or virtual environment. The system may also incorporate sensors, such as cameras or motion trackers, to dynamically adjust the displayed content based on the user's movements or surroundings. Additionally, the system supports user input methods, such as gestures or voice commands, to interact with the displayed content. This allows for hands-free operation, which is particularly useful in applications like industrial training, medical procedures, or navigation. The XR HMD may also include haptic feedback mechanisms to provide tactile responses, further enhancing immersion and usability. By leveraging XR technology, the system enables users to access and manipulate digital information in a natural and intuitive way, improving efficiency and reducing cognitive load in various professional and consumer applications.
20. The system of claim 11 , wherein the display is presented without the use of an extended reality head-mounted device.
A system for visualizing data or virtual content in a physical environment without requiring an extended reality (XR) head-mounted device (HMD). The system includes a display device, such as a monitor or projector, that presents visual information in a way that aligns with or overlays onto the real-world environment. The display may use spatial mapping or tracking to ensure accurate positioning of virtual elements relative to physical objects. The system may also incorporate sensors or cameras to detect the user's position and adjust the display accordingly, ensuring a seamless integration of virtual content with the real world. This approach eliminates the need for wearable XR devices, making the system more accessible and reducing barriers to adoption. The display may be configured to provide interactive or dynamic content, allowing users to engage with virtual elements in a natural way. The system may also include input devices, such as gestures or voice commands, to enable user interaction with the displayed content. By avoiding the use of HMDs, the system provides a more inclusive and comfortable experience for users who may be hesitant to use head-mounted displays. The technology is particularly useful in applications such as education, training, remote collaboration, and entertainment, where immersive experiences are desired without the constraints of wearable devices.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
October 20, 2020
March 22, 2022
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.