Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A method performed by one or more computing devices, the method comprising: scanning image information reflecting different regions of environment for an indication of a physical marker, the image information being captured by at least one image capture device; in an instance when an individual region being scanned does not include the physical marker, outputting a search indicator conveying that the environment is being scanned for the physical marker; responsive to detecting an indication that the physical marker is present in a particular region of the environment, initiating a position-determining process for the physical marker, the position-determining process comprising: receiving a first instance of image information captured by the at least one image capture device while positioned at a first vantage point in the environment; identifying a first instance of marker information in the first instance of image information that depicts the physical marker; instructing, via a user interface, a user to move to a second vantage point within the environment relative to the physical marker; receiving a second instance of image information captured by said at least one image capture device while positioned at the second vantage point in the environment; processing the second instance of image information to identify a second instance of marker information that depicts the physical marker; and determining a position of the physical marker in the environment relative to the at least one image capture device based on at least the first instance of marker information and the second instance of marker information.
This invention relates to a method for detecting and determining the position of a physical marker within an environment using image capture devices. The method addresses the challenge of accurately locating markers in environments where initial scans may not immediately detect the marker, ensuring users can efficiently pinpoint its position. The process begins by scanning image data from different regions of the environment to search for the marker. If the marker is not found in a scanned region, a search indicator is displayed to inform the user that the environment is being scanned. Upon detecting the marker in a specific region, a position-determining process is initiated. This involves capturing a first set of image data from a first vantage point, identifying the marker within that data, and then instructing the user to move to a second vantage point. A second set of image data is captured from this new position, and the marker is identified again. The system then calculates the marker's position relative to the image capture device by analyzing the marker's depiction in both sets of image data. This method ensures precise marker localization by leveraging multiple viewpoints and user interaction.
2. The method of claim 1 , wherein said one or more computing devices are associated with a head-mounted display.
A head-mounted display (HMD) system includes one or more computing devices that process visual data to generate a virtual environment for display. The system tracks the user's head movements and adjusts the displayed content in real-time to maintain spatial coherence, ensuring the virtual environment aligns with the user's perspective. The computing devices may also incorporate sensors to detect environmental conditions, such as lighting or obstacles, and dynamically modify the virtual content to enhance immersion. Additionally, the system may support multi-user interactions, where multiple HMDs synchronize their virtual environments to enable shared experiences. The computing devices handle rendering, latency compensation, and user input processing to provide a seamless and responsive experience. The system may also include haptic feedback mechanisms to enhance tactile interaction within the virtual environment. The overall goal is to create a highly immersive and interactive virtual reality experience by dynamically adapting the displayed content based on user movements and environmental factors.
3. The method of claim 1 , wherein the search indicator comprises a display feature presented on the user interface.
A system and method for enhancing user interaction with a digital interface involves presenting a search indicator as a display feature on the user interface to improve search functionality. The search indicator is designed to guide users toward search-related actions, making it easier to locate and initiate searches within the interface. This feature helps address the problem of users struggling to find or recognize search capabilities in complex or cluttered digital environments, thereby improving usability and efficiency. The search indicator may include visual elements such as icons, text, or animations that highlight search options, ensuring users can quickly identify and access search functions. By integrating this display feature, the system ensures that search functionality is prominently visible, reducing the time and effort required for users to perform searches. The method may also involve dynamically adjusting the search indicator based on user behavior or context, further optimizing the search experience. This approach enhances user engagement and satisfaction by streamlining the search process within the interface.
4. The method of claim 1 , further comprising: after detecting the indication that the physical marker is present in the particular region of the environment, displaying a progress indicator that conveys an extent of progress of said one or more computing devices in confirming that the first instance of marker information depicts the physical marker.
This invention relates to systems for detecting and confirming the presence of physical markers in an environment using computing devices. The problem addressed is the need for reliable marker detection and verification in applications such as augmented reality, robotics, or navigation, where computing devices must accurately identify and confirm the presence of physical markers to perform tasks like localization, object tracking, or environmental mapping. The method involves one or more computing devices detecting an indication that a physical marker is present in a specific region of the environment. After detection, the system displays a progress indicator that shows the extent of progress in confirming whether the detected marker information accurately represents the physical marker. This progress indicator provides real-time feedback to users or other systems, ensuring transparency and reliability in the marker verification process. The method may also include capturing marker information from the environment, comparing the captured information to stored marker data, and determining whether the captured information matches the stored data to confirm the marker's presence. The progress indicator dynamically updates as the computing devices process and verify the marker information, allowing users to monitor the verification process until confirmation is achieved. This approach enhances accuracy and user confidence in marker-based systems.
5. The method of claim 4 , wherein the progress indicator corresponds to a display feature that grows in length in proportion to the progress.
A method for visually representing progress in a digital system involves a progress indicator that dynamically adjusts its length based on the completion status of a task. The indicator is part of a user interface that monitors and displays the advancement of an operation, such as data processing, file transfer, or software installation. The indicator's length increases incrementally as the task progresses, providing a clear and intuitive visual cue to the user. This approach ensures that users can easily track the status of ongoing processes without requiring numerical or textual updates. The method may also incorporate additional visual or auditory feedback to enhance user awareness. The progress indicator is designed to be responsive, updating in real-time as the task advances, and may include features such as color changes or animations to further emphasize progress milestones. This technique is particularly useful in applications where users need continuous feedback on long-running operations, improving user experience and reducing uncertainty. The system may also include error detection mechanisms that alter the indicator's appearance if an issue arises, allowing users to quickly identify and address problems.
6. The method of claim 4 , further comprising displaying a representation of the first instance of marker information on a display device, wherein the progress indicator corresponds to a display feature that advances around the representation of the first instance of marker information in proportion to the progress.
This invention relates to systems for tracking and displaying progress through marker information, such as waypoints or checkpoints in a sequence. The problem addressed is the need for a clear, visual representation of progress through a series of markers, ensuring users can easily track their position and advancement. The method involves displaying a representation of a first instance of marker information on a display device. A progress indicator is used to show advancement through the marker sequence. This indicator corresponds to a display feature that moves or advances around the representation of the first marker in direct proportion to the progress made. For example, if the marker is a circular icon, the progress indicator could be an arc or pointer that rotates around it as progress is made. The method may also include detecting a user's position relative to the marker, determining the progress based on this position, and updating the progress indicator accordingly. The display feature could be a visual element such as a line, arrow, or animated effect that dynamically changes to reflect real-time progress. This ensures users have an intuitive understanding of their current status within the sequence. The system may also include additional markers, where the progress indicator adjusts based on the user's movement through multiple markers. The invention improves user experience by providing a clear, real-time visual cue of progress through a defined sequence of markers.
7. The method of claim 1 , further comprising: providing, on the user interface, a movement indicator that describes a plurality of vantage points to which the user is invited to move along a path.
A system and method for enhancing user interaction with a virtual or augmented reality environment involves providing a user interface that displays a movement indicator. This indicator guides the user along a predefined path, suggesting multiple vantage points from which the user can view or interact with the environment. The movement indicator dynamically updates as the user progresses, ensuring they remain aware of available viewing positions. The system may also include features such as real-time adjustments to the path based on user input or environmental changes, ensuring an immersive and intuitive navigation experience. The primary problem addressed is the lack of intuitive guidance in virtual or augmented reality environments, which can lead to disorientation or inefficient exploration. By providing clear, visually guided movement suggestions, the system improves user engagement and spatial awareness within the digital environment. The method may be applied in various contexts, including gaming, training simulations, and virtual tours, where precise navigation and user guidance are essential.
8. The method of claim 7 , further comprising: as individual instances of marker information are successfully identified at individual vantage points, updating the movement indicator to indicate that the individual instances of marker information have been successfully identified at the individual vantage points.
This invention relates to a system for tracking and identifying marker information from multiple vantage points, particularly in applications such as augmented reality, robotics, or automated surveillance. The problem addressed is the need to accurately detect and verify the presence of marker information, such as visual tags or identifiers, across different perspectives to ensure reliable tracking and interaction with objects or environments. The method involves using multiple vantage points to capture marker information, which may include visual markers, barcodes, or other identifiable patterns. As each vantage point successfully identifies an instance of the marker information, a movement indicator is updated to reflect this confirmation. This ensures that the system can dynamically track the marker's position and orientation, even as it moves or changes perspective. The movement indicator may be a visual or data-based representation that helps determine the marker's status, such as whether it has been fully recognized or partially obscured. The system may also include preprocessing steps to enhance marker detection, such as filtering noise or adjusting for lighting conditions. Once markers are identified, their positional data is compared across vantage points to confirm consistency and accuracy. This method improves reliability in applications where precise tracking is critical, such as in robotics navigation, augmented reality overlays, or automated quality inspection. The invention ensures that markers are not only detected but also verified across multiple viewpoints, reducing errors and improving system robustness.
9. The method of claim 1 , further comprising receiving at least one additional instance of image information, and, for each additional instance of image information that is collected at a particular vantage point, identifying at least one additional instance of marker information.
This invention relates to a system for capturing and processing image information from multiple vantage points to identify marker information. The technology addresses the challenge of accurately detecting and tracking markers in dynamic environments where images are captured from varying perspectives. The method involves collecting image information from a primary vantage point and then receiving at least one additional instance of image information from different vantage points. For each additional instance of image information collected, the system identifies at least one additional instance of marker information. This process enhances the accuracy and reliability of marker detection by leveraging multiple viewpoints, which helps mitigate errors caused by occlusions, lighting variations, or perspective distortions. The system may be used in applications such as augmented reality, robotics, or computer vision, where precise marker identification is critical. By integrating data from multiple vantage points, the invention improves the robustness of marker detection in real-world scenarios.
10. The method of claim 1 , wherein said determining comprises: using the first instance of marker information to virtually project a first ray into the environment based on at least a position of the first instance of marker information in the first instance of image information and a placement of said at least one image capture device in the environment while at the first vantage point; using the second instance of marker information to virtually project a second ray into the environment based on at least a position of the second instance of marker information in the second instance of image information and a placement of said at least one image capture device in the environment while at the second vantage point; identifying an intersection of the first ray and the second ray; and determining the position of the physical marker based at least on the intersection.
This invention relates to a method for determining the position of a physical marker in an environment using multiple image capture devices positioned at different vantage points. The method addresses the challenge of accurately locating markers in three-dimensional space by leveraging visual data from multiple perspectives. The system captures a first instance of image information containing a first instance of marker information from a first vantage point and a second instance of image information containing a second instance of marker information from a second vantage point. The method then uses the first instance of marker information to project a first virtual ray into the environment, considering the marker's position in the first image and the placement of the image capture device at the first vantage point. Similarly, the second instance of marker information is used to project a second virtual ray based on the marker's position in the second image and the device's placement at the second vantage point. The intersection of these two rays is identified, and the physical marker's position is determined based on this intersection point. This approach improves spatial accuracy by triangulating the marker's location from multiple viewpoints, reducing errors caused by single-view ambiguity. The method is applicable in augmented reality, robotics, and computer vision systems where precise marker localization is required.
11. The method of claim 10 , further comprising constraining the position of the physical marker to lie on an identified reconstructed surface, corresponding to a detected physical surface in the environment.
This invention relates to augmented reality (AR) systems that use physical markers to align virtual content with real-world surfaces. The problem addressed is ensuring accurate placement of virtual objects on detected physical surfaces in an environment, which is challenging due to marker movement, occlusion, or environmental noise. The method involves detecting a physical marker in the environment and determining its position relative to a detected physical surface, such as a wall or table. The marker's position is then constrained to lie on a reconstructed surface, which is a digital representation of the detected physical surface. This ensures that virtual content anchored to the marker remains properly aligned with the real-world surface, even if the marker's position is initially estimated with some error. The reconstructed surface is generated by analyzing sensor data, such as depth or camera images, to model the physical surface's geometry. The marker's constrained position is used to render virtual content in a way that appears correctly positioned on the physical surface in the AR display. This approach improves AR system accuracy by reducing misalignment between virtual and real-world elements, enhancing user experience in applications like gaming, navigation, or industrial training.
12. The method of claim 1 , further comprising repeating the method to identify another position of at least one additional physical marker that is present in the environment.
This invention relates to a method for identifying positions of physical markers in an environment, such as for navigation, mapping, or augmented reality applications. The method involves detecting a physical marker in the environment, determining its position relative to a reference point, and storing this positional data. The process is repeated to identify additional markers, allowing for the creation of a spatial map of the environment. The markers may be visual, such as QR codes or patterns, or non-visual, such as RFID tags or acoustic beacons. The method may use sensors like cameras, scanners, or receivers to detect the markers and compute their positions using techniques like triangulation, image recognition, or signal strength analysis. By iteratively identifying and recording marker positions, the system builds a comprehensive spatial reference framework, enabling precise localization and tracking within the environment. This approach is useful in applications requiring accurate environmental mapping, such as robotics, autonomous navigation, or augmented reality overlays. The method ensures that multiple markers can be detected and mapped, providing redundancy and improving accuracy in dynamic or complex environments.
13. The method of claim 1 , further comprising placing a virtual object in a modified-reality world in relation to the position of the physical marker, and presenting the virtual object on a display device.
This invention relates to augmented reality systems that integrate virtual objects with physical environments using markers. The problem addressed is the accurate placement and display of virtual objects in a modified-reality world, ensuring proper alignment with physical markers. The method involves detecting a physical marker in a real-world environment using a sensor, such as a camera, and determining its position and orientation. A virtual object is then placed in a modified-reality world relative to the detected marker's position. The virtual object is rendered and presented on a display device, such as a head-mounted display or a smartphone screen, in a way that appears anchored to the physical marker. The system may also track the marker's movement and adjust the virtual object's position dynamically to maintain alignment. This ensures that the virtual object remains correctly positioned relative to the physical marker as the user moves or the marker changes orientation. The invention enhances user interaction in augmented reality applications by providing stable and contextually relevant virtual overlays.
14. One or more computing devices comprising: a hardware processor; and a storage resource storing machine-readable instructions which, when executed by the hardware processor, cause the hardware processor to: using at least one image capture device, scan an environment for an initial indication that a real-world marker is present in a target region; prior to identifying the initial indication that the real-world marker is present in the target region, output a search indicator conveying that the one or more computing devices are scanning for the real-world marker; after identifying the initial indication that the real-world marker is present in the target region, successively receive plural instances of image information captured at plural vantage points in the environment by the at least one image capture device; process the plural instances of image information to identify instances of marker information in the respective instances of image information, the instances of marker information depicting the real-world marker that is present in the environment; and determine a position of the real-world marker in the environment relative to the at least one image capture device based at least on the instances of marker information.
This invention relates to augmented reality systems that use real-world markers to determine spatial positioning. The problem addressed is the need for a computing system to efficiently locate and track a physical marker in an environment to enable accurate augmented reality (AR) overlays or other spatial applications. The system includes one or more computing devices with a processor and storage storing instructions for marker detection and tracking. The system uses at least one image capture device, such as a camera, to scan an environment for an initial indication of a real-world marker in a target region. Before detecting the marker, the system outputs a search indicator, such as a visual or auditory cue, to inform users that scanning is in progress. Once the marker is initially detected, the system continuously captures multiple images from different vantage points in the environment. These images are processed to identify instances of the marker, and the system determines the marker's position relative to the image capture device based on the detected marker information. This allows for precise spatial mapping and alignment of virtual content with the physical environment. The system improves user experience by providing feedback during marker search and ensuring accurate positioning for AR applications.
15. The one or more computing devices of claim 14 , wherein the machine-readable instructions, when executed by the hardware processor, cause the hardware processor to: detect the initial indication that the real-world marker is present in the target region by identifying a group of pixels having a particular color associated with the real-world marker.
This invention relates to computer vision systems for detecting real-world markers in a target region using image processing. The problem addressed is accurately identifying markers in real-world environments, which can be challenging due to variations in lighting, perspective, and background clutter. The system uses one or more computing devices with hardware processors to analyze images captured by a camera. The processor executes machine-readable instructions to detect markers by identifying groups of pixels with a specific color associated with the marker. This involves analyzing pixel data to locate regions matching the marker's color signature, which helps distinguish the marker from other objects in the scene. The system may also include additional processing steps, such as filtering or thresholding, to improve detection accuracy. The invention is particularly useful in augmented reality, robotics, and industrial automation, where precise marker detection is essential for tracking objects or guiding actions. The use of color-based detection allows for robust marker identification even in dynamic environments.
16. The one or more computing devices of claim 14 , wherein the machine-readable instructions, when executed by the hardware processor, cause the hardware processor to determine the position of the real-world marker by: virtually projecting a plurality of rays into the environment, each ray being based on at least: a position of an instance of marker information in a corresponding instance of image information and a placement of said at least one image capture device in the environment while at a corresponding vantage point in the environment; identifying intersection information that describes a manner in which the plurality of rays intersect; and determining the position of the real-world marker based at least on the intersection information.
This invention relates to computer vision systems for determining the position of real-world markers in an environment using image capture devices. The problem addressed is accurately locating markers in three-dimensional space based on captured images, which is challenging due to variations in camera placement, perspective, and environmental conditions. The system uses one or more computing devices with hardware processors to execute machine-readable instructions. The instructions cause the processor to determine the marker's position by virtually projecting multiple rays into the environment. Each ray is based on the position of marker information in an image and the placement of the image capture device at a specific vantage point. The system then identifies intersection information describing how these rays intersect in space. The marker's position is calculated using this intersection data, which accounts for the geometric relationships between the rays and the marker's location. This approach improves accuracy by leveraging multiple rays and their intersections, reducing errors from single-point measurements. The method is particularly useful in augmented reality, robotics, and automated navigation systems where precise marker localization is critical. The system dynamically adjusts for camera movement and environmental changes, ensuring reliable positioning under varying conditions.
17. The one or more computing devices of claim 16 , wherein the machine-readable instructions, when executed by the hardware processor, cause the hardware processor to: constrain the position of the real-world marker to lie on an identified reconstructed surface, corresponding to a detected physical surface in the environment.
This invention relates to augmented reality (AR) systems that use real-world markers to anchor virtual content in a physical environment. The problem addressed is ensuring accurate placement of virtual objects by constraining their position relative to detected physical surfaces, improving realism and interaction in AR applications. The system involves one or more computing devices with hardware processors executing machine-readable instructions. These instructions enable the processor to detect physical surfaces in the environment and reconstruct a digital representation of those surfaces. The system then identifies a real-world marker, such as a visual or spatial anchor, and constrains its position to lie on the reconstructed surface. This ensures that virtual content associated with the marker remains aligned with the physical environment, preventing misalignment or drift. The solution improves AR applications by dynamically adjusting the marker's position to match the detected surface geometry, enhancing stability and realism. This is particularly useful in scenarios where surfaces may be uneven or dynamically changing, such as in industrial AR training or interactive gaming environments. The system may also include additional features like surface tracking, marker detection, and virtual content rendering to support the constrained positioning.
18. The one or more computing devices of claim 14 , machine-readable instructions, when executed by the hardware processor, cause the hardware processor to: output the search indicator as text conveying that the target region is being scanned for the initial indication that the real-world marker is present in the target region.
This invention relates to augmented reality (AR) systems that detect real-world markers in a target region of a physical environment. The problem addressed is the lack of clear feedback to users when an AR system is actively scanning for markers, leading to confusion or frustration when the system fails to recognize a marker. The solution involves a computing device with a hardware processor and machine-readable instructions that generate a visual or textual search indicator. This indicator is displayed to the user as text, explicitly stating that the system is scanning the target region for the initial detection of a real-world marker. The system may also include a camera to capture images of the target region and a display to present the AR content. The search indicator provides real-time feedback, improving user experience by setting expectations during marker detection. The invention ensures users understand the system is functioning correctly, even if the marker is not yet found. This approach enhances transparency and reduces user uncertainty in AR applications.
19. A computer-readable storage medium storing computer-readable instructions, the computer-readable instructions, when executed by one or more processor devices, causing the one or more processor devices to perform acts comprising: using at least one image capture device, scanning an environment to identify characteristics that are indicative of the possible presence of a physical marker; outputting an indication that the environment is being scanned for the possible presence of the physical marker; after to successfully detecting the presence of the physical marker in the environment, receiving plural instances of image information captured at plural vantage points in the environment by the at least one image capture device; processing the plural instances of image information to identify plural instances of marker information in the respective instances of image information, the plural instances of marker information identifying the physical marker that is present in the environment; determining a position of the physical marker in the environment relative to the at least one image capture device based at least on the plural instances of marker information; and placing a virtual object in a modified-reality world in relation to the position of the physical marker.
This invention relates to augmented reality systems that use physical markers to anchor virtual objects in a real-world environment. The problem addressed is the need for accurate detection and positioning of physical markers to enable precise placement of virtual objects in augmented reality applications. The system uses one or more image capture devices, such as cameras, to scan an environment for physical markers. During scanning, the system provides feedback indicating that the environment is being analyzed for marker presence. Once a marker is detected, the system captures multiple images of the marker from different vantage points. These images are processed to extract marker information, which identifies the marker's characteristics in each image. The system then determines the marker's position in the environment relative to the image capture device by analyzing the multiple instances of marker information. This positional data is used to place a virtual object in an augmented reality world, ensuring it appears correctly aligned with the physical marker. The system may also adjust the virtual object's position dynamically as the marker's position changes or as the user moves within the environment. This approach enhances the accuracy and stability of augmented reality overlays in real-world settings.
20. The computer-readable storage medium of claim 19 , the acts further comprising: outputting the indication that the environment is being scanned for the possible presence of the physical marker in at least one instance when a target region is being scanned and the target region includes no indication that the physical marker is present in the target region.
This invention relates to systems for detecting physical markers in an environment, particularly in scenarios where a target region is scanned but no marker is found. The technology addresses the challenge of providing clear feedback when a scanning process does not detect a marker, ensuring users or systems are aware of the absence of the marker rather than assuming it was not scanned. The system involves a computer-readable storage medium containing instructions that, when executed, perform acts including scanning an environment for a physical marker and outputting an indication when a target region is scanned but no marker is detected. This ensures transparency in the scanning process, preventing misinterpretation of results. The method may involve analyzing the target region for visual, acoustic, or other sensor data to confirm the absence of the marker. The output indication can be visual, auditory, or a system alert, depending on the application. This approach is useful in applications like augmented reality, robotics, or automated inventory systems where marker detection is critical, and false negatives must be minimized. The invention improves reliability by explicitly signaling when a scan yields no marker, reducing errors in subsequent processes that rely on marker detection.
21. The computer-readable storage medium of claim 20 , wherein the indication comprises a search indicator displayed along a border of the target region while the target region is being scanned.
This invention relates to user interface enhancements for computer systems, specifically improving the visual feedback during interactive selection or scanning of regions within a graphical display. The problem addressed is the lack of clear visual indication when a user is selecting or scanning a target region, which can lead to confusion or errors in the selection process. The solution involves displaying a search indicator along the border of the target region while it is being scanned. This indicator provides real-time feedback to the user, making it easier to track the selection process and ensure accuracy. The search indicator may be a dynamic visual element, such as a moving highlight or border animation, that follows the edges of the target region as the user interacts with it. This visual feedback helps users distinguish between active and inactive regions, reducing misselection and improving overall usability. The invention is particularly useful in applications where precise region selection is critical, such as image editing, document annotation, or data visualization tools. By providing clear, immediate feedback, the system enhances user experience and efficiency in interactive tasks.
Unknown
November 26, 2019
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.