Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A head-mounted display device comprising: a visible-light camera configured to collect a visible-light image of a physical space; a surface sensor configured to measure one or more surface parameters of the physical space; a see-through display configured to visually present an augmentation image while light from the physical space passes through the see-through display to a user eye; and an augmented-reality engine configured to: identify a surface of the physical space from the one or more measured surface parameters, determine an angle of the identified surface relative to a perspective of the see-through display; compose a mixed-reality image that includes the augmentation image overlaid on the visible-light image, and visually present, via the see-through display, the mixed-reality image in alignment with the identified surface at a non-parallel angle relative to the identified surface if the angle is less than a threshold angle.
A head-mounted display creates mixed reality by overlaying computer graphics onto the real world. It uses a visible-light camera to capture an image of the physical space. A surface sensor, like a depth camera, measures the shape of surfaces in the space. The system identifies a surface based on the sensor data and calculates the angle of that surface relative to the user's view through the see-through display. An augmented-reality engine then composes a mixed-reality image, combining the real-world image with a computer-generated augmentation. If the surface angle is below a certain threshold, the mixed-reality image is shown aligned to the identified surface, but at a non-parallel angle, improving the viewing experience.
2. The head-mounted display device of claim 1 , further comprising: a gaze sensor configured to measure one or more gaze parameters; and wherein the augmented-reality engine is configured to recognize a gaze vector from the one or more gaze parameters, and wherein the identified surface is a surface nearest the gaze vector.
The head-mounted display from the previous description incorporates eye-tracking. A gaze sensor measures the user's gaze direction. The augmented-reality engine calculates a gaze vector from this data. The system then identifies the surface in the real world that is closest to where the user is looking, using the gaze vector to determine the intended target surface. This allows the mixed-reality content to be accurately placed relative to the user's focus.
3. The head-mounted display device of claim 1 , wherein the surface sensor is a depth camera, and wherein the one or more surface parameters include a relative surface depth measured by the depth camera.
In the head-mounted display described earlier, the surface sensor is specifically a depth camera. The surface parameters it measures are relative surface depths. The depth camera provides depth information about the physical space, which the augmented-reality engine uses to understand the 3D structure of the environment and identify surfaces suitable for overlaying augmented content.
4. The head-mounted display device of claim 1 , wherein the mixed-reality image is aligned at an angle that is parallel with the identified surface.
The head-mounted display, as previously described, aligns the mixed-reality image so that it is precisely parallel to the identified surface in the physical space. Instead of showing the augmentation at a non-parallel angle when the identified surface is less than a threshold, the augmentation is aligned so it is parallel to the identified surface.
5. The head-mounted display device of claim 1 , wherein the mixed-reality image is automatically visually presented via the see-through display responsive to a user request during use of the head-mounted display device.
With the head-mounted display as previously described, a user can request the mixed-reality image to appear at any time. The mixed-reality display will appear when requested by the user.
6. The head-mounted display device of claim 1 , wherein the mixed-reality image is automatically visually presented via the see-through display responsive to the visible-light camera collecting the visible light image.
With the head-mounted display as previously described, the mixed-reality image automatically appears when the visible-light camera captures an image. The augmentation appears automatically.
7. The head-mounted display device of claim 1 , wherein the see-through display is configured to visually present an animation in which the mixed-reality image appears to move away from the user eye into alignment with the identified surface of the physical space.
The head-mounted display, as previously described, shows an animation when presenting the mixed-reality image. The animation makes it appear as if the mixed-reality image is moving away from the user's eye and settling onto the identified surface in the physical space. This animation provides a visual cue to help the user understand the placement of the augmented content.
8. The head-mounted display device of claim 1 , wherein the augmented-reality engine is configured to visually present, via the see-through display, a virtual adjustment control for adjusting a size or position of the mixed-reality image in the physical space.
With the head-mounted display from the first description, the user is provided with virtual controls that appear in the see-through display. The virtual controls can be used to change the size or placement of the mixed-reality image in the physical space.
9. A method for controlling an augmented-reality device, comprising: collecting, with a visible-light camera of the augmented-reality device, a visible-light image of a physical space; measuring, with a surface sensor of the augmented-reality device, one or more surface parameters of the physical space; identifying a surface of the physical space from the one or more measured surface parameters; determining an angle of the identified surface relative to a perspective of a user of the augmented-reality device; and visually presenting, via a display of the augmented-reality device, the visible-light image in alignment with the identified surface at a non-parallel angle relative to the identified surface if the angle is less than a threshold angle from a perspective of a user of the augmented-reality device.
A method for displaying augmented reality on a device involves these steps: First, a visible-light camera captures an image of the physical space. Next, a surface sensor measures parameters of the surfaces in the space. A surface is then identified based on these measurements, and its angle relative to the user's viewpoint is determined. Finally, the captured image is displayed, aligned with the identified surface. If the angle of the surface is below a threshold, the image is aligned at a non-parallel angle to enhance the user's viewing experience.
10. The method of claim 9 , further comprising visually presenting, via the display of the augmented-reality device, one or more virtual objects overlaid on the physical space; composing a mixed-reality image that includes the one or more virtual objects overlaid on the visible-light image of the physical space; and visually presenting, via the display of the augmented-reality device, the mixed-reality image in alignment with the identified surface from the perspective of the user of the augmented-reality device.
The augmented-reality method from the previous description includes displaying virtual objects overlaid on the real world. The method composes a mixed-reality image by combining these virtual objects with the visible-light image of the physical space. This mixed-reality image is then visually presented on the display, aligned with a identified surface, providing an enhanced augmented reality experience to the user.
11. The method of claim 9 , further comprising: measuring, with a gaze sensor of the augmented-reality device, one or more gaze parameters of a user eye; and recognizing a gaze vector of the user eye from the one or more gaze parameters, and wherein the identified surface is a surface nearest the gaze vector.
The augmented-reality method described earlier incorporates eye-tracking. A gaze sensor measures the user's gaze direction. A gaze vector is calculated from this data, representing the user's line of sight. The identified surface is then selected as the one closest to the user's gaze vector, ensuring that augmentations are placed on the surface the user is looking at.
12. The method of claim 9 , wherein the visible-light image is aligned at an angle that is parallel with the identified surface.
The augmented-reality method, as previously described, aligns the visible-light image so that it is precisely parallel to the identified surface in the physical space. Instead of showing the captured image at a non-parallel angle when the identified surface is less than a threshold, the captured image is aligned so it is parallel to the identified surface.
13. The method of claim 9 , wherein the visible-light image is automatically visually presented via the display responsive to the visible-light camera collecting the visible light image.
In the augmented-reality method described earlier, the visible-light image is automatically displayed when the camera captures it. This automatic presentation provides a real-time view of the physical space, which can then be augmented with virtual content.
14. The method of claim 9 , further comprising: visually presenting, via the display of the augmented-reality device, an animation in which the visible-light image appears to move away from a perspective of the user of the augmented-reality device into alignment with the identified surface of the physical space.
The augmented-reality method, as previously described, includes an animation when presenting the visible-light image. The animation makes it appear as if the visible-light image is moving away from the user's viewpoint and settling onto the identified surface in the physical space. This animation provides a visual cue to help the user understand the placement of the augmented content.
15. A method for controlling an augmented-reality device, comprising: measuring, with a surface sensor of the augmented-reality device, one or more surface parameters of a physical space; identifying one or more surfaces of the physical space from the one or more measured surface parameters; visually presenting, via a see-through display of the augmented-reality device, an augmentation image while light from the physical space passes through the see-through display to a user eye; collecting, with a visible-light camera of the augmented-reality device, a visible-light image of the physical space; composing a mixed-reality image that includes the augmentation image overlaid on the visible-light image; measuring, with a gaze sensor of the augmented-reality device, one or more gaze parameters of a user eye; recognizing a gaze vector from the one or more gaze parameters; determining an angle of the identified surface relative to a perspective of the user eye; and automatically visually presenting, via the see-through display of the augmented-reality device, the mixed-reality image in alignment with an identified surface nearest the gaze vector at a non-parallel angle relative to the identified surface if the angle is less than a threshold angle.
An augmented-reality method combines real and virtual elements using a see-through display. A surface sensor measures surface parameters in the physical space and identifies surfaces. An augmentation image is displayed while allowing the user to see through to the real world. Simultaneously, a visible-light camera captures an image of the space, and a mixed-reality image is created by overlaying the augmentation on the captured image. A gaze sensor tracks the user's eye, determining a gaze vector. The system then identifies a surface nearest to the gaze vector and calculates its angle relative to the user's view. The mixed-reality image is automatically presented, aligned with the identified surface. If the surface angle is below a threshold, the mixed-reality image is shown aligned to the surface, but at a non-parallel angle.
16. The method of claim 15 , wherein the mixed-reality image is automatically visually presented via the see-through display responsive to the visible-light camera collecting the visible light image.
In the augmented-reality method from the previous description, the mixed-reality image is automatically displayed as soon as the visible-light camera captures an image. This immediate presentation provides a seamless integration of real and virtual elements in the user's view.
17. The method of claim 15 , further comprising: visually presenting, via the see-through display of the augmented-reality device, an animation in which the mixed-reality image appears to move away from a perspective of the user of the augmented-reality device into alignment with the identified surface of the physical space.
The augmented-reality method, as previously described, displays an animation when presenting the mixed-reality image. The animation makes it appear as if the mixed-reality image is moving away from the user's viewpoint and settling onto the identified surface in the physical space.
Unknown
November 21, 2017
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.