Legal claims defining the scope of protection, as filed with the USPTO.
1. A computing device comprising: a logic subsystem; and a data-holding subsystem comprising instructions stored thereon that are executable by the logic subsystem to receive viewer location data and viewer orientation data from a location and orientation sensing system comprising one or more motion sensors located on a head-mounted display system in a presentation space and one or more image sensors in the presentation space that are not located on the head-mounted display system; from the viewer location data and the viewer orientation data, locate a viewer in the presentation space, determine a direction in which the viewer is facing in the presentation space, and determine an orientation of the head-mounted display system in the presentation space; determine a presentation image to send to the head-mounted display system by determining a portion of, and an orientation of, a volumetric image mapped to a portion of the presentation space that is within the viewer's field of view based upon the viewer location data and the viewer orientation data, the presentation image corresponding to a first perspective of an object in the volumetric image; send the presentation image to the head-mounted display system; detect a change in the viewer location data and the viewer orientation data; and determine a different presentation image to send to the head-mounted display system based on the change detected in the viewer location data and the viewer orientation data, the different presentation image corresponding to a second, different perspective of the object in the volumetric image.
2. The computing device of claim 1 , wherein the instructions are further executable to receive eyeball tracking data from an eyeball tracking image sensor on the head-mounted display system and to further determine the presentation image based upon the eyeball tracking data.
3. The computing device of claim 1 , wherein the instructions are further configured to receive an input of the volumetric image and to map the volumetric image to the presentation space.
4. The computing device of claim 1 , wherein the volumetric image comprises video image data of a scene captured from a plurality of angles.
5. The computing device of claim 1 , wherein the instructions are further executable to detect roll, pitch, and yaw of the head-mounted display system from the viewer orientation data.
6. The computing device of claim 1 , wherein the instructions are further executable to: detect a user input requesting a user interface; determine a user interface image to send to the head-mounted display system for display, the user interface image comprising a user interface element; send the user interface image to the head-mounted display; detect a user gesture interacting with the user interface image; and in response, send a modified user interface image that illustrates an effect of the user gesture on the user interface image.
7. The computing device of claim 6 , wherein the user interface element comprises a pushable and/or pullable element.
8. The computing device of claim 1 , wherein the instructions are executable to detect a plurality of viewers in the presentation space, and to determine different images to send to each of the plurality of viewers based upon a location of each viewer in the presentation space.
9. The computing device of claim 1 , wherein the instructions are further executable to receive an audio input, to detect a voice command in the audio input, and to perform a function in response to the audio input.
10. A system for presenting volumetric video image content in a presentation space, the system comprising: a plurality of image capture devices configured to capture images of the presentation space; a head-mounted display system comprising one or more motion sensors configured to detect tilt along a plurality of axes; and a computing device comprising a logic subsystem and a data-holding subsystem comprising instructions stored thereon that are executable by the logic subsystem to receive an input of volumetric video image data, map the volumetric video image data to the presentation space to produce a mapping of the volumetric video image data to the presentation space by associating pixels of the volumetric video image data with locations in the presentation space; receive viewer tracking image data from the plurality of image capture devices; receive motion data from the one or more motion sensors on the head-mounted display system; from the viewer tracking image data and the motion data, locate a viewer in the presentation space and determine a direction in which the viewer is facing in the presentation space; from the motion data, determine an orientation of the head-mounted display system in the presentation space; determine a presentation image to send to the head-mounted display system by determining a portion of, and an orientation of, the volumetric video image data mapped to a portion of the presentation space that is within the viewer's field of view based upon the viewer tracking image data and the motion data, the presentation image corresponding to a first perspective of an object in the volumetric video image data; send the presentation image to the head-mounted display system; detect a change in the viewer tracking image data and the motion data; and determine a different presentation image to send to the head-mounted display system based on the change detected in the viewer tracking image data and the motion data, the different presentation image corresponding to a second, different perspective of the object in the volumetric video image data.
11. The system of claim 10 , wherein the head-mounted display system comprises an eyeball tracking sensor, and wherein the computing device is configured to receive eyeball tracking data from the head-mounted display system and to further determine the presentation image based upon the eyeball tracking data.
12. The system of claim 10 , wherein the head-mounted display system comprises an outward facing head-mounted image sensor, and wherein the computing device is configured to receive image data from the outward facing head-mounted image sensor and to detect a user gesture based upon the image data from the outward facing head-mounted image sensor.
13. The system of claim 10 , wherein the head-mounted display system comprises a microphone, and wherein the computing device is configured to receive audio data from the microphone and detect a voice command in the audio data.
14. The system of claim 10 , wherein the instructions are further executable to: detect a user input requesting a user interface; determine a user interface image to send to the head-mounted display system for display, the user interface image comprising a user interface element; send the user interface image to the head-mounted display system; detect a user gesture interacting with the user interface image; and in response, send a modified user interface image that illustrates an effect of the user gesture on the user interface image.
15. A method of presenting volumetric video image data, the method comprising: receiving the volumetric video image data; mapping the volumetric video image data to a presentation space by associating pixels of the volumetric video image data with locations in the presentation space; receiving viewer tracking image data from a plurality of image capture devices; receiving motion data from one or more motion sensors on a head-mounted display system; locating a viewer in the presentation space via the viewer tracking image data and the motion data, and determining a direction in which the user is facing in the presentation space; from the motion data, determining an orientation of the head-mounted display system in the presentation space; receiving eyeball tracking data from an image sensor on the head-mounted display system; from the eyeball tracking data, determining a direction in which the viewer's vision is directed; determining a presentation image to send to the head-mounted display system by determining a portion of, and an orientation of, a volumetric image mapped to the presentation space that is within the viewer's field of view based upon the viewer tracking image data, the motion data, and the eyeball tracking data, the presentation image corresponding to a first perspective of an object in the volumetric video image data; sending the presentation image to the head-mounted display system; detecting a change in the viewer tracking image data, the motion data, and the eyeball tracking data; determining a different presentation image to send to the head-mounted display system based on the change in the viewer tracking image data, the motion data, and the eyeball tracking data, the different presentation image corresponding to a second, different perspective of the object in the volumetric video image data.
16. The method of claim 15 , further comprising detecting a request to display a user interface, and in response, sending a user interface image to the head-mounted display system.
17. The method of claim 16 , further comprising detecting a user gesture interacting with the user interface image, and in response, sending a modified user interface image that illustrates an effect of the user gesture on the user interface image.
18. The method of claim 16 , wherein the request to display the user interface comprises a gesture detected via the image sensor located on the head-mounted display system.
19. The method of claim 15 , further comprising receiving an audio input, detecting a voice command in the audio input, and performing a function in response to the audio input.
20. The method of claim 15 , further comprising locating a plurality of viewers in the presentation space, determining images to send to each of the plurality of viewers based upon a location of each viewer in the presentation space, and sending to each viewer a corresponding image for display.
Unknown
February 24, 2015
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.