In one implementation, a method includes: determining an interpupillary distance (IPD) measurement for a user based on a function of depth data obtained by the depth sensor and image data obtained by the image sensor; and calibrating a head-mounted device (HMD) provided to deliver augmented reality/virtual reality (AR/VR) content by setting one or more presentation parameters of the HMD based on the IPD measurement in order to tailor one or more AR/VR displays of the HMD to a field-of-view of the user.
Legal claims defining the scope of protection, as filed with the USPTO.
1. A method comprising: at a device with one or more processors, non-transitory memory, an image sensor, and a depth sensor: determining an interpupillary distance (IPD) measurement for a user based on a function of depth data obtained by the depth sensor and image data obtained by the image sensor; detecting a trigger to adjust an assembled head-mounted device (HMD) that has been built to fit users with different physiological measurements; and adjusting a combination of a focus point, a presentation point and a warping parameter associated with the assembled HMD based on the IPD measurement in order to tailor one or more AR/VR displays of the HMD to a field-of-view of the user.
2. The method of claim 1 further comprising: determining a position of each eye of the user within the image data obtained by the image sensor; and determining a depth measurement associated with the depth data obtained by the depth sensor, the depth measurement characterizing a distance from the device to a portion of the face of the user, wherein the IPD measurement is determined based on a function of the positions of the eyes and the depth measurement.
3. The method of claim 2 further comprising, obtaining depth data by the depth sensor, and synthesizing a mesh map of at least a portion of the face of the user based on the depth data, wherein the mesh map provides a characterization of facial topography of the user; and wherein the depth measurement is determined based on the mesh map.
4. The method of claim 2 , wherein the portion of the face of the user associated with the depth measurement corresponds to at least one eye of the user.
5. The method of claim 1 , wherein the IPD measurement includes at least one of the distance from the device to a portion of the face of the user, a tilt angle relative to one or more reference points, and a pitch angle relative to the one or more reference points.
6. The method of claim 1 , wherein adjusting the focus point comprises adjusting a focus point of AR/VR content rendered by the one or more AR/VR displays based on the IPD measurement.
7. The method of claim 1 , wherein includes adjusting the presentation position comprises adjusting a presentation position of AR/VR content rendered by the one or more AR/VR displays based on the IPD measurement.
8. The method of claim 1 , wherein adjusting the warping parameter comprises adjusting a warping parameter of AR/VR content rendered by the one or more AR/VR displays based on the IPD measurement.
9. The method of claim 1 , further comprising adjusting a position of at least one of the one or more AR/VR displays based on the IPD measurement.
10. The method of claim 1 , further comprising adjusting at least one lens parameter associated with the one or more AR/VR displays based on the IPD measurement.
11. The method of claim 10 , wherein the at least one lens parameter corresponds to one of a lens warping parameter, a focal length parameter, and an aperture parameter.
12. The method of claim 1 further comprising, storing the IPD measurement in a user profile associated with the user, wherein the user profile at least includes biometric information associated with the user.
13. The method of claim 1 further comprising, obtaining an adjustment input from the user, and updating the IPD measurement based on the adjustment input.
14. The method of claim 1 , wherein at least one of the focus point, the presentation position and the warping parameter is a software parameter.
15. The method of claim 14 , wherein adjusting the software parameter changes how the one or more AR/VR displays render AR/VR content without triggering a physical change in the HMD.
16. A device comprising: one or more processors; a non-transitory memory; an image sensor; a depth sensor; and one or more programs stored in the non-transitory memory, which, when executed by the one or more processors, cause the device to: determine an interpupillary distance (IPD) measurement for a user based on a function of depth data obtained by the depth sensor and image data obtained by the image sensor; detect a trigger to adjust an assembled head-mounted device (HMD) that has been built to fit users with different physiological measurements; and adjust a combination of a focus point, a presentation position and a lens warping parameter associated with the assembled HMD based on the IPD measurement in order to tailor one or more AR/VR displays of the HMD to a field-of-view of the user.
17. The device of claim 16 , wherein the programs further cause the device to: determine a position of each eye of the user within the image data obtained by the image sensor; and determine a depth measurement associated with the depth data obtained by the depth sensor, the depth measurement characterizing a distance from the device to a portion of the face of the user, wherein the IPD measurement is determined based on a function of the positions of the eyes and the depth measurement.
18. The device of claim 16 , wherein the IPD measurement includes at least one of the distance from the device to a portion of the face of the user, a tilt angle relative to one or more reference points, and a pitch angle relative to the one or more reference points.
19. The device of claim 16 , wherein adjusting the focus point includes adjusting a focus point of the AR/VR content rendered by the one or more AR/VR displays based on the IPD measurement.
20. The device of claim 16 , wherein adjusting the presentation position includes adjusting a presentation position of the AR/VR content rendered by the one or more AR/VR displays based on the IPD measurement.
21. The device of claim 16 , wherein the programs further cause the device to adjust at least one lens parameter associated with the one or more AR/VR displays based on the IPD measurement.
22. The device of claim 16 , wherein at least one of the focus point, the presentation position and the warping parameter is a software parameter.
23. The device of claim 22 , wherein adjusting the software parameter changes how the one or more AR/VR displays render AR/VR content without triggering a physical change in the HMD.
24. A non-transitory memory storing one or more programs, which, when executed by one or more processors of a device with an image sensor and a depth sensor, cause the device to: determine an interpupillary distance (IPD) measurement for a user based on a function of depth data obtained by the depth sensor and image data obtained by the image sensor; detect a trigger to adjust an assembled head-mounted device (HMD) that has been built to fit users with different physiological measurements; and adjust a combination of a focus point, a presentation position and a warping parameter associated with the assembled HMD based on the IPD measurement in order to tailor one or more AR/VR displays of the HMD to a field-of-view of the user.
25. The non-transitory memory of claim 24 , wherein at least one of the focus point, the presentation position and the warping parameter is a software parameter.
26. The non-transitory memory of claim 25 , wherein adjusting the software parameter changes how the one or more AR/VR displays render AR/VR content without triggering a physical change in the HMD.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
June 22, 2018
November 3, 2020
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.