A calibration method for an optical see-through display includes the following. An image sensing device is fixed at a standard position of an eye of a user seeing the optical see-through display, and the image sensing device is configured to photograph a virtual image displayed by the optical see-through display and an image of a real object in an environment. Extrinsic parameters between the image sensing device and a virtual camera are calculated by using extrinsic parameters between the image sensing device and multiple calibration patterns of the real object as well as extrinsic parameters between the virtual camera and the multiple calibration patterns of the real object. A calibration system is also provided.
Legal claims defining the scope of protection, as filed with the USPTO.
2. The calibration method for the optical see-through display as claimed in claim 1, wherein the virtual camera is configured to simulate a virtual image projector of the optical see-through display.
3. The calibration method for the optical see-through display as claimed in claim 1, wherein a method for calculating the projection homography matrix for transforming the image plane of the image sensing device to the image plane of the optical see-through display is a minimum mean-square error (MMSE) method or a random sample consensus (RANSAC) method.
5. The calibration method for the optical see-through display as claimed in claim 4, wherein a method for obtaining the extrinsic parameters between the tracking camera and the pattern of the real object is a pose estimation algorithm.
7. The calibration method for the optical see-through display as claimed in claim 6, wherein a direction of the translation amount is parallel to a direction of a line connecting the two eyes of the user.
8. The calibration method for the optical see-through display as claimed in claim 6, wherein a direction of the translation amount is inclined with respect to a direction of a line connecting the two eyes of the user.
9. The calibration method for the optical see-through display as claimed in claim 1, wherein a method for calculating the extrinsic parameters between the image sensing device and the virtual camera comprises Zhang Zhengyou's camera calibration algorithm.
11. The calibration system as claimed in claim 10, wherein the virtual camera is configured to simulate a virtual image projector of the optical see-through display.
12. The calibration system as claimed in claim 10, wherein a method for calculating the projection homography matrix for transforming the image plane of the image sensing device to the image plane of the optical see-through display is a minimum mean-square error (MMSE) method or a random sample consensus (RANSAC) method.
14. The calibration system as claimed in claim 13, wherein a method for obtaining the extrinsic parameters between the tracking camera and the pattern of the real object is a pose estimation algorithm.
16. The calibration system as claimed in claim 15, wherein a direction of the translation amount is parallel to a direction of a line connecting the two eyes of the user.
17. The calibration system as claimed in claim 15, wherein a direction of the translation amount is inclined with respect to a direction of a line connecting the two eyes of the user.
18. The calibration system as claimed in claim 10, wherein a method for calculating the extrinsic parameters between the image sensing device and the virtual camera comprises Zhang Zhengyou's camera calibration algorithm.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
January 19, 2023
April 16, 2024
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.