Legal claims defining the scope of protection, as filed with the USPTO.
1. A method of recognizing and tracking a spatial point, comprising: a point light source, formed by a movable active point light source, which is a scattered visible light or non-visible light emitted from a point light source, or formed by a movable passive point light source which is a pointed reflecting object for reflecting the light of other light sources; and a spatial point recognition device, for receiving the scattered light emitted by the point light source, and calculating and outputting a convergent point coordinates signal (X V , Y V , Z V ) of the spatial point recognition device, and an object point coordinates signal (X P , Y P , Z P ) of the point light source, and the spatial point recognition device being capable of moving the convergent point, such that the coordinates of the convergent point are superimposed with the coordinates of the object point, so as to achieve the purpose of tracking the point light source automatically, at the same the spatial point recognition device also receives the coordinates signal (X V New , Y V New , Z V New ) of a new convergent point provided by other external devices to reset the position of the convergent point, so as to achieve the purpose of resetting the convergent point of the spatial point recognition device.
2. The method of recognizing and tracking a spatial point as recited in claim 1 , wherein the spatial point recognition device, comprising: a parallax imaging device, for outputting a set of convergent point parameter signals and a pair of left and right 2D image signals with a parallax signal after the light emitted by the point light source is received, as well as receiving a set of new convergent point parameter signals for changing the position of the convergent point of the parallax imaging device; and a spatial point computing device, for calculating and outputting the convergent point coordinates signal (X V , Y V , Z V ) of the parallax imaging device and the object point coordinates signal (X P , Y P , Z P ) of the point light source after the set of convergent point parameter signals and the pair of left and right 2D image signals with a parallax signal are received, as well as calculating and outputting a set of new convergent point parameter signals according to the object point coordinates signal (X P , Y P , Z P ) of the point light source, so as to superimpose the coordinates of the convergent point with the coordinates of the object point to achieve the purpose of tracking the point light source, and also receiving an new convergent point coordinates signal (X V New , Y V New , Z V New ) Provided by other external device such that calculating and compulsorily outputting a set of new convergent point parameter signals according to the inputted new convergent point coordinates signal (X V New , Y V New , Z V New ) to reset the position of the convergent point, so as to achieve the purpose of resetting the new convergent point.
3. The method of recognizing and tracking a spatial point as recited in claim 2 , wherein the parallax imaging device, comprising: a left camera, installed at a convergent point positioning mechanical device, for outputting a left 2D image signals with a parallax signal, after a scattered light emitted by the point light source is received; a right camera, installed at the convergent point positioning mechanical device, for outputting a right 2D image signals with a parallax signal, after a scattered light emitted by the point light source is received; a left 2D image memory and output device, for storing and outputting a left 2D image signals with a parallax signal after the left 2D image signals are read; a right 2D image memory and output device, for storing and outputting a right 2D image signals with a parallax signal after the right 2D image signals are read; a convergent point positioning mechanical device, formed by a plurality of rotating and displacing mechanical structures, actuators, and positioning sensors, for fixing, retaining, rotating and displacing the left and right cameras, such that a convergent point driving and controlling signal is received for driving and controlling all actuators to change and reset the direction of the visual axis of the left and right cameras, so as to achieve the purpose of changing and resetting the position of the convergent point of the parallax imaging device, and the data of all positioning sensors are outputted to provide the direction and position of the visual axis of the left and right cameras; a convergent point reading device, for reading the data of all positioning sensors on the convergent point positioning mechanical device and the focal length of the cameras, and outputting a set of convergent point parameter signals; and a convergent point setting device, for receiving a set of new convergent point parameter signals and outputting a convergent point driving and controlling signal which is converted from the set of new convergent point parameter signals, so as to achieve the purpose of driving all actuators on the convergent point positioning mechanical device.
4. The method of recognizing and tracking a spatial point as recited in claim 3 , wherein the left camera, comprising: an optical filter, for filtering a light source with a wavelength other than the wavelength of the point light source; an automatic fine-tuning 2D aperture, being a crevice in the shape of a circular hole, whose diameter can be fine-tuned automatically; an automatic focusing 2D lens module, being a lens module with horizontal and vertical direction 2D focusing abilities for automatically focusing and outputting the focal length; and a 2D image sensor, formed by a general CCD or CMOS, for outputting a left 2D image signal with a parallax signal.
5. The method of recognizing and tracking a spatial point as recited in claim 3 , wherein the right camera, comprising: an optical filter, for filtering a light source with a wavelength other than the wavelength of the point light source; an automatic fine-tuning 2D aperture, being a crevice in the shape of a circular hole, whose diameter can be fine-tuned automatically; an automatic focusing 2D lens module, being a lens module with horizontal and vertical direction 2D focusing abilities for automatically focusing and outputting the focal length; and a 2D image sensor, formed by a general CCD or CMOS, for outputting a right 2D image signal with a parallax signal.
6. The method of recognizing and tracking a spatial point as recited in claim 2 , wherein the spatial point computing device, comprising: an electronic interface, formed by plurality of general electronic components including digital I/O ports, ADCs and DACs to serve as an interface of connecting the parallax imaging device, for reading the set of convergent point parameter signals, and left and right 2D image signals with a parallax signal; as well as outputting a set of new convergent point parameter signals; an electronic interface, being a standard transmission interface formed by a general cable or wireless RS232, USB, network, to serve as an interface of connecting another external device, for reading a new convergent point coordinates signal (X V New , Y V New , Z V New ), as well as outputting an object point coordinates signal (X P , Y P , Z P ) of the point light source and a convergent point coordinates signal (X V , Y V , Z V ) of the parallax imaging device; and a computing procedure device, being a general microcomputer formed by a microprocessor, a DSP, and a memory device, a computing logic procedure installed in the memory device is used for calculating and outputting a convergent point coordinates signal (X V , Y V , Z V ) of the parallax imaging device and an object point coordinates signal (X P , Y P , Z P ) of the point light source according to the inputted set of convergent point parameter signals and the parallax signals which are obtained from the inputted pair of left and right 2D image signals with a parallax signal, and calculating and outputting a set of new convergent point parameter signals according to the object point coordinates signal (X P , Y P , Z P ) to superimpose the coordinates of the convergent point of the parallax imaging device with the coordinates of the object point of the point light source, so as to achieve the purpose of tracking the object point of the point light source, and the computing logic procedure also calculating and compulsorily outputting a set of new convergent point parameter signals according to the inputted new convergent point coordinates signal (X V New , Y V New , Z V New ) to reset the position of the convergent point, so as to achieve the purpose of resetting the new convergent point.
7. The method of recognizing and tracking a spatial point as recited in claim 2 , wherein the set of convergent point parameter signals are (θ L , θ R , φ L , φ R , Ω, Φ, S, f), and the parallax signals are (x L , y L , x R , y R ), and the set of new convergent point parameter signals are (θ L New , θ R New , φ L New , φ R New , Ω New , Φ New , S New ).
8. The method of recognizing and tracking a spatial point as recited in claim 3 , wherein a parallax signal included in the left 2D image signal is (x L , y L ), and a parallax signal included in the right 2D image signal is (x R , y R ).
9. The method of recognizing and tracking a spatial point as recited in claim 8 , further comprising a relation y L =y R =y i , existed between the parallax signals (x L , y L ) and (x R , y R ).
10. The method of recognizing and tracking a spatial point as recited in claim 7 , wherein the set of convergent point parameter signals (θ L , θ R , φ L , φ R Ω, Φ, S, f) has a relation of φ L , φ R =φ, and the set of new convergent point parameter signals (θ L New , θ R New , φ L New , φ R New , Ω New , Φ New , S New ) has a relation of φ L New =φ R New =φ New .
11. The method of recognizing and tracking a spatial point as recited in claim 6 , wherein the computing logic procedure of the computing procedure device processes the 2D image signals to find the brightest point on the 2D left and right images, and obtains coordinates of parallax signal (x L , y L ) and coordinates of parallax signal (x R , y R ) corresponding to the point light source.
12. The method of recognizing and tracking a spatial point as recited in claim 6 , wherein the computing logic procedure of the computing procedure device bases on the vector of the left convergent point and the unit vector of the left visual axis, and the vector of the right convergent point and the unit vector of the right visual axis having a geometric relation of being parallel with each other, and the vector of the left convergent point and the vector of the right convergent point having a geometric relation of being intersected with each other at the convergent point to compute a convergent point coordinates signal (X V , Y V , Z V ) according to the following equations: X V = R L 23 R L 13 R L 23 R L 13 - R R 23 R R 13 X L 0 ″ - R R 23 R R 13 R L 23 R L 13 - R R 23 R R 13 X R 0 ″ + Y R 0 ″ - Y L 0 ″ R L 23 R L 13 - R R 23 R R 13 Y V = R L 33 R L 23 R L 33 R L 23 - R R 33 R R 23 Y L 0 ″ - R R 33 R R 23 R L 33 R L 23 - R R 33 R R 23 Y R 0 ″ + Z R 0 ″ - Z L 0 ″ R L 33 R L 23 - R R 33 R R 23 Z V = R L 13 R L 33 R L 13 R L 33 - R R 13 R R 33 Z L 0 ″ - R R 13 R R 33 R L 13 R L 33 - R R 13 R R 33 Z R 0 ″ + X R 0 ″ - X L 0 ″ R L 13 R L 33 - R R 13 R R 33 .
13. The method of recognizing and tracking a spatial point as recited in claim 6 , wherein the computing logic procedure of the computing procedure device bases on the principle of geometric optical imaging which refers to the vector of the left point image and the vector of the left object point, and the vector of the right point image and the vector of the right object point having a geometric relation of being parallel with each other, and the vector of the left object point and the vector of the right object point having geometric relation of being intersected with each other at the object point to calculate an object point coordinates signal (X P , Y P , Z P ) according to the following equations: X P = - R L 21 x L - R L 22 y i + fR L 23 - R L 11 x L - R L 12 y i + fR L 13 ( fR L 13 + X L 0 ″ ) - R L 21 x L - R L 22 y i + fR L 23 - R L 11 x L - R L 12 y i + fR L 13 - - R R 21 x R - R R 22 y i + fR R 23 - R R 11 x R - R R 12 y i + fR R 13 - - R R 21 x R - R R 22 y i + fR R 23 - R R 11 x R - R R 12 y i + fR R 13 ( fR R 13 + X R 0 ″ ) - R L 21 x L - R L 22 y i + fR L 23 - R L 11 x L - R L 12 y i + fR L 13 - - R R 21 x R - R R 22 y i + fR R 23 - R R 11 x R - R R 12 y i + fR R 13 + fR R 23 + Y R 0 ″ - ( fR L 23 + Y L 0 ″ ) - R L 21 - R L 22 y i + fR L 23 - R L 11 x L - R L 12 y i + fR L 13 - - R R 21 x R - R R 22 y i + fR R 23 - R R 11 x R - R R 12 y i + fR R 13 Y P = - R L 31 x L - R L 32 y i + fR L 33 - R L 21 x L - R L 22 y i + fR L 23 ( fR L 23 + Y L 0 ″ ) - R L 31 x L - R L 32 y i + fR L 33 - R L 21 x L - R L 22 y i + fR L 23 - - R R 31 x R - R R 32 y i + fR R 33 - R R 21 x R - R R 22 y i + fR R 23 - - R R 31 x R - R R 32 y i + fR R 33 - R R 21 x R - R R22 y i + fR R 23 ( fR R 23 + Y R 0 ″ ) - R L 31 x L - R L 32 y i + fR L 33 - R L 21 x L - R L 22 y i + fR L 23 - - R R 31 x R - R R 32 y i + fR R 33 - R R 21 x R - R R 22 y i + fR R 23 + ( fR R 33 + Z R 0 ″ ) - ( fR L 33 + Z L 0 ″ ) - R L 31 x L - R L 32 y i + fR L 33 - R L 21 x L - R L 22 y i + fR L 23 - - R R 31 x R - R R 32 y i + fR R 33 - R R 21 x R - R R 22 y i + fR R 23 Z P = - R L 11 x L - R L 12 y i + fR L 13 - R L 31 x L - R L 32 y i + fR L 33 ( fR L 33 + Z L 0 ″ ) - R L 11 x L - R L 12 y i + fR L 13 - R L 31 x L - R L 32 y i + fR L 33 - - R R 11 x R - R R 12 y i + fR R 13 - R R 31 x R - R R 32 y i + fR R 33 - - R R 11 x R - R R 12 y i + fR R 13 - R R 31 x R - R R 32 y i + fR R 33 ( fR R 33 + Z R 0 ″ ) - R L 11 x L - R L 12 y i + fR L 13 - R L 31 x L - R L 32 y i + fR L 33 - - R R 11 x R - R R 12 y i + fR R 13 - R R 31 x R - R R 32 y i + fR R 33 + fR R 13 + X R 0 ″ - ( fR L 13 + X L 0 ″ ) - R L 11 x L - R L 12 y i + fR L 13 - R L 31 x L - R L 32 y i + fR L 33 - - R R 11 x R - R R 12 y i + fR R 13 - R R 31 x R - R R 32 y i + fR R 33
14. The method of recognizing and tracking a spatial point as recited in claim 10 , wherein the positive and negative values of each angle with respect to the set of convergent point parameter signals (θ L , θ R , φ L , φ R , Ω, Φ, S, f), and the set of new convergent point parameter signals (θ L New , θ R New , φ L New , φ R New , Ω New , Φ New , S New ) are defined according to the right-hand rule or the left-hand rule.
15. The method of recognizing and tracking a spatial point as recited in claim 12 , wherein the values of R 11 ˜R 33 and X″ L0 Y″ L0 Z″ L0 X″ R0 Y″ R0 Z″ R0 vary with the order of rotating the coordinates, and the values of R 11 ˜R 33 and X″ L0 Y″ L0 Z″ L0 X″ R0 Y″ R0 Z″ R0 in a result of one of the orders of rotating the coordinates are: R L 11 = cos Θ cos θ L - sin Θ cos Φ sin θ L ; R L 12 = cos Θ sin θ L sin φ + sin Θ sin Φ cos φ + sin Θ cos Φ cos θ L sin φ ; R L 13 = cos Θ sin θ L cos φ - sin Θ sin Φ sin φ + sin Θ cos Φ cos θ L cos φ ; R L 21 = sin Φ sin θ L ; R L 22 = cos Φ cos φ - sin Φ cos θ L sin φ ; R L 23 = - cos Φ sin φ - sin Φ cos θ L cos φ ; R L 31 = - sin Θ cos θ L - cos Θ cos Φ sin θ L ; R L 32 = - sin Θ sin θ L sin φ + cos Θ sin Φ cos φ + cos Θ cos Φ cos θ L sin φ ; R L 33 = - sin Θ sin θ L cos φ - cos Θ sin Φ sin φ + cos Θ cos Φ cos θ L cos φ ; R R 11 = cos Θ cos θ R - sin Θ cos Φ sin θ R ; R R 12 = cos Θ sin θ R sin φ + sin Θ sin Φ cos φ + sin Θ cos Φ θ R sin φ ; R R 13 = cos Θ sin θ R cos φ - sin Θ sin Φ sin φ + sin Θ cos Φ cos θ R cos φ ; R R 21 = sin Φ sin θ R ; R R 22 = cos Φ cos φ - sin Φ cos θ R sin φ ; R R 23 = - cos Φ sin φ - sin Φ cos θ R cos φ ; R R 31 = - sin Θ cos θ R - cos Θ cos Φ sin θ R ; R R 32 = - sin Θ sin θ R sin φ + cos Θ sin Φ cos φ + cos Θ cos Φ cos θ R sin φ ; R R 33 = - sin Θ sin θ R cos φ - cos Θ sin Φ sin φ + cos Θ cos Φ cos θ R cos φ ; X L 0 ″ = H sin Φ sin Θ + S 2 cos Θ ; Y L 0 ″ = H cos Θ ; Z L 0 ″ = H sin Φ cos Θ - S 2 sin Θ ; X R 0 ″ = H sin Θ sin Φ - S 2 cos Θ ; Y R 0 ″ = H cos Θ ; and Z R 0 ″ = H cos Θ sin Φ + S 2 sin Θ
16. The method of recognizing and tracking a spatial point as recited in claim 6 , wherein the object point tracking made by the computing logic procedure of the computing procedure device is divided into a small-angle object point tracking and a large-angle object point tracking according to the size of the object point tracking range.
17. The method of recognizing and tracking a spatial point as recited in claim 16 , wherein the small-angle object point tracking controls the convergent point positioning mechanical device to change the value of (θ L , θ R , φ L , φ R ) in order to change the convergent point and moves the convergent point to the position of the object point when the point light source (which is the object point) is closer to the convergent point, and the large-angle object point tracking controls the convergent point positioning mechanical device to change the value of (θ L , θ R , φ L , φ R , Θ, Φ, S) in order to change the convergent point and moves the convergent point to the position of the object point when the point light source (which is the object point) is farther away from the convergent point, so as to achieve the purpose of tracking the object point.
19. The method of recognizing and tracking a spatial point as recited in claim 17 , wherein the large-angle object point tracking calculates and outputs a set of new convergent point parameter signal (θ L New , θ R New , φ L New , φ R New , Ω New , Φ New , S New ) according to the position of the object point P(X P , Y P , Z P ) by a method of aligning the direction of the new central visual axis O″ H P with the object point under a condition of O″ H P ⊥ĵ″ N , in other words, after the neck parameter (Θ New , Φ New ) being determined properly, and then using the relations of θ L New =−θ New , θ R New =θ New , φ L New =φ R =0 to rotate and set the angle of the visual axis of the left and right cameras, so as to achieve the purpose of tracking the object point, and each related angle is calculated by: Θ New = tan - 1 ( X P Z P ) X P sin Θ New sin Φ New + Y P cos Φ New + Z P cos Θ New sin Φ New = H ; and θ New = 1 2 sin 1 ( × ) .
20. The method of recognizing and tracking a spatial point as recited in claim 6 , wherein the new convergent point is reset according to the inputted new convergent point coordinates signal (X V New , Y V New , Z V New ) to calculate and output a set of new convergent point parameter signals (θ L New , θ R New , φ L New , φ R New , Ω New , Φ New , S New ), and its calculation method is the same as the calculation method as recited in claim 19 , but the value (X V New , Y V New , Z V New ) is substituted into (X P , Y P , Z P ) in the equations.
Unknown
June 15, 2010
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.