A video communication method includes: acquiring a plurality of 2D images corresponding to a talker using a 3D camera; adjusting a point of convergence of the plurality of 2D images using a feature point of the talker; detecting an object located between the talker and the 3D camera using the acquired plurality of 2D images; scaling an original sense of depth of the detected object to a new sense of depth; and generating a 3D talker image including the object with the new sense of depth and transmitting the 3D talker image to a 3D video communication apparatus of a listener.
Legal claims defining the scope of protection, as filed with the USPTO.
1. A three dimensional (3D) video communication method comprising: acquiring a plurality of two dimensional (2D) images corresponding to a talker, by using a 3D camera; detecting an object located between the talker and the 3D camera using the acquired plurality of 2D images; scaling an original sense of depth of the detected object to a new sense of depth relative to the talker; and generating a 3D talker image including the object with the new sense of depth relative to the talker and transmitting the 3D talker image to a 3D video communication apparatus of a listener.
2. The 3D video communication method of claim 1 , further comprising setting the feature point of the talker, wherein the feature point comprises at least one of eyes, nose, lips, ears, and eyebrows of the talker.
3. The 3D video communication method of claim 1 , further comprising: receiving a 3D listener image from the 3D video communication apparatus of the listener; and displaying the 3D listener image or the 3D talker image on a display unit.
4. The 3D video communication method of claim 1 , wherein the 3D camera comprises at least one of a stereoscopic camera and a depth camera unit.
5. The 3D video communication method of claim 1 , further comprising computing a distance between the 3D camera and the talker, by using disparity or depth information of the plurality of 2D images.
6. The 3D video communication method of claim 1 , further comprising: displaying the 3D talker image on a reference plane of a display unit of the 3D video communication apparatus of the listener; and displaying the object having the new sense of depth on a front side of the reference plane in a positive z axis direction distinguishably from the 3D talker image.
7. The 3D video communication method of claim 1 , further comprising: displaying the object having the new sense of depth on a reference plane of a display unit of the 3D video communication apparatus of the listener; and displaying the 3D talker image on a back side of the reference plane in a negative z axis direction distinguishably from the object with the new sense of depth.
8. The 3D video communication method of claim 1 , wherein the adjusting comprises: shifting a left-side image and a right-side image acquired from one of a stereoscopic camera and a depth camera unit using the feature point, or rotating at least one of a light axis of a left-side camera and a light axis of a right-side camera of the stereoscopic camera.
9. The 3D video communication method of claim 1 , wherein the scaling comprises: enlarging or shifting the object detected in a left-side image and the object detected in a right-side image acquired from one of a stereoscopic camera and a depth camera unit, or adjusting at least one distance among a light axis of a left-side camera and a light axis of a right-side camera of the stereoscopic camera.
10. The 3D video communication method of claim 1 , wherein the scaling comprises enlarging, by adding a predetermined ratio corresponding to a size of the object detected in a left-side image and a size of the object detected in a right-side image acquired by one of a stereoscopic camera and a depth camera unit, or enlarging the detected object of the left-side image and the detected object of the right-side image to a predetermined size.
11. The 3D video communication method of claim 1 , wherein the 3D camera is integrally formed in a 3D video communication apparatus of the talker.
12. The 3D video communication method of claim 1 , further comprising adjusting a point of convergence of the plurality of 2D images using a feature point of the talker.
13. A three dimensional (3D) video communication method comprising: acquiring a plurality of two dimensional (2D) images corresponding to a talker, by using a 3D camera; detecting an object located between the talker and the 3D camera; scaling an original sense of depth of the detected object to a new sense of depth relative to the talker; transmitting a second 3D talker image containing the object with the new sense of depth relative to the talker to a 3D video communication apparatus of a listener; and receiving a 3D listener image from the 3D video communication apparatus of the listener and displaying the first 3D talker image or the 3D listener image containing the object with the original sense of depth on a display unit.
14. The 3D video communication method of claim 13 , further comprising computing a distance between the 3D camera and the talker.
15. The 3D video communication method of claim 13 , further comprising generating a first 3D talker image by adjusting a point of convergence of the plurality of 2D images using a feature point of the talker.
16. A three dimensional (3D) video communication method comprising: acquiring a plurality of two dimensional (2D) images corresponding to a talker, by using a 3D camera; distinguishing between a first region corresponding to the talker and a second region between the talker and the 3D camera; detecting an object located between the talker and the 3D camera in the second region; scaling an original sense of depth of the detected object to a new sense of depth relative to the talker; and generating a 3D talker image including the object with the new sense of depth relative to the talker.
17. The 3D video communication method of claim 16 , wherein the detecting the object between the talker and the 3D camera comprises dividing the detected object into separate layers.
18. The 3D video communication method of claim 16 , further comprising: transmitting the 3D talker image to a 3D video communication apparatus of a listener; receiving a 3D listener image from the 3D video communication apparatus of the listener; and displaying the received 3D listener image or the 3D talker image on a display unit.
19. The 3D video communication method of claim 18 , further comprising: displaying the 3D talker image on a reference plane of the display unit, and displaying the object with the new sense of depth on a front side of the reference plane in a positive z axis direction distinguishably from the 3D talker image, or displaying the object with the new sense of depth on the reference plane of the display unit, and displaying the 3D talker image on a back side of the reference plane in a negative z axis direction distinguishably from the object with the new sense of depth.
20. The 3D video communication method of claim 16 , further comprising computing a distance between the 3D camera and the talker.
21. The 3D video communication method of claim 16 , wherein the 3D camera comprises at least one of a stereoscopic camera and a depth camera unit.
22. The 3D video communication method of claim 16 , further comprising adjusting a point of convergence of the plurality of 2D images using a feature point of the talker.
23. A three dimensional (3D) video communication system comprising a display unit which displays a 3D image, the 3D video communication system comprising: a storage unit; and a control unit which controls the 3D camera and the storage unit, wherein the control unit, detects an object located between the talker and the 3D camera, scales an original sense of depth of the detected object to a new sense of depth relative to the talker, and generates a 3D talker image including the object with the new sense of depth relative to the talker from the plurality of 2D images.
24. The 3D video communication system of claim 23 , further comprising: a transmitting/receiving unit which transmits the 3D talker image to a 3D video communication apparatus of a listener during video communication with the listener, and receives a 3D listener image from the 3D video communication apparatus of the listener, wherein the display unit displays the 3D talker image or the received 3D listener image.
25. The 3D video communication system of claim 23 , wherein the display unit displays a user interface (UI) screen to set a feature point of the talker and the feature point is inputted using the UI screen.
26. The 3D video communication system of claim 23 , wherein the control unit computes a distance between the 3D camera and the talker using the plurality of 2D images and detects the object using the computed distance.
27. The 3D video communication system of claim 23 , wherein the control unit adjusts a point of convergence of a plurality of two dimensional (2D) images using a feature point of a talker.
28. A three dimensional (3D) video communication system comprising a display unit which displays a 3D image, the 3D video communication system comprising: a 3D camera which acquires a plurality of two dimensional (2D) images corresponding to a talker; a storage unit; and a control unit which controls the 3D camera and the storage unit, wherein the control unit distinguishes between a first region corresponding to the talker and a second region between the talker and the 3D camera, detects the object in the second region, scales an original sense of depth of the detected object to a new sense of depth relative to the talker, and generates a 3D talker image including the object with the new sense of depth relative to the talker from the plurality of 2D images.
29. The 3D video communication system of claim 28 , further comprising: a transmitting/receiving unit which transmits the 3D talker image to a 3D video communication apparatus of a listener during video communication with the listener, and receives a 3D listener image from the 3D video communication apparatus of the listener, wherein the display unit displays the 3D talker image or the 3D listener image.
30. The 3D video communication system of claim 28 , wherein the control unit computes a distance between the 3D camera and the talker using the plurality of 2D images and detects the object using the computed distance.
31. The 3D video communication system of claim 28 , wherein the control unit adjusts a point of convergence of the plurality of 2D images using the feature point of the talker.
32. A three dimensional (3D) video communication system comprising a display unit which displays a 3D image, the 3D video communication system comprising: a transmitting/receiving unit which receives a 3D talker image including a first object with an adjusted sense of depth; a storage unit which stores the 3D talker image including the first object with the adjusted sense of depth; a control unit which controls the transmitting/receiving unit and the storage unit, and a 3D camera which acquires a plurality of two dimensional (2D) images corresponding to a listener; wherein the control unit: controls generating an output image by using the 3D talker image including the first object with the stored adjusted sense of depth relative to the talker, and controls displaying the generated output image on the display unit; adjusts a point of convergence of the plurality of 2D images using a feature point of the listener, detects a second object located between the listener and the 3D camera using the acquired plurality of 2D images, scales an original sense of depth of the detected second object into a new sense of depth relative to the listener, generates a 3D listener image including the second object with the new sense of depth relative to the listener from a plurality of 2D images, and transmits the generated 3D listener image to a 3D video communication of a talker using the transmitting/receiving unit.
33. The 3D video communication system of claim 32 , wherein: the 3D talker image is displayed on a reference plane of the display unit of a 3D video communication apparatus of the listener and the first object with the adjusted sense of depth is displayed on a front side of the reference plane in a positive z axis direction distinguishably from the 3D talker image, or the first object with the adjusted sense of depth is displayed on the reference plane of the display unit, and the 3D talker image is displayed on a back side of the reference plane in a negative z axis direction distinguishably from the first object with the adjusted sense of depth.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
November 7, 2011
February 23, 2016
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.