Method and Apparatus for Controlling Virtual Monitor

1. An apparatus for controlling a virtual monitor in an augmented reality display system, the apparatus comprising: a camera configured to photograph an image for determining a location of the virtual monitor and for photographing an image of a user's finger; a graphic device storing at least one window image; a Parallel Tracking And Mapping (PTAM) processor configured to parallel process the image for determining a location of the virtual monitor, and to locate the at least one window image to display the virtual monitor at a set location; a finger tip extractor configured to extract a finger tip from the image of the user's finger; a stencil buffer configured to buffer information of the finger tip not to render the image of the finger in the virtual monitor such that an object of the virtual monitor is controlled by the fingertip extracted from the image of the user's finger; a collision determinator configured to determine whether the finger tip collides with an object in the virtual monitor, the object of the virtual monitor controlled by the fingertip extracted; and a function processor configured to control an operation of the virtual monitor according to whether the finger tip collides with the object in the virtual monitor.

2. The apparatus of claim 1 , further comprising an image compensator configured to receive and compensate for the image of the user's finger using a Rentinex algorithm to compensate for and to transfer, to the finger tip extractor, a unique color in the image of the user's finger changed due to illumination.

4. The apparatus of claim 2 , wherein the PTAM processor tracks the image for determining the location to extract characteristic points, forms a three-dimensional space using the extracted characteristic points to determine a location of the virtual monitor, forms a plane at the determined location of the virtual monitor using openGL, and maps the window image on the formed plane to form the virtual monitor.

5. The apparatus of claim 4 , wherein the PTAM processor repeats parallel processing the image for determining the location and the window images according to a user setting to form virtual multi-monitors at different locations.

6. The apparatus of claim 5 , wherein the finger tip extractor separates a finger from the compensated image of a finger using a Convex hull algorithm, and determines a direction of a finger from a center of an area and a center of a contour to extract the finger tip.

7. The apparatus of claim 6 , wherein the function processor comprises a head mount display unit, controls an operation of the virtual monitor according to a determination result of the collision processor, and expresses the operation of the virtual monitor in a three-dimensional space.

8. A method for controlling a virtual monitor in an augmented reality display system, including a camera for photographing an image for determining a location of the virtual monitor and for photographing an image of a user's finger, and a graphic device storing at least one window image, the method comprising: parallel-processing the image for determining a location of the virtual monitor, and locating the at least one window image to display the virtual monitor at a set location; extracting a finger tip from the image of the user's finger; buffering information of the finger tip not to render the image of the finger in the virtual monitor such that an object of the virtual monitor is controlled by the fingertip extracted from the image of the user's finger; determining whether the finger tip collides with an object in the virtual monitor, the object of the virtual monitor controlled by the fingertip extracted; and controlling an operation of the virtual monitor according to whether the finger tip collides with the object in the virtual monitor.

9. The method of claim 8 , further comprising receiving and compensating for the image of the user's finger using a Rentinex algorithm to compensate for a unique color in the image of the user's finger changed due to illumination.

11. The method of claim 9 , wherein the parallel-processing of the image for determining a location of the virtual monitor and the window images comprises: tracking the image for determining the location to extract characteristic points; forming a three-dimensional space using the extracted characteristic points to determine a location of the virtual monitor; forming a plane at the determined location of the virtual monitor using openGL; and mapping the window image on the formed plane to form the virtual monitor.

12. The method of claim 11 , wherein the parallel-processing of the image for determining a location of the virtual monitor and the window images comprises: repeating parallel processing of the image for determining the location and the window images according to a user setting to form virtual multi-monitors at different locations.

13. The method of claim 12 , wherein the extracting of the finger tip comprises: separating a finger from the compensated image of a finger using a Convex hull algorithm; and determining a direction of the finger from a center of an area and a center of a contour to extract the finger tip.

14. The method of claim 13 , wherein, the controlling of the operation of the virtual monitor comprises: controlling an operation of the virtual monitor according to a determination result of the collision processor; and expressing the operation of the virtual monitor in a three-dimensional space such that a user views the expressed operation of the virtual monitor.