Legal claims defining the scope of protection, as filed with the USPTO.
1. An apparatus comprising a transparent display for implementing augmented reality, the apparatus comprising: a transparent display; a front camera; a rear camera configured to capture a first background image; a memory; and a processor electrically connected to the transparent display, the front camera, the rear camera, and the memory, wherein the memory stores instructions that, when executed, cause the processor, to control the front camera to capture a face image, to control the rear camera to capture a first background image, to convert the first background image into a second background image based on a gaze direction determined by using the face image, to extract an image of a first area from the second background image based on a viewing angle of the user, to generate an augmented reality image based on the extracted image, to display the augmented reality image on the transparent display, and wherein the first background image is converted into the second background image by moving or rotating the first background image based on the gaze direction.
2. The apparatus as claimed in claim 1 , wherein the instructions further cause the processor to match a shooting direction of the rear camera to the gaze direction of the user.
3. The apparatus as claimed in claim 1 , wherein the instructions further cause the processor to move the shooting direction of the rear camera to a position matched to the gaze direction of the user.
4. The apparatus as claimed in claim 1 , wherein the instructions further cause the controller, to detect an object of interest by analyzing the extracted image, to map virtual information to the detected object of the interest, to generate the augmented reality image including the virtual information and the detected object of the interest, and to display the augmented reality image on the transparent display.
5. The apparatus as claimed in claim 1 , wherein the rear camera is a wide-angle camera.
6. A method of implementing augmented reality by using a transparent display, the method comprising: receiving a face image from a front camera; receiving a first background image from a rear camera; converting the first background image into a second background image based on a gaze direction determined by using the face image; extracting an image of a first area from the second background image captured by a rear camera based on a viewing angle of the user; generating an augmented reality image based on the extracted image; displaying the augmented reality image on the transparent display, and wherein the first background image is converted into the second background image by moving or rotating the first background image based on the gaze direction.
7. The method as claimed in claim 6 , further comprising: matching a shooting direction of the rear camera to the gaze direction of the user.
8. The method as claimed in claim 7 , further comprising: moving the shooting direction of the rear camera to a position matched to the gaze direction of the user.
9. The method as claimed in claim 6 , wherein the generating of the augmented reality image based on the extracted image comprises: detecting an object of interest by analyzing the extracted image; mapping virtual information to the detected object of the interest; and generating the augmented reality image including the virtual information and the detected object of the interest.
10. The method as claimed in claim 6 , wherein the rear camera is a wide-angle camera.
11. At least one non-transitory processor readable medium for storing a computer program of instructions configured to be readable by at least one processor for instructing the at least one processor to execute a computer process for performing the method as recited in claim 6 .
Unknown
May 15, 2018
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.