Legal claims defining the scope of protection, as filed with the USPTO.
1. A method to display a merged image on a display, the method comprising, by a processor: receiving first data that relates to a first image of a real object; receiving second data that relates to a second image of a virtual object, wherein the second image, if displayed on the display, would overlap, in an overlap region, at least part of the first image if the first image were displayed on the display, and wherein the virtual object includes text; identifying an overlap part in the first data that corresponds to the overlap region; clipping the overlap part from the first data that relates to the first image of the real object by copying the overlap part to produce clipped data, wherein the clipped data includes data that corresponds to the first image of the real object in the overlap part; blurring the clipped data by application of a blurring transform on the clipped data, where the clipped data includes data that corresponds to the first image of the real object in the overlap part, to produce blurred data related to the first image of the real object; subtracting the clipped data related to the first image of the real object from the blurred data related to the first image of the real object to produce an additive blur component; adding the additive blur component to the second data related to the second image of the virtual object to produce merged data, wherein adding the additive blur component includes executing a brightness based merge, and wherein executing the brightness based merge includes: identifying a first brightness of the second data; and adjusting a second brightness of the additive blur component based on the first brightness; generating the merged image to be displayed on the display based on the merged data; and outputting the merged image on the display so that the merged data appears in the overlap region.
2. The method of claim 1 , wherein the display includes a see-through display.
3. The method of claim 1 , further comprising: prior to identifying the overlap part, registering a first location of the first data with a second location in the second data.
4. The method of claim 3 , wherein registering includes aligning four corner locations of the first data with four locations in the second data.
5. The method of claim 3 , wherein registering includes aligning the first location of the first data to a feature of the real object represented in the second data.
6. The method of claim 1 , further comprising: prior to blurring the clipped data, executing a perspective warp to the clipped data when the clipped data and the second data have different perspectives along the line of sight.
7. The method of claim 1 , wherein the blurring transform includes a Gaussian blur.
8. The method of claim 1 , wherein blurring the clipped data includes executing a computer vision function on the clipped data to produce the blurred data.
9. An augmented reality device effective to display an image, the device comprising: a memory that includes instructions; a camera configured to capture first data that relates to a first image of a real object; a processor configured to be in communication with the memory and camera, the processor configured to: receive the first data; receive second data that relates to a second image of a virtual object, wherein the second image, if displayed on the display, would overlap, in an overlap region, at least part of the first image of the real object if the first image of the real object were displayed on the display, and wherein the virtual object includes text; identify an overlap part in the first data that corresponds to the overlap region; clip the overlap part from the first data that relates to the first image of the real object by generation of a copy of the overlap part to produce clipped data, wherein the clipped data includes data that corresponds to the first image of the real object in the overlap part; blur the clipped data by application of a blurring transform on the clipped data, where the clipped data includes data that corresponds to the first image of the real object in the overlap part, to produce blurred data related to the first image of the real object; subtract the clipped data related to the first image of the real object from the blurred data related to the first image of the real object to produce an additive blur component; add the additive blur component to the second data related to the second image of the virtual object to produce merged data, wherein the addition of the additive blur component includes execution of a brightness based merge, and wherein execution of the brightness based merge includes: identification of a first brightness of the second data; and adjustment of a second brightness of the additive blur component based on the first brightness; and generate a merged image; and a display configured to be in communication with the processor, the display configured to display the merged image on the display so that the merged data appears in the overlap region.
10. The device of claim 9 , wherein the display includes a see-through display.
11. The device of claim 9 , wherein the processor is further configured to register, prior to identification of the overlap part, a first location of the first data with a second location in the second data.
12. The device of claim 9 , wherein the processor is further configured to execute a perspective warp to the clipped data when the clipped data and the second data have different perspectives along the line of sight.
13. The device of claim 9 , wherein the blurring transform includes a Gaussian blur.
14. A method to display a merged image on a display, the method comprising: capturing first data through a camera, wherein the first data relates to a first image of a real object; receiving, by a processor, second data that relates to a second image of a virtual object, wherein the second image, if displayed on the display, would overlap, in an overlap region, at least part of the first image if the first image were displayed on the display, and wherein the virtual object includes text; identifying, by the processor, an overlap part in the first data that corresponds to the overlap region; clipping, by the processor, the overlap part from the first data that relates to the first image of the real object by copying the overlap part to produce clipped data, wherein the clipped data includes data that corresponds to the first image of the real object in the overlap part; blurring, by the processor, the clipped data by application of a blurring transform on the clipped data, where the clipped data includes data that corresponds to the first image of the real object in the overlap part, to produce blurred data related to the first image of the real object; subtracting, by the processor, the clipped data related to the first image of the real object from the blurred data related to the first image of the real object to produce an additive blur component; adding, by the processor, the additive blur component to the second data related to the second image of the virtual object to produce merged data, wherein adding the additive blur component includes executing a brightness based merge, and wherein executing the brightness based merge includes: identifying a first brightness of the second data; and adjusting a second brightness of the additive blur component based on the first brightness; generating, by the processor, the merged image based on the merged data; and displaying the merged image on the display so that the merged data appears in the overlap region.
15. The method of claim 14 , further comprising, by the processor: registering a first location of the first data with a second location in the second data; and executing a perspective warp to the clipped data when the clipped data and the second data have different perspectives along the line of sight, wherein: applying the blurring transform on the clipped data includes applying a Gaussian blur; and adding the additive blur component includes executing a brightness based merge to add the additive blur component to the second data.
Unknown
March 28, 2017
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.