Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A method comprising: acquiring a first image of an object and a reflective surface at a first time with a camera positioned adjacent the reflective surface and having a field of view perpendicular to the reflective surface, wherein the image is reflected into the camera by a mirror positioned adjacent the camera, the mirror being positioned to reflect at least a portion of the reflective surface and a space adjacent the reflective surface; acquiring a second image of the object and the reflective surface with the camera at a second time; comparing the first image and the second image and determining a differential between the first image and the second image to identify movement; identifying in the first image and the second image the object based at least in part on the differential between the first image and the second image; identifying a convex polygon representing the object based at least in part on the differential between the first image and the second image; identifying in the first image and the second image a reflection of the object on the reflective surface, wherein the identifying the reflection of the object on the reflective surface comprises: defining a region of interest; subtracting pixel values of a portion of a video displayed on the reflective surface within the region of interest; analyzing a shape within the region of interest; and determining the shape to have a shape similar to the object in the first image and the second image; determining three-dimensional coordinates of at least a portion of the object based at least in part on the convex polygon and the reflection of the object in the first image and the second image; and transforming the three-dimensional coordinates into surface coordinates comprising a graphical marker displayed on the reflective surface.
A method for determining the 3D position of an object near a reflective surface (like a screen) involves capturing two images of the object and its reflection using a camera and a mirror. The camera is positioned to have a field of view perpendicular to the reflective surface. The mirror reflects the surface and space near it into the camera. The method compares the two images to detect movement, identifies the object based on these movements by finding differences in the images, and creates a convex polygon representing the object. It also locates the object's reflection by defining a region of interest on the reflective surface, subtracting pixel values related to content displayed on the reflective surface, analyzing shapes, and finding a shape similar to the object. Finally, it calculates the object's 3D coordinates using the object and reflection's positions, and converts these coordinates into a graphical marker on the reflective surface.
2. The method of claim 1 further comprising performing a predetermined action in response to the surface coordinates.
The method for determining the 3D position of an object, which acquires two images of the object and its reflection using a camera and a mirror, compares the two images to detect movement, identifies the object based on these movements, creates a convex polygon representing the object, locates the object's reflection by defining a region of interest on the reflective surface, analyzes shapes, and finds a shape similar to the object, calculates the object's 3D coordinates using the object and reflection's positions, and converts these coordinates into a graphical marker on the reflective surface, further includes performing a specific action based on the location where the graphical marker has appeared on the surface.
3. The method of claim 2 wherein the predetermined action is performed in response to the object remaining in substantially the same position for a predetermined amount of time.
The method for determining the 3D position of an object, which acquires two images of the object and its reflection using a camera and a mirror, compares the two images to detect movement, identifies the object based on these movements, creates a convex polygon representing the object, locates the object's reflection by defining a region of interest on the reflective surface, analyzes shapes, and finds a shape similar to the object, calculates the object's 3D coordinates using the object and reflection's positions, and converts these coordinates into a graphical marker on the reflective surface, further includes performing a specific action based on the location where the graphical marker has appeared on the surface, where the action only happens if the object stays in roughly the same place for a set amount of time.
4. The method of claim 2 wherein: the reflective surface is a graphical display; and the predetermined action includes displaying a graphical image at the surface coordinates.
The method for determining the 3D position of an object, which acquires two images of the object and its reflection using a camera and a mirror, compares the two images to detect movement, identifies the object based on these movements, creates a convex polygon representing the object, locates the object's reflection by defining a region of interest on the reflective surface, analyzes shapes, and finds a shape similar to the object, calculates the object's 3D coordinates using the object and reflection's positions, and converts these coordinates into a graphical marker on the reflective surface, further includes performing a specific action based on the location where the graphical marker has appeared on the surface, where the reflective surface is a graphical display, and the action is displaying an image at that location.
5. The method of claim 1 further comprising removably coupling a mobile computing device on an angle relative to the reflective surface, wherein the camera is coupled to the mobile computing device.
The method for determining the 3D position of an object, which acquires two images of the object and its reflection using a camera and a mirror, compares the two images to detect movement, identifies the object based on these movements, creates a convex polygon representing the object, locates the object's reflection by defining a region of interest on the reflective surface, analyzes shapes, and finds a shape similar to the object, calculates the object's 3D coordinates using the object and reflection's positions, and converts these coordinates into a graphical marker on the reflective surface, where a mobile device is attached at an angle relative to the reflective surface and the camera is connected to that device.
6. The method of claim 1 wherein acquiring of the image enables unilaterally provisioning computing capabilities identify the object, the reflection of the object in the reflective surface, and determine the three-dimensional coordinates of at least the portion of the object.
The method for determining the 3D position of an object, which acquires two images of the object and its reflection using a camera and a mirror, compares the two images to detect movement, identifies the object based on these movements, creates a convex polygon representing the object, locates the object's reflection by defining a region of interest on the reflective surface, analyzes shapes, and finds a shape similar to the object, calculates the object's 3D coordinates using the object and reflection's positions, and converts these coordinates into a graphical marker on the reflective surface, where the image capture allows computing to identify the object, its reflection, and the 3D coordinates of at least part of the object without additional configuration.
7. The method of claim 1 further comprising: acquiring a second image of the object and the reflective surface, the second image being acquired after the first image; identifying in the second image the object; identifying in the second image the convex polygon representing the object; identifying in the second image a reflection of the object on the reflective surface; and determining a second three-dimensional coordinates of at least a portion of the object based at least in part on the convex polygon and the reflection of the object in the second image.
The method for determining the 3D position of an object, which acquires two images of the object and its reflection using a camera and a mirror, compares the two images to detect movement, identifies the object based on these movements, creates a convex polygon representing the object, locates the object's reflection by defining a region of interest on the reflective surface, analyzes shapes, and finds a shape similar to the object, calculates the object's 3D coordinates using the object and reflection's positions, and converts these coordinates into a graphical marker on the reflective surface, further includes acquiring another image, identifying the object and creating its convex polygon in the new image, identifying the reflection of the object in the new image, and calculating new 3D coordinates based on the object and its reflection.
8. The method of claim 1 further comprising: determining a region of interest from the first image, the object being positioned within the region of interest; comparing at least one shape in the region of interest in the second image to the object in the first image; and wherein the object is identified in the second image based at least in part on the region of interest and the comparison of the at least one shape to the object.
The method for determining the 3D position of an object, which acquires two images of the object and its reflection using a camera and a mirror, compares the two images to detect movement, identifies the object based on these movements, creates a convex polygon representing the object, locates the object's reflection by defining a region of interest on the reflective surface, analyzes shapes, and finds a shape similar to the object, calculates the object's 3D coordinates using the object and reflection's positions, and converts these coordinates into a graphical marker on the reflective surface, further includes defining a region of interest in the first image where the object is located, and identifying the object in the second image by comparing shapes within that region to the object in the first image.
9. A system, the system comprising: a reflective surface; a camera positioned adjacent the reflective surface and having a field of view perpendicular to the reflective surface; a mirror positioned adjacent the reflective surface and the camera, the mirror oriented to reflect at least a portion of the reflective surface and a space adjacent the reflective surface; a memory having computer readable instructions; and one or more processors for executing the computer readable instructions, the one or more processors being coupled to communicate with the camera, the computer readable instructions comprising: acquiring a first image of an object and the reflective surface with the camera at a first time via the mirror; acquiring a second image of the object and the reflective surface with the camera at a second time; comparing the first image and the second image and determining a differential between the first image and the second image to identify movement; identifying in the first image and the second image the object based at least in part on the differential between the first image and the second image; identifying a convex polygon representing the object based at least in part on the differential between the first image and the second image; identifying in the first image and the second image a reflection of the object on the reflective surface, wherein the identifying the reflection of the object on the reflective surface comprises: defining a region of interest; subtract pixel values of a portion of a video displayed on the reflective surface within the region of interest; analyzing a shape within the region of interest; and determining the shape to have a shape similar to the object in the first image and the second image; determining three-dimensional coordinates of at least a portion of the convex polygon based at least in part on the object and the reflection of the object in the first image and the second image; and transforming the three-dimensional coordinates into surface coordinates comprising a graphical marked displayed on the reflective surface.
A system for determining the 3D position of an object near a reflective surface using image processing, includes a reflective surface, a camera positioned next to the surface with a view perpendicular to it, and a mirror that reflects the surface and surrounding area into the camera. A processor executes instructions to capture two images of the object and its reflection at different times. The system then compares the images to find motion, identifies the object in both images by detecting these movements and creates a convex polygon representing the object. It finds the reflection by focusing on a region of interest, subtracting background video displayed on the reflective surface, analyzing shapes, and matching it to the object's shape. It calculates 3D coordinates and marks the corresponding position on the reflective surface graphically.
10. The system of claim 9 further comprising performing a predetermined action in response to the surface coordinates.
The system for determining the 3D position of an object, comprised of a reflective surface, a camera positioned next to the surface with a view perpendicular to it, and a mirror that reflects the surface and surrounding area into the camera; which captures two images of the object and its reflection at different times, then compares the images to find motion, identifies the object in both images by detecting these movements, creates a convex polygon representing the object; finds the reflection, calculates 3D coordinates and marks the corresponding position on the reflective surface graphically; also performs a specific action based on the determined surface coordinates.
11. The system of claim 10 wherein the predetermined action is performed in response to the object remaining in substantially the same position for a predetermined amount of time.
The system for determining the 3D position of an object, comprised of a reflective surface, a camera positioned next to the surface with a view perpendicular to it, and a mirror that reflects the surface and surrounding area into the camera; which captures two images of the object and its reflection at different times, then compares the images to find motion, identifies the object in both images by detecting these movements, creates a convex polygon representing the object; finds the reflection, calculates 3D coordinates and marks the corresponding position on the reflective surface graphically; performs a specific action based on the determined surface coordinates; the action only happens if the object stays in roughly the same place for a set amount of time.
12. The system of claim 10 wherein the predetermined action includes displaying a graphical image at the surface coordinates.
The system for determining the 3D position of an object, comprised of a reflective surface, a camera positioned next to the surface with a view perpendicular to it, and a mirror that reflects the surface and surrounding area into the camera; which captures two images of the object and its reflection at different times, then compares the images to find motion, identifies the object in both images by detecting these movements, creates a convex polygon representing the object; finds the reflection, calculates 3D coordinates and marks the corresponding position on the reflective surface graphically; also performs a specific action based on the determined surface coordinates; where the action involves showing an image at the calculated location on the surface.
13. The system of claim 9 further comprising removably coupling a mobile computing device on an angle relative to the reflective surface, wherein the camera is coupled to the mobile computing device.
The system for determining the 3D position of an object, comprised of a reflective surface, a camera positioned next to the surface with a view perpendicular to it, and a mirror that reflects the surface and surrounding area into the camera; which captures two images of the object and its reflection at different times, then compares the images to find motion, identifies the object in both images by detecting these movements, creates a convex polygon representing the object; finds the reflection, calculates 3D coordinates and marks the corresponding position on the reflective surface graphically; where a mobile device is attached at an angle relative to the reflective surface, and the camera is connected to the mobile device.
14. A computer program product for determining a pre-touch location of an object relative to a reflective surface, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform: acquiring a first image of the object and the reflective surface at a first time with a camera, the camera arranged adjacent the reflective surface and having a field of view perpendicular to the reflective surface, wherein the image is reflected into the camera by a mirror positioned adjacent the camera, the mirror being positioned to reflect at least a portion of the reflective surface and a space adjacent the reflective surface; acquiring a second image of the object and the reflective surface with the camera at a second time; comparing the first image and the second image and determining a differential between the first image and the second image to identify movement; identifying in the first image and the second image the object based at least in part on a differential between the first image and the second image; identifying a convex polygon representing the object based at least in part on the differential between the first image and the second image; identifying in the first image and the second image a reflection of the object on the reflective surface, wherein the identifying the reflection of the object on the reflective surface comprises: defining a region of interest; subtracting pixel values of a portion of a video displayed on the reflective surface within the region of interest; analyzing a shape within the region of interest; and determining the shape to have a shape similar to the object in the first image and the second image; determining three-dimensional coordinates of at least a portion of the object based at least in part on the convex polygon and the reflection of the object in the first image and second image; and transforming the three-dimensional coordinates into surface coordinates comprising a graphical marker displayed on the reflective surface.
A computer program for determining the 3D position of an object near a reflective surface captures two images of the object and its reflection using a camera and a mirror. The camera is positioned to have a field of view perpendicular to the reflective surface. The mirror reflects the surface and space near it into the camera. The program compares the two images to detect movement, identifies the object based on these movements by finding differences in the images, and creates a convex polygon representing the object. It also locates the object's reflection by defining a region of interest on the reflective surface, subtracting pixel values related to content displayed on the reflective surface, analyzing shapes, and finding a shape similar to the object. Finally, it calculates the object's 3D coordinates using the object and reflection's positions, and converts these coordinates into a graphical marker on the reflective surface.
15. The computer program product of claim 14 further comprising performing a predetermined action in response to the surface coordinates.
The computer program for determining the 3D position of an object, which acquires two images of the object and its reflection using a camera and a mirror, compares the two images to detect movement, identifies the object based on these movements, creates a convex polygon representing the object, locates the object's reflection by defining a region of interest on the reflective surface, analyzes shapes, and finds a shape similar to the object, calculates the object's 3D coordinates using the object and reflection's positions, and converts these coordinates into a graphical marker on the reflective surface, further includes performing a specific action based on the location where the graphical marker has appeared on the surface.
16. The computer program product of claim 15 wherein the predetermined action is performed in response to the object in remaining substantially the same position for a predetermined amount of time.
The computer program for determining the 3D position of an object, which acquires two images of the object and its reflection using a camera and a mirror, compares the two images to detect movement, identifies the object based on these movements, creates a convex polygon representing the object, locates the object's reflection by defining a region of interest on the reflective surface, analyzes shapes, and finds a shape similar to the object, calculates the object's 3D coordinates using the object and reflection's positions, and converts these coordinates into a graphical marker on the reflective surface, further includes performing a specific action based on the location where the graphical marker has appeared on the surface, where the action only happens if the object stays in roughly the same place for a set amount of time.
17. The computer program product of claim 14 wherein: the reflective surface is a graphical display; and the predetermined action includes displaying a graphical image at the surface coordinates.
The computer program for determining the 3D position of an object, which acquires two images of the object and its reflection using a camera and a mirror, compares the two images to detect movement, identifies the object based on these movements, creates a convex polygon representing the object, locates the object's reflection by defining a region of interest on the reflective surface, analyzes shapes, and finds a shape similar to the object, calculates the object's 3D coordinates using the object and reflection's positions, and converts these coordinates into a graphical marker on the reflective surface, where the reflective surface is a graphical display, and the action is displaying an image at that location.
Unknown
November 21, 2017
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.