Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A system for automatic re-localization of a handheld scanning device in a previously mapped environment, the system comprising: a two-dimensional (2D) scanner comprising: a light source, an image sensor and a controller, the light source steers a beam of light within a first plane to illuminate object points in the environment, the image sensor is arranged to receive light reflected from the object points, the controller being operable to determine a distance value to at least one of the object points; and an inertial measurement unit fixedly coupled relative to the 2D scanner and having a first sensor, the inertial measurement unit generating a signal in response a change in position or orientation of the housing, the first sensor having a first characteristic; one or more processors operably coupled to the 2D scanner, the one or more processors being responsive to non-transitory executable instructions for performing operations comprising: determining a current location of the 2D scanner in an environment relative to a location in a previously generated 2D image of the environment that was created based at least in part on an image of a non-digital floorplan; generating a new 2D image of at least a subset of the environment based at least in part in response to a signal from the first sensor, the at least a subset of the environment comprising the current location of the 2D scanner and at least one other location in the environment; and combining overlapping portions of the previously generated 2D image and the current 2D image.
This invention relates to a system for automatically re-localizing a handheld scanning device within a previously mapped environment. The system addresses the challenge of maintaining accurate positioning of a handheld scanner as it moves through an environment, ensuring that new scans align correctly with pre-existing maps. The system includes a 2D scanner with a light source that steers a beam within a plane to illuminate object points, an image sensor to capture reflected light, and a controller to calculate distance to those points. An inertial measurement unit (IMU) is fixed to the scanner, detecting changes in position or orientation via a sensor with specific characteristics. One or more processors analyze signals from the IMU to determine the scanner's current location relative to a pre-existing 2D map, which was initially created using a non-digital floorplan. The system generates a new 2D image of the environment, including the scanner's current location and other points, and merges overlapping regions of the new and pre-existing images to maintain an accurate, updated map. This ensures seamless integration of new scans with prior mapping data, improving navigation and spatial awareness in dynamic environments.
2. The system of claim 1 , wherein the determining comprises: computing virtual scan data based at least in part on a point of view of the location in a previously generated 2D image of the environment; obtaining current scan data from the 2D scanner at the current location; comparing the virtual scan data to the current scan data; and based on the virtual scan data not matching the current scan data: modifying the point of view of the location in a previously generated 2D image of the environment; and repeating the computing, obtaining, and comparing.
3. The system of claim 2 , wherein the virtual scan data matches the current scan data when the virtual scan data is within a threshold value of the current scan data.
4. The system of claim 2 , wherein the repeating is performed until the virtual scan data matches the current scan data.
5. The system of claim 1 , wherein the system further comprises a mobile computing device coupled to the 2D scanner, and the current location of the 2D scanner relative to a location in a previously generated 2D image is determined by an augmented reality application executing on the mobile computing device.
6. The system of claim 1 , wherein the image of the non-digital floorplan is a photograph.
7. The system of claim 1 , wherein the floorplan is a floorplan of a building.
8. The system of claim 1 , wherein the first sensor is selected from a group comprising: an accelerometer, a gyroscope and a magnetometer.
9. The system of claim 1 , wherein the first sensor is a camera.
10. The system of claim 1 , wherein the image of the non-digital floorplan includes an image of a scale adjacent the non-digital floorplan.
A system converts non-digital floorplans, such as paper or printed blueprints, into digital floorplans. The system captures an image of the non-digital floorplan, processes the image to extract geometric features, and generates a digital floorplan from the extracted features. The system includes a camera or scanner to capture the image, a processor to analyze the image and identify walls, doors, and other architectural elements, and a display to present the digital floorplan. The system may also include a scale reference in the captured image to ensure accurate dimensions in the digital output. The scale reference, such as a ruler or grid, is placed adjacent to the non-digital floorplan during imaging to provide a measurement standard for converting physical dimensions into digital units. The system may further include calibration tools to adjust for perspective distortion or lens distortion in the captured image, ensuring precise scaling and alignment of the digital floorplan. The system may also support user input to refine or correct the extracted features, allowing for manual adjustments to improve accuracy. The digital floorplan can be exported in various formats for use in architectural software or construction planning tools.
11. A method for automatic re-localization of a handheld scanning device in a previously mapped environment, the method comprising: determining a current location of a 2D scanner in an environment relative to a location in a previously generated 2D image of the environment that was created based at least in part on an image of a non-digital floorplan, the 2D scanner comprising: a light source, an image sensor and a controller, the light source steers a beam of light within the first plane to illuminate object points in the environment, the image sensor is arranged to receive light reflected from the object points, the controller being operable to determine a distance value to at least one of the object points; and an inertial measurement unit fixedly coupled relative to the 2D scanner and having a first sensor, the inertial measurement unit generating a signal in response a change in position or orientation of the housing, the first sensor having a first characteristic; generating a new 2D image of at least a subset of the environment based at least in part in response to a signal from the first sensor, the at least a subset of the environment comprising the current location of the 2D scanner and at least one other location in the environment; and combining overlapping portions of the previously generated 2D image and the current 2D image.
12. The method of claim 11 , wherein the determining comprises: computing virtual scan data based at least in part on a point of view of the location in a previously generated 2D image of the environment; obtaining current scan data from the 2D scanner at the current location; comparing the virtual scan data to the current scan data; and based on the virtual scan data not matching the current scan data: modifying point of view of the location in a previously generated 2D image of the environment; and repeating the computing, obtaining, and comparing.
13. The method of claim 12 , wherein the virtual scan data matches the current scan data when the virtual scan data is within a threshold value of the current scan data.
14. The method of claim 12 , wherein the repeating is performed until the virtual scan data matches the current scan data.
A system and method for aligning virtual scan data with current scan data involves generating a virtual scan of a physical object using a virtual model and comparing it to a current scan of the same object. The virtual scan is adjusted by modifying the virtual model parameters, such as position, orientation, or shape, and the process is repeated until the virtual scan data closely matches the current scan data. This alignment ensures accurate representation of the physical object in the virtual model, which is useful in applications like quality control, manufacturing, or medical imaging where precise matching between real-world and digital data is critical. The method may involve iterative adjustments, where each iteration refines the virtual model based on discrepancies between the virtual and current scans. The process continues until the differences fall within a predefined tolerance, ensuring the virtual model accurately reflects the current state of the physical object. This technique improves the reliability of digital representations in various industrial and medical applications.
15. The method of claim 11 , wherein the current location of the 2D scanner relative to a location in a previously generated 2D image is determined by an augmented reality application executing on a mobile computing device coupled to the 2D scanner.
16. The method of claim 11 , wherein the image of the non-digital floorplan is a photograph.
17. The method of claim 11 , wherein the floorplan is a floorplan of a building.
18. The method of claim 11 , wherein the image of the non-digital floorplan includes an image of a scale adjacent the non-digital floorplan.
Unknown
January 26, 2021
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.