A smart management integrated mapping system (SMIMS) having the capability of displaying real-time properties and controlling network-based devices in a geographical area is disclosed which comprises: generating a 3D/360° map of the geographical area using at least one imaging devices; generating and storing real-time properties associated with the plurality of objects into a storage via a network; selecting and matching the real-time properties to each of the first plurality of objects; embedding the real-time properties into a plurality of objects; rendering the real-time properties into displayable images; and displaying the real-time properties at a particular observation point when a user selects that particular object.
Legal claims defining the scope of protection, as filed with the USPTO.
1. A method of generating and managing a three-dimensional-360 degrees (3D/3600) map of a geographical area, comprising: generating said 3D/3600 map of said geographical area using at least one imaging devices and at least one flying means, wherein said 3D/3600 map comprises a plurality of objects and network-based devices different from said plurality of objects, wherein said plurality of objects and network-based devices are stationary and permanent elements of said geographical area captured in said 3D/3600 map; using an application interface (API) to access remote client databases via a network and to obtain real-time properties associated with said plurality of objects and said network-based devices owned by said clients wherein using said API is based on determining data format of said plurality of objects and said network-based devices; enabling controls of said network-based devices via said network; embedding said real-time properties into said plurality of objects and said network-based devices located within said 3D/3600 map; providing an interactive graphic user interface (GUI) to display said real-time properties and to control said network-based devices; and displaying said real-time properties of any of said plurality of objects or said network-based devices when a user uses a pointing device to select any of said particular object or said particular network-based device.
2. The method of claim 1 wherein said step of generating said 3D/3600 map of said geographical area using at least one imaging devices further comprising: generating three-dimensional 3D/3600 still maps using said at least one imaging devices; generating a two-dimensional (2D) still maps said geographical area using at least one flying means; and stitching said three-dimensional 3D/3600 still maps and said two-dimensional 2D still maps into said 3D/3600 still map of said geographical area.
3. The method of claim 1 wherein said step of accessing client databases to obtain real-time properties associated with said plurality of objects further comprises: determining whether said client databases have provided a direct access or a remote access to obtain said real-time properties of said plurality of objects; if said client databases have provided said direct access, then retrieving said realtime properties of said plurality of objects; otherwise, checking a data format of said realtime properties of said plurality of objects, if said data format is correct then retrieving using said API and storing said real-time properties of said plurality of objects into said storage via said network.
4. The method of claim 1 wherein said network-based devices further comprises at least one lighting devices, at least one sensors, at least one cameras, at least one video recording devices, and at least one actuators; and wherein said controls of said network-based devices via said network further comprises: establishing communication links to said network-based devices; and determining whether interrupts occur, if not allowing said user to receive real-time imagery from said at least one lighting devices, said at least one sensors, at least one actuators, at least one cameras, and at least one video recording devices via said network; if said interrupts occur, repeating said establishing communication links with different network-based devices and/or repeating said determining interrupts occurring step.
5. The method of claim 4 wherein said controls of said network-based devices via said network further comprises: constantly receiving said real-time properties from said network-based devices; formatting said real-time properties of said network-based devices in form of a frame text having a predetermined data structure; and checking if said frame text conforms to said correct predetermined data structure: if said frame text conforms to said predetermined data structure, then transmitting and recording said real-time properties of said network-based devices via said network, if not then continue to receive said real-time properties of said network-based devices.
6. The method of claim 5 wherein said network comprises an Internet of Things (IoT), a hard drive, a master-slave configuration, and a cloud-network.
7. The method of claim 1 wherein said step of embedding said real-time properties of said plurality of objects and said network-based devices into said plurality of objects located within said 3D/3600 map further comprising: assigning a first identification (ID) to each of said plurality of objects and said network-based devices; assigning a second ID to said real-time properties associated with said plurality of objects and said network-based devices; and selecting said real-time properties when said first identification is matched with said second identification.
8. The method of claim 1 wherein said accessing client databases to obtain real-time properties associated with said network-based devices and storing said real-time properties of said network-based devices into a storage via a network further comprises: determining whether said client databases have provided a direct access or a remote access to obtain said real-time properties of said network-based devices; if said client databases have provided said direct access, then retrieving said realtime properties of said network-based devices; otherwise, checking a data format of said real-time properties of said network-based devices, if said data format is correct then retrieve using said API store said real-time properties of said network-based devices into said storage via said network.
9. The method of claim 1 further comprising: generating a second plurality of objects using said at least imaging devices; comparing said second plurality of objects with said plurality of objects; detecting differences between said plurality of objects and said second plurality of objects; combining said differences into said plurality of objects to generate an update realtime 3D/3600 still map; and displaying said update real-time 3D/3600 still map.
10. The method of claim 1 wherein said step of embedding said real-time properties into said plurality of objects located within said 3D/3600 map further comprises: generating a plurality of observation points each having an x-y-z coordinates on each of said plurality of objects; and fixedly attaching said plurality of observation points to said 3D/3600 still map so that when said user changes a view of said 3D/3600 still map, said plurality of observation points moves along accordingly without changing said x-y-z coordinates related to said 3D/3600 still map.
11. A computer network system, comprising: a plurality of network-based devices; at least one imaging devices for generating said 3D/3600 still map of property geographical area; a storage for storing said 3D/3600 still map and real-time properties of a plurality of objects and network-based devices different from said plurality of objects, wherein said plurality of objects and network-based devices are stationary and permanent elements of said geographical area captured in said 3D/3600 map; a smart management integrated mapping module (SMIM) comprising: a data retriever module configured to use an application interface (API) to access remote client databases to obtain real-time properties associated with said plurality of objects and said network-based devices owned by said clients wherein using said API is based on determining data format of said plurality of objects and said network-based devices and store said real-time properties into said storage via a network; device controller module configured to control operations and obtain said real-time properties of said plurality of network-based devices; a data embedder module configured to embed said real-time properties into a plurality of observation points located on said real-time 3D/3600 map; a data converter module configured to render said real-time properties into displayable images; an interactive manager module configured to provide an interactive graphic user interface (GUI) to users so that users can control said plurality of network-based devices and view said plurality of real-time properties; and a display and analytics module configured to display real-time properties of a particular object when said user using a pointing device to select one of said plurality of objects and display realtime imagery from said plurality of network-based devices.
12. The computer network system of claim 11 further wherein said smart management integrated mapping module (SMIM) further comprises a map update module configured to: generating a second plurality of objects using said at least one imaging devices; comparing said second plurality of objects with said plurality of objects; detecting differences between said plurality of objects and said second plurality of objects; and combining said differences into said plurality of objects to generate an update realtime 3D/3600 still map; and updating said update real-time 3D/3600 still map.
13. The computer network system of claim 12 wherein said at least one imaging devices is selected from at least one digital cameras, at least one 3D scanners, at least one video recording devices, and at least one flycams.
14. The computer network system of claim 13 wherein said network comprises an Internet of Things (IoT).
15. A computer software program stored in a non-transitory computer readable medium for executing a microprocessor in a computer network system to perform an image process, comprising: generating and displaying a smart management integrated mapping system (SMIMS) interface on a display screen of said computer network system; displaying an 3D/3600 still map of a geographical area including a plurality of objects and network-based devices different from said plurality of objects, wherein said plurality of objects and network-based devices are stationary and permanent elements of said geographical area captured in said 3D/3600 map; displaying real-time properties associated with said plurality of objects when a user selects a particular object when a user selects a particular object among said plurality of objects using an interactive graphic user interface (GUI) of said SMIMS interface; controlling and displaying a real-time imagery obtained from network-based devices when said user selects a particular network-based device among said network-based devices using said interactive graphic user interface (GUI) of said SMIMS interface, wherein said interactive management function is operable to perform: generating said 3D/3600 map of said geographical area using at least one imaging devices and at least one flying means; accessing remote client databases using an application interface (API) to obtain real-time properties associated with said plurality of objects and said network-based devices owned by said clients wherein using said API is based on determining data format of said plurality of objects and said network-based devices and storing said real-time properties into a storage via a network; enabling controls of said network-based devices via said network; embedding said real-time properties into said plurality of objects located within said 3D/3600 map; and providing said interactive graphic user interface (GUI) to display said real-time properties as a user moves a pointing device to one of said plurality of objects and to control said network-based devices.
16. The computer software program of claim 15 wherein said step of generating said 3D/3600 map of said geographical area using at least one imaging devices further comprising: generating three-dimensional 3D/3600 maps using said at least one imaging devices; generating two-dimensional (2D) still maps said geographical area using at least one flying means; and stitching said three-dimensional 3D/3600 maps and said 2D still maps into said 3D/3600 still map of said geographical area.
17. The computer software program of claim 15 wherein said step of accessing client databases to obtain real-time properties associated with said plurality of objects further comprises: determining whether said client databases have provided a direct access or a remote access to obtain said real-time properties of said plurality of objects and said network-based devices; if said client databases have provided said direct access, then retrieving said realtime properties of said plurality of objects and said network-based devices; otherwise, checking a data format of said real-time properties of said plurality of objects and said network-based devices, if said data format is correct then retrieving using said API and storing said real-time properties of said plurality of objects and said network-based devices into said storage via said network.
18. The method of claim 15 wherein said network-based devices further comprises at least one lighting devices, at least one sensors, at least one cameras, at least one video recording devices, and at least one actuators; and wherein said controls of said network-based devices via said network further comprises: establishing communication links to said network-based devices; and determining whether interrupts occur, if not allowing said user to receive real-time imagery from said at least one lighting devices, said at least one sensors, at least one actuators, at least one cameras, and at least one video recording devices via said network; if said interrupts occur, repeating said establishing communication links with different network-based devices and/or repeating said determining interrupts occurring step.
19. The computer software program of claim 15 wherein said controls of said network-based devices via said network further comprises: constantly receiving said real-time properties from said plurality of objects and said network-based devices; formatting said real-time properties in form of a frame text having a predetermined data structure; and checking if said frame text conforms to said correct predetermined data structure: if said frame text conforms to said predetermined data structure, then transmitting and recording said real-time properties via said network, if not then continue to receive said real-time properties of said plurality of objects and said network-based devices; wherein said step of embedding said real-time properties into said plurality of objects and said network-based devices located within said 3D/3600 map further comprising: assigning a first identification (ID) to each of said plurality of objects; assigning a second ID to said real-time properties associated with said plurality of objects and said network-based devices; and selecting said real-time properties when said first identification is matched with said second identification.
20. The computer software program of claim 15 further comprising: generating a second plurality of objects using said at least imaging devices; comparing said second plurality of objects with said plurality of objects; detecting differences between said plurality of objects and said second plurality of objects; combining said differences into said plurality of objects to generate an update realtime 3D/3600 still map; and displaying said update real-time 3D/3600 still map.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
November 2, 2018
February 16, 2021
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.