Technologies for interacting with a user to identify an unrecognizable object include an autonomous device that is configured to obtain environmental data indicative of an environment, detect an object in the environment using the environmental data, determine, in response to detecting the object, whether the object is recognizable, activate, in response to determining that the object is not recognizable, a light source, indicate the object using the light source, query a user using the light source and a natural language query output with an audio device, receive a user response indicative of an object identity, and update a recognizable object database in response to a receipt of the user response to associate the object identity with the object.
Legal claims defining the scope of protection, as filed with the USPTO.
1. An autonomous device for user interaction to identify an unrecognizable object, the autonomous device comprising: an I/O communicator to obtain environmental data indicative of an environment; an object manager to detect an object in the environment using the environmental data and determine, in response to a detection the object, whether the object is recognizable; a light source controller to activate, in response to a determination that the object is not recognizable, a light source and indicate the object using the light source; and a user communicator to query a user using the light source and a natural language query output with an audio device and receive a user response indicative of an object identity; wherein the object manager is further to update a recognizable object database in response to a receipt of the user response to associate the object identity with the object.
2. The autonomous device of claim 1 further comprising an environment map manager to generate an environment map, wherein the environment map includes a digital blueprint of the environment including locations of one or more recognized objects in the environment.
3. The autonomous device of claim 1 further comprising a device location tracker to monitor a location of the autonomous device in the environment map.
4. The autonomous device of claim 1 , wherein the environmental data includes data obtained from a camera or a LIDAR sensor.
5. The autonomous device of claim 1 , wherein to detect the object comprises to detect the object using a recognizable object database or an environment map.
6. The autonomous device of claim 1 , wherein to indicate the object using the light source comprises to indicate the object by illuminating light indicate on the object.
7. The autonomous device of claim 1 , wherein to indicate the object using the light source comprises to indicate the object by projecting a frame of light surrounding the object.
8. The autonomous device of claim 1 , wherein to query the user comprises to query the user based on at least one of absolute coordinates of the object, relative coordinates relative to one or more nearby known objects, or a distance from the autonomous device.
9. The autonomous device of claim 1 , wherein to query the user comprises to query the user based on one or more features of the object.
10. The autonomous device of claim 1 , wherein the light source controller is further to deactivate the light source in response to a determination that a predefined time is reached without a receipt of the user response after the activation of the light source.
11. One or more non-transitory, machine-readable storage media comprising a plurality of instructions stored thereon that, in response to being executed, cause an autonomous device to: obtain environmental data indicative of an environment; detect an object in the environment using the environmental data; determine whether the object is recognizable; activate, in response to determining that the object is not recognizable, a light source; indicate the object using the light source; query a user using the light source and a natural language query output with an audio device; receive a user response indicative of an object identify; and update a recognizable object database in response to a receipt of the user response to associate the object identity with the object.
12. The one or more non-transitory, machine-readable storage media of claim 11 , further comprising a plurality of instructions that in response to being executed cause the autonomous device to generate an environment map, wherein the environment map includes a digital blueprint of the environment including locations of one or more recognized objects in the environment.
13. The one or more non-transitory, machine-readable storage media of claim 11 , further comprising a plurality of instructions that in response to being executed cause the autonomous device to monitor a location of the autonomous device in the environment map, wherein to detect the object comprises to detect the object using a recognizable object database or an environment map.
14. The one or more non-transitory, machine-readable storage media of claim 11 , wherein the environmental data includes data obtained from a camera or a LIDAR sensor.
15. The one or more non-transitory, machine-readable storage media of claim 11 , to indicate the object using the light source comprises to indicate the object by illuminating light indicate on the object.
16. The one or more non-transitory, machine-readable storage media of claim 11 , wherein to indicate the object using the light source comprises to indicate the object by projecting a frame of light surrounding the object.
17. The one or more non-transitory, machine-readable storage media of claim 11 , wherein to query the user comprises to query the user based on at least one of absolute coordinates of the object, relative coordinates relative to one or more nearby known objects, or a distance from the autonomous device.
18. The one or more non-transitory, machine-readable storage media of claim 11 , wherein to query the user comprises to query the user based on one or more features of the object.
19. The one or more non-transitory, machine-readable storage media of claim 11 , further comprising a plurality of instructions that in response to being executed cause the autonomous device to deactivate the light source in response to a determination that a predefined time is reached without a receipt of the user response after the activation of the light source.
20. A method for interacting with a user to identify an unrecognizable object, the method comprising: obtaining, by an autonomous device, environmental data indicative of an environment; detecting, by the autonomous device, an object in the environment using the environmental data; determining, in response to detecting the object and by the autonomous device, whether the object is recognizable; activating, in response to determining that the object is not recognizable and by the autonomous device, a light source; indicating, by the autonomous device, the object using the light source; querying, by the autonomous device, a user using the light source and a natural language query output with an audio device; receiving, by the autonomous device, a user response indicative of an object identity; and updating, by the autonomous device, a recognizable object database in response to a receipt of the user response to associate the object identity with the object.
21. The method of claim 20 further comprising tracking a location of the autonomous device in the environment map, wherein detecting the object comprises detecting the object using a recognizable object database or an environment map.
22. The method of claim 20 , wherein indicating the object using the light source comprises indicating the object by illuminating light indicate on the object.
23. The method of claim 20 , wherein indicating the object using the light source comprises indicating the object by projecting a frame of light surrounding the object.
24. The method of claim 20 , wherein querying the user comprises querying the user based on at least one of absolute coordinates of the object, relative coordinates relative to one or more nearby known objects, a distance from the autonomous device, or one or more features of the object.
25. The method of claim 20 further comprising: determining, by an autonomous device, whether a predefined time is reached without a receipt of the user response after the activation of the light source; transmitting, in response to determining that the predefined time has been reached and by an autonomous device, an alert message; and deactivating, by an autonomous device, the light source.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
September 7, 2018
February 2, 2021
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.