Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, relating to an autonomous aerial personal assistant device (AAPAD). The AAPAD can include a base unit housing various electronic components, a balloon for providing lift to carry a weight of the base unit, and a positioning unit that maintains a position of the balloon based at least on feedback provided by a plurality of sensors and computers. In some implementations, a request to initiate a communication session can be received on the AAPAD. Data indicating a presence of the user can then be obtained. A preset distance between the user and the AAPAD can be determined. Instructions to one or more components of the AAPAD can then be transmitted to automatically navigate the AAPAD to travel toward a location of the user.
Legal claims defining the scope of protection, as filed with the USPTO.
1. An autonomous aerial personal assistant device comprising: a base unit comprising: one or more electronic components including a personal assistant component that is configured to detect, and generate responses for, natural language questions, a rechargeable power generator that provides power to the one or more electronic components, one or more display elements, one or more cameras, one or more microphones, one or more speakers, and one or more sensors, and one or more computers comprising: a natural language processing element configured to process the natural language questions, a user engagement element that (i) is configured to perform operations comprising determining that a communication session with the user has ended, and in response to determining that the communication session with the user has ended, transmitting instructions to the positioning module to automatically navigate the autonomous aerial personal assistant device to travel in a direction away from a location of the user, and (ii) is configured to: operate in a first mode in which the autonomous aerial personal assistant remains in a designated location that is not viewable to a user; operate in a second mode in which the autonomous aerial personal assistant travels along a designated route that tracks movement of the user; or operate in a third mode in which the autonomous aerial personal assistant, upon receiving an instruction from the user, navigates towards a location of the user; a balloon for providing lift to carry a weight of the base unit; a projector that is disposed within the balloon and that is configured to provide representations of the responses to the natural language questions that are detected by the personal assistant component on an interior surface of the balloon for display; and a positioning unit that maintains a position of the balloon based at least on feedback provided by the one or more sensors and the one or more computers.
2. The device of claim 1 , wherein at least one of the one or more sensors is capable of generating a third-dimensional topological representation of a property region within a vicinity of the autonomous aerial personal assistant.
3. The device of claim 1 , wherein the user engagement element is configured to perform operations comprising: identifying a presence of a user within a vicinity of the autonomous aerial personal assistant device based at least on data obtained from the one or more cameras, the one or more sensors, and the one or more computers; determining a preset distance between the user and the autonomous aerial personal assistant device based at least on the presence of the user; and transmitting instructions to the positioning module to control movement of the balloon to maintain the preset distance between the user and the autonomous aerial floating personal assistant.
4. The device of claim 3 , wherein transmitting instructions to the positioning module to control movement of the balloon to maintain the preset distance comprises transmitting instructions to the positioning module to control movement of the balloon such that the one or more display elements face the user during the movement of the balloon.
5. The device of claim 3 , wherein the user engagement element configured to perform further operations comprising: receiving data indicating a user-specified trajectory of movement; and transmitting instructions to the positioning module to control movement of the balloon to navigate towards the user-specified trajectory of movement.
6. The device of claim 1 , wherein the user engagement element is configured to perform operations comprising: receiving, from a user device, a request to initiate a communication session on the autonomous aerial personal assistant device; and in response to receiving a request to initiate a communication on the autonomous aerial personal assistant device, transmitting instructions to the positioning module to automatically navigate the autonomous aerial personal assistant device to travel toward a location of the user.
7. The device of claim 1 , wherein the balloon further comprises a refillable helium tank configured to inflate the balloon with helium.
8. The device of claim 1 , wherein the one or more computers are configured to perform operations comprising: receiving, from a remote device associated with a first user, a request to initiate video conference with a second user near a vicinity of the autonomous aerial personal assistant; identifying a presence of the second user within the vicinity of the autonomous aerial personal assistant device based at least on data obtained from the one or more cameras, the one or more sensors, and the one or more computers; and in response to identifying the presence of the second user, transmitting instructions to the initiate the video conference between the first user and the second user.
9. A computer-implemented method comprising: receiving, from a computer device of a user, data indicating a request to initiate a communication session on the autonomous aerial personal assistant device; obtaining data indicating a presence of the user within a vicinity of the autonomous aerial floating personal assistance device; determining a preset distance between the user and the autonomous aerial personal assistant device based at least on the obtained data indicating the presence of the user; transmitting instructions to one or more components of the autonomous aerial floating personal assistance device to: (i) automatically navigate the autonomous aerial personal assistant device to travel toward a location of the user, and (ii) control movement of the autonomous aerial floating personal assistance device to maintain the optimal distance between the user and the autonomous aerial floating personal assistant; in response to a natural language question of the user that is detected by the autonomous aerial personal assistant, automatically, by the autonomous aerial personal assistant, (i) generating a response to the natural language question, and (ii) providing, by a projector that is disposed within a balloon, a representation of the response to the natural language question a representation of the response to the natural language question on an interior surface of the balloon for display to the user; and determining that the communication session with the user has ended; and in response to determining that the communication session with the user has ended, transmitting instructions to one or more components of the autonomous aerial personal assistant device to automatically navigate the autonomous aerial personal assistant device to travel in a direction away from a location of the user.
10. The method of claim 9 , further comprising: transmitting instructions to the one or more components of the autonomous aerial floating personal operate in a particular mode from among multiple operation modes, the multiple operation modes including at least: a first mode in which the autonomous aerial personal assistant remains in a designated location that is not viewable to a user near a vicinity of the autonomous aerial personal assistant; a second mode in which the autonomous aerial personal assistant travels along a designated route that tracks movement of the user near the vicinity of the autonomous aerial personal assistant; and a third in which the autonomous aerial personal assistant, upon receiving an instruction from the user near the vicinity of the aerial floating personal assistance device, travels toward a location of the user.
11. The method of claim 9 , further comprising: receiving, from a remote device associated with a first user, a request to initiate video conference with a second user near a vicinity of the autonomous aerial personal assistant; identifying a presence of the second user within the vicinity of the autonomous aerial personal assistant device based at least on data obtained from one or more cameras, one or more sensors, and one or more computers; and in response to identifying the presence of the second user, transmitting instructions to the initiate the video conference between the first user and the second user.
12. A non-transitory computer-readable storage device encoded with computer program instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising: receiving, from a computer device of a user, data indicating a request to initiate a communication session on the autonomous aerial personal assistant device; obtaining data indicating a presence of the user within a vicinity of the autonomous aerial floating personal assistance device; determining a preset distance between the user and the autonomous aerial personal assistant device based at least on the obtained data indicating the presence of the user; transmitting instructions to one or more components of the autonomous aerial floating personal assistance device to: (i) automatically navigate the autonomous aerial personal assistant device to travel toward a location of the user, and (ii) control movement of the autonomous aerial floating personal assistance device to maintain the optimal distance between the user and the autonomous aerial floating personal assistant; in response to a natural language question of the user that is detected by the autonomous aerial personal assistant, automatically, by the autonomous aerial personal assistant, (i) generating a response to the natural language question, and (ii) providing, by a projector that is disposed within a balloon, a representation of the response to the natural language question a representation of the response to the natural language question on an interior surface of the balloon for display to the user; and determining that the communication session with the user has ended; and in response to determining that the communication session with the user has ended, transmitting instructions to one or more components of the autonomous aerial personal assistant device to automatically navigate the autonomous aerial personal assistant device to travel in a direction away from a location of the user.
13. The device of claim 12 , further comprising: transmitting instructions to the one or more components of the autonomous aerial floating personal operate in a particular mode from among multiple operation modes, the multiple operation modes including at least: a first mode in which the autonomous aerial personal assistant remains in a designated location that is not viewable to a user near a vicinity of the autonomous aerial personal assistant; a second mode in which the autonomous aerial personal assistant travels along a designated route that tracks movement of the user near the vicinity of the autonomous aerial personal assistant; and a third in which the autonomous aerial personal assistant, upon receiving an instruction from the user near the vicinity of the aerial floating personal assistance device, travels toward a location of the user.
14. The device of claim 12 , further comprising: receiving, from a remote device associated with a first user, a request to initiate video conference with a second user near a vicinity of the autonomous aerial personal assistant; identifying a presence of the second user within the vicinity of the autonomous aerial personal assistant device based at least on data obtained from one or more cameras, one or more sensors, and one or more computers; and in response to identifying the presence of the second user, transmitting instructions to the initiate the video conference between the first user and the second user.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
October 13, 2017
October 13, 2020
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.