An embodiment of a Wearable Computer apparatus includes a first portable unit for data gathering and providing a natural user interface, and a second portable unit for processing the gathered data from the first unit and taking an action in respond to the received data. The first portable unit includes an eyeglass frame, at least one first scene camera disposed on the eyeglass frame for capturing at least one scene image corresponding to a field of view of a user, at least one microphone, one speaker and one LED to create a natural user interface, and at least one first processor to receive data from the data gathering units in the first portable unit and communicating that data to the second portable unit. The second portable unit is in communication with the first portable unit and includes at least one second processor configured for receiving data from the first processor. The second portable unit also includes at least one interface of a digital personal assistant that receives at least one scene image from the first portable unit and initiates an object recognition procedure to recognize an object in the at least one scene image. Based on the at least one recognized object, the digital personal assistant takes an action that may include providing a feedback to the user via light or audio.
Legal claims defining the scope of protection, as filed with the USPTO.
2. The multi-camera imaging apparatus of claim 1 wherein the perform the operation comprises determining that the user is paying attention to or looking at the at least one object using the at least one object recognition, the at least a portion of the head movements history, and the at least a portion of the eye movements history.
5. The multi-camera imaging apparatus of claim 2 wherein the determining that the user is paying attention to or looking at the at least one object comprises determining that the eye movements of the user maintained in the at least portion of the eye movements history have only a small variation or spread while the head movements of the user maintained in the at least portion of the head movements history remain relatively fixed.
6. The multi-camera imaging apparatus of claim 5 wherein the eye movements of the user comprise gaze directions of the user.
7. The multi-camera imaging apparatus of claim 2 wherein the determining that the user is paying attention to or looking at the at least one object comprises generating a motion vector representing the gaze directions of the user by combining the at least portion of the eye movements history and the at least portion of the head movements history.
12. The multi-camera imaging apparatus of claim 9 wherein the perform the operation further comprises selecting subset portions of at least some of the scene images containing the hand of the user and interpreting the gesture or the movement of the hand of the user in the subset portions of the at least some of the scene images.
13. The multi-camera imaging apparatus of claim 1 wherein the perform the operation includes anticipating a need of the user with respect to the at least one object using at least a portion of the head movements history and at least a portion of the eye movements history.
14. The multi-camera imaging apparatus of claim 1 wherein the eye movements history provides a trajectory of the eye movements of the eyes of the user.
15. The multi-camera imaging apparatus of claim 2 wherein the perform the operation further comprises creating a scene map of the at least one object based on the determining the user is paying attention to or looking at the at least one object.
17. The multi-camera imaging apparatus of claim 1 wherein first ones of the electronics elements are configured to be worn by the user and are disposed on or in the frame and second ones of the electronics elements are configured to be carried by the user and are disposed in a smartphone.
20. The multi-camera imaging apparatus of claim 19 wherein the perform the operation comprises determining that the user is paying attention to or looking at the at least one object using the at least one object recognition, the at least a portion of the head movements history, and the at least a portion of the eye movements history.
23. The multi-camera imaging apparatus of claim 20 wherein the determining that the user is paying attention to or looking at the at least one object comprises determining that the eye movements of the user maintained in the at least portion of the eye movements history have only a small variation or spread while the head movements of the user maintained in the at least portion of the head movements history remain relatively fixed.
24. The multi-camera imaging apparatus of claim 23 wherein the eye movements of the user comprise gaze directions of the user.
25. The multi-camera imaging apparatus of claim 20 wherein the determining that the user is paying attention to or looking at the at least one object comprises generating a motion vector representing the gaze directions of the user by combining the at least portion of the eye movements history and the at least portion of the head movements history.
30. The multi-camera imaging apparatus of claim 27 wherein the perform the operation further comprises selecting subset portions of at least some of the scene images containing the hand of the user and interpreting the gesture or the movement of the hand of the user in the subset portions of the at least some of the scene images.
31. The multi-camera imaging apparatus of claim 19 wherein the perform the operation includes anticipating a need of the user with respect to the at least one object using at least a portion of the head movements history and at least a portion of the eye movements history.
32. The multi-camera imaging apparatus of claim 19 wherein the eye movements history provides a trajectory of the eye movements of the eyes of the user.
33. The multi-camera imaging apparatus of claim 19 wherein the perform the operation further comprises creating a scene map of the at least one object based on the determining the user is paying attention to or looking at the at least one object.
35. The multi-camera imaging apparatus of claim 19 wherein first ones of the electronics elements are configured to be worn by the user and are disposed on or in the frame and second ones of the electronics elements are configured to be carried by the user and are disposed in a smartphone.
38. The multi-camera imaging apparatus of claim 37 wherein the perform the operation comprises determining that the user is paying attention to or looking at the at least one object using the at least one object recognition, the at least a portion of the head movements history, and the at least a portion of the eye movements history.
41. The multi-camera imaging apparatus of claim 38 wherein the determining that the user is paying attention to or looking at the at least one object comprises determining that the eye movements of the user maintained in the at least portion of the eye movements history have only a small variation or spread while the head movements of the user maintained in the at least portion of the head movements history remain relatively fixed.
42. The multi-camera imaging apparatus of claim 41 wherein the eye movements of the user comprise gaze directions of the user.
43. The multi-camera imaging apparatus of claim 38 wherein the determining that the user is paying attention to or looking at the at least one object comprises generating a motion vector representing the gaze directions of the user by combining the at least portion of the eye movements history and the at least portion of the head movements history.
48. The multi-camera imaging apparatus of claim 45 wherein the perform the operation further comprises selecting subset portions of at least some of the scene images containing the hand of the user and interpreting the gesture or the movement of the hand of the user in the subset portions of the at least some of the scene images.
49. The multi-camera imaging apparatus of claim 37 wherein the perform the operation includes anticipating a need of the user with respect to the at least one object using at least a portion of the head movements history and at least a portion of the eye movements history.
50. The multi-camera imaging apparatus of claim 37 wherein the eye movements history provides a trajectory of the eye movements of the eyes of the user.
51. The multi-camera imaging apparatus of claim 38 wherein the perform the operation further comprises creating a scene map of the at least one object based on the determining the user is paying attention to or looking at the at least one object.
53. The multi-camera imaging apparatus of claim 37 wherein first ones of the electronics elements are configured to be worn by the user and are disposed on or in the frame and second ones of the electronics elements are configured to be carried by the user and are disposed in a smartphone.
55. The multi-camera imaging apparatus of claim 19 wherein the multi-camera imaging apparatus further comprises the software.
56. The multi-camera imaging apparatus of claim 37 wherein the multi-camera imaging apparatus further comprises the software.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
September 21, 2019
September 20, 2022
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.