Patentable/Patents/US-9679197
US-9679197

Biometric aware object detection and tracking

PublishedJune 13, 2017
Assigneenot available in USPTO data we have
Inventorsnot available in USPTO data we have
Technical Abstract

The technology disclosed can provide methods and systems for identifying users while capturing motion and/or determining the path of a portion of the user with one or more optical, acoustic or vibrational sensors. Implementations can enable use of security aware devices, e.g., automated teller machines (ATMs), cash registers and banking machines, other secure vending or service machines, security screening apparatus, secure terminals, airplanes, automobiles and so forth that comprise sensors and processors employing optical, audio or vibrational detection mechanisms suitable for providing gesture detection, personal identification, user recognition, authorization of control inputs, and other machine control and/or machine communications applications. A virtual experience can be provided to the user in some implementations by the addition of haptic, audio and/or other sensory information projectors.

Patent Claims
29 claims

Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.

Claim 1

Original Legal Text

1. A method of authorizing commands issued by gestures, the method including: detecting a set of gestures performed by different users and identifying control gestures in the set of gestures that control responsiveness of one of more virtual objects, including: capturing a plurality of images of a hand in a three-dimensional (3D) sensory space; processing one or more of the images to extract biometric features of the hand; authenticating the hand based on the extracted biometric features; determining a dominant user from among the users based at least on one or more biometric features extracted of the users; processing the sequence of the images as a hand gesture; determining a command indicated by the hand gesture; determining whether the authenticated hand is authorized to issue the command; and issuing an authorized command as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users.

Plain English Translation

A method for authorizing commands using hand gestures involves capturing multiple images of a hand in 3D space, extracting biometric features from the images, and authenticating the hand based on these features. The method identifies a "dominant" user based on their biometrics, processes a sequence of hand images as a gesture, and determines the command indicated by the gesture. If the authenticated hand is authorized to issue the command, the system triggers a response from virtual objects based on the gesture of the dominant user, while ignoring gestures from non-dominant users. This allows control of virtual objects via biometric-authenticated gestures.

Claim 2

Original Legal Text

2. The method of claim 1 , wherein the extracted biometric features include vein patterns of the hand.

Plain English Translation

The method of authorizing commands issued by gestures, including: detecting a set of gestures performed by different users and identifying control gestures in the set of gestures that control responsiveness of one of more virtual objects, including: capturing a plurality of images of a hand in a three-dimensional (3D) sensory space; processing one or more of the images to extract biometric features of the hand; authenticating the hand based on the extracted biometric features; determining a dominant user from among the users based at least on one or more biometric features extracted of the users; processing the sequence of the images as a hand gesture; determining a command indicated by the hand gesture; determining whether the authenticated hand is authorized to issue the command; and issuing an authorized command as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users, where the biometric features used for authentication specifically include vein patterns of the hand.

Claim 3

Original Legal Text

3. The method of claim 1 , wherein the extracted biometric features include palm prints of the hand.

Plain English Translation

The method of authorizing commands issued by gestures, including: detecting a set of gestures performed by different users and identifying control gestures in the set of gestures that control responsiveness of one of more virtual objects, including: capturing a plurality of images of a hand in a three-dimensional (3D) sensory space; processing one or more of the images to extract biometric features of the hand; authenticating the hand based on the extracted biometric features; determining a dominant user from among the users based at least on one or more biometric features extracted of the users; processing the sequence of the images as a hand gesture; determining a command indicated by the hand gesture; determining whether the authenticated hand is authorized to issue the command; and issuing an authorized command as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users, where the biometric features used for authentication specifically include palm prints of the hand.

Claim 4

Original Legal Text

4. The method of claim 1 , wherein the extracted biometric features include fingerprints of the hand.

Plain English Translation

The method of authorizing commands issued by gestures, including: detecting a set of gestures performed by different users and identifying control gestures in the set of gestures that control responsiveness of one of more virtual objects, including: capturing a plurality of images of a hand in a three-dimensional (3D) sensory space; processing one or more of the images to extract biometric features of the hand; authenticating the hand based on the extracted biometric features; determining a dominant user from among the users based at least on one or more biometric features extracted of the users; processing the sequence of the images as a hand gesture; determining a command indicated by the hand gesture; determining whether the authenticated hand is authorized to issue the command; and issuing an authorized command as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users, where the biometric features used for authentication specifically include fingerprints of the hand.

Claim 5

Original Legal Text

5. The method of claim 2 further including extracting at least one of: scars of the hand; shape of the hand; size of the hand; measurements across a palm of the hand; finger width at a first knuckle of the hand; and complexion of the hand.

Plain English Translation

The method of authorizing commands issued by gestures, including: detecting a set of gestures performed by different users and identifying control gestures in the set of gestures that control responsiveness of one of more virtual objects, including: capturing a plurality of images of a hand in a three-dimensional (3D) sensory space; processing one or more of the images to extract vein patterns of the hand; authenticating the hand based on the extracted vein patterns; determining a dominant user from among the users based at least on one or more biometric features extracted of the users; processing the sequence of the images as a hand gesture; determining a command indicated by the hand gesture; determining whether the authenticated hand is authorized to issue the command; and issuing an authorized command as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users, which includes extracting at least one of: scars of the hand; shape of the hand; size of the hand; measurements across a palm of the hand; finger width at a first knuckle of the hand; and complexion of the hand, to supplement vein pattern identification.

Claim 6

Original Legal Text

6. The method of claim 1 , further including: using stereo-imaging to capture the plurality of images of the hand.

Plain English Translation

The method of authorizing commands issued by gestures, including: detecting a set of gestures performed by different users and identifying control gestures in the set of gestures that control responsiveness of one of more virtual objects, including: capturing a plurality of images of a hand in a three-dimensional (3D) sensory space; processing one or more of the images to extract biometric features of the hand; authenticating the hand based on the extracted biometric features; determining a dominant user from among the users based at least on one or more biometric features extracted of the users; processing the sequence of the images as a hand gesture; determining a command indicated by the hand gesture; determining whether the authenticated hand is authorized to issue the command; and issuing an authorized command as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users, where the images of the hand are captured using stereo-imaging techniques.

Claim 7

Original Legal Text

7. The method of claim 1 , further including: registering multiple images of different poses of the hand during the hand gesture.

Plain English Translation

The method of authorizing commands issued by gestures, including: detecting a set of gestures performed by different users and identifying control gestures in the set of gestures that control responsiveness of one of more virtual objects, including: capturing a plurality of images of a hand in a three-dimensional (3D) sensory space; processing one or more of the images to extract biometric features of the hand; authenticating the hand based on the extracted biometric features; determining a dominant user from among the users based at least on one or more biometric features extracted of the users; processing the sequence of the images as a hand gesture; determining a command indicated by the hand gesture; determining whether the authenticated hand is authorized to issue the command; and issuing an authorized command as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users, where multiple images of the hand in different poses are registered during the gesture.

Claim 8

Original Legal Text

8. The method of claim 7 , wherein the different poses of the hand include at least one of: palm view of the hand; backhand view of the hand; and closed fist view of the hand.

Plain English Translation

The method of authorizing commands issued by gestures where multiple images of the hand in different poses are registered during the hand gesture, the different poses of the hand include at least one of: palm view of the hand; backhand view of the hand; and closed fist view of the hand. These different views aid in accurately capturing and interpreting the hand gesture and extracting comprehensive biometric data.

Claim 9

Original Legal Text

9. The method of claim 1 , further including: responsive to authenticating the hand based on the extracted biometric features, interpreting subsequent hand gestures based on specific interpretation criteria.

Plain English Translation

The method of authorizing commands issued by gestures, including: detecting a set of gestures performed by different users and identifying control gestures in the set of gestures that control responsiveness of one of more virtual objects, including: capturing a plurality of images of a hand in a three-dimensional (3D) sensory space; processing one or more of the images to extract biometric features of the hand; authenticating the hand based on the extracted biometric features; determining a dominant user from among the users based at least on one or more biometric features extracted of the users; processing the sequence of the images as a hand gesture; determining a command indicated by the hand gesture; determining whether the authenticated hand is authorized to issue the command; and issuing an authorized command as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users, where upon successful authentication, subsequent hand gestures are interpreted based on specific criteria associated with that authenticated hand.

Claim 10

Original Legal Text

10. The method of claim 1 , further including: issuing the authorized command to a security aware device.

Plain English Translation

The method of authorizing commands issued by gestures, including: detecting a set of gestures performed by different users and identifying control gestures in the set of gestures that control responsiveness of one of more virtual objects, including: capturing a plurality of images of a hand in a three-dimensional (3D) sensory space; processing one or more of the images to extract biometric features of the hand; authenticating the hand based on the extracted biometric features; determining a dominant user from among the users based at least on one or more biometric features extracted of the users; processing the sequence of the images as a hand gesture; determining a command indicated by the hand gesture; determining whether the authenticated hand is authorized to issue the command; and issuing an authorized command as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users, where the authorized command is specifically issued to a security aware device like an ATM.

Claim 11

Original Legal Text

11. The method of claim 1 , wherein processing one or more of the images to extract biometric features of the hand further includes: using at least one image characteristic of the images, determining an image property that specifies changes to the image characteristic across various image points; determining variations to the image property across the various image points; and based on the determined variations, identifying points of interest in the images that represent the biometric features.

Plain English Translation

The method of authorizing commands issued by gestures involves extracting biometric features from hand images by determining changes to image characteristics (like pixel intensity) across various image points. Variations in these properties are then analyzed to identify "points of interest" within the images, which represent the biometric features. This process involves analyzing changes in image characteristics to locate specific biometric markers.

Claim 12

Original Legal Text

12. The method of claim 11 , further including: using a Hessian Matrix for determining changes to the image property across the various image points.

Plain English Translation

The method of extracting biometric features from hand images by determining changes to image characteristics across various image points, determining variations to the image property across the various image points, and based on the determined variations, identifying points of interest in the images that represent the biometric features, uses a Hessian Matrix for determining changes to the image property across the various image points.

Claim 13

Original Legal Text

13. The method of claim 11 , further including: using eigenvalues and eigenvectors for identifying the points of interest.

Plain English Translation

The method of extracting biometric features from hand images by determining changes to image characteristics across various image points, determining variations to the image property across the various image points, and based on the determined variations, identifying points of interest in the images that represent the biometric features, uses eigenvalues and eigenvectors for identifying the points of interest.

Claim 14

Original Legal Text

14. The method of claim 11 , wherein the image characteristic is pixel intensity.

Plain English Translation

The method of extracting biometric features from hand images by determining changes to image characteristics across various image points, determining variations to the image property across the various image points, and based on the determined variations, identifying points of interest in the images that represent the biometric features, where the image characteristic is pixel intensity.

Claim 15

Original Legal Text

15. The method of claim 11 , wherein the image property is gradient of pixel intensity.

Plain English Translation

The method of extracting biometric features from hand images by determining changes to image characteristics across various image points, determining variations to the image property across the various image points, and based on the determined variations, identifying points of interest in the images that represent the biometric features, where the image property being analyzed is the gradient of pixel intensity.

Claim 16

Original Legal Text

16. The method of claim 11 , further including: determining normalized biometric features by at least one of rotating, translating, and scaling the biometric features.

Plain English Translation

The method of extracting biometric features from hand images by determining changes to image characteristics across various image points, determining variations to the image property across the various image points, and based on the determined variations, identifying points of interest in the images that represent the biometric features, includes determining normalized biometric features by at least one of rotating, translating, and scaling the biometric features.

Claim 17

Original Legal Text

17. The method of claim 11 , wherein determining whether the authenticated hand is authorized to issue the command further includes: comparing the extracted biometric features to a stored biometric profile.

Plain English Translation

The method of authorizing commands issued by gestures, including: detecting a set of gestures performed by different users and identifying control gestures in the set of gestures that control responsiveness of one of more virtual objects, including: capturing a plurality of images of a hand in a three-dimensional (3D) sensory space; processing one or more of the images to extract biometric features of the hand; authenticating the hand based on the extracted biometric features; determining a dominant user from among the users based at least on one or more biometric features extracted of the users; processing the sequence of the images as a hand gesture; determining a command indicated by the hand gesture; determining whether the authenticated hand is authorized to issue the command; and issuing an authorized command as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users, where determining whether the authenticated hand is authorized to issue the command includes comparing the extracted biometric features to a stored biometric profile.

Claim 18

Original Legal Text

18. The method of claim 17 , further including: constructing a biometric profile based on the extracted biometric features, including: prompting a user to perform hand gestures in the 3D sensory space and capturing a plurality of images of the hand during the hand gestures; processing one or more of the images to extract biometric features of the hand; determining normalized biometric features by at least one of rotating, translating, and scaling the biometric features; registering multiple images of different poses of the hand during the hand gestures; and storing the normalized biometric features and corresponding poses for recognizing gestures.

Plain English Translation

The method of authorizing commands issued by gestures where determining whether the authenticated hand is authorized to issue the command includes comparing the extracted biometric features to a stored biometric profile, further includes constructing a biometric profile based on the extracted biometric features by prompting a user to perform hand gestures in 3D space, capturing images of the hand, processing these images to extract biometric features, normalizing the features by rotating, translating, and scaling them, registering multiple images of different hand poses, and storing the normalized features and corresponding poses for gesture recognition.

Claim 19

Original Legal Text

19. The method of claim 1 , determining whether the authenticated hand is authorized to issue the command further includes: determining whether a user who performs the hand gesture has a role authorized to issue the command.

Plain English Translation

The method of authorizing commands issued by gestures, including: detecting a set of gestures performed by different users and identifying control gestures in the set of gestures that control responsiveness of one of more virtual objects, including: capturing a plurality of images of a hand in a three-dimensional (3D) sensory space; processing one or more of the images to extract biometric features of the hand; authenticating the hand based on the extracted biometric features; determining a dominant user from among the users based at least on one or more biometric features extracted of the users; processing the sequence of the images as a hand gesture; determining a command indicated by the hand gesture; determining whether the authenticated hand is authorized to issue the command; and issuing an authorized command as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users, where determining whether the authenticated hand is authorized to issue the command further includes determining whether a user who performs the hand gesture has a role authorized to issue the command.

Claim 20

Original Legal Text

20. The method of claim 1 , wherein a biometric profile is constructed at a first device and an authorized command is issued to a second device.

Plain English Translation

The method of authorizing commands issued by gestures, including: detecting a set of gestures performed by different users and identifying control gestures in the set of gestures that control responsiveness of one of more virtual objects, including: capturing a plurality of images of a hand in a three-dimensional (3D) sensory space; processing one or more of the images to extract biometric features of the hand; authenticating the hand based on the extracted biometric features; determining a dominant user from among the users based at least on one or more biometric features extracted of the users; processing the sequence of the images as a hand gesture; determining a command indicated by the hand gesture; determining whether the authenticated hand is authorized to issue the command; and issuing an authorized command as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users, where a biometric profile is constructed at a first device and an authorized command is issued to a second device.

Claim 21

Original Legal Text

21. The method of claim 1 , further including: detecting another hand gesture in the 3D sensory space; verifying hand continuity by comparing biometric features of a hand captured during the another hand gesture with biometric features of the hand captured previously; and repudiating authentication of the hand responsive to a lack of verification of the hand continuity.

Plain English Translation

The method of authorizing commands issued by gestures, including: detecting a set of gestures performed by different users and identifying control gestures in the set of gestures that control responsiveness of one of more virtual objects, including: capturing a plurality of images of a hand in a three-dimensional (3D) sensory space; processing one or more of the images to extract biometric features of the hand; authenticating the hand based on the extracted biometric features; determining a dominant user from among the users based at least on one or more biometric features extracted of the users; processing the sequence of the images as a hand gesture; determining a command indicated by the hand gesture; determining whether the authenticated hand is authorized to issue the command; and issuing an authorized command as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users, includes detecting another hand gesture, verifying hand continuity by comparing biometric features of a hand captured during the another hand gesture with biometric features of the hand captured previously and repudiating authentication of the hand responsive to a lack of verification of the hand continuity.

Claim 22

Original Legal Text

22. The method of claim 1 , wherein the hand gesture is at least one of: an upward swiping gesture; a downward swiping gesture; a rotating gesture; and a grasping gesture.

Plain English Translation

The method of authorizing commands issued by gestures, including: detecting a set of gestures performed by different users and identifying control gestures in the set of gestures that control responsiveness of one of more virtual objects, including: capturing a plurality of images of a hand in a three-dimensional (3D) sensory space; processing one or more of the images to extract biometric features of the hand; authenticating the hand based on the extracted biometric features; determining a dominant user from among the users based at least on one or more biometric features extracted of the users; processing the sequence of the images as a hand gesture; determining a command indicated by the hand gesture; determining whether the authenticated hand is authorized to issue the command; and issuing an authorized command as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users, where the hand gesture is at least one of: an upward swiping gesture; a downward swiping gesture; a rotating gesture; and a grasping gesture.

Claim 23

Original Legal Text

23. The method of claim 1 , further including: distinguishing control gestures from proximate non-control gestures in a virtually augmented real environment, by: detecting the set of gestures performed by different users in a virtually augmented real environment; and identifying control gestures in the set of gestures that control responsiveness of the one of more virtual objects superimposed over a real environment.

Plain English Translation

The method of authorizing commands issued by gestures, including: detecting a set of gestures performed by different users and identifying control gestures in the set of gestures that control responsiveness of one of more virtual objects, including: capturing a plurality of images of a hand in a three-dimensional (3D) sensory space; processing one or more of the images to extract biometric features of the hand; authenticating the hand based on the extracted biometric features; determining a dominant user from among the users based at least on one or more biometric features extracted of the users; processing the sequence of the images as a hand gesture; determining a command indicated by the hand gesture; determining whether the authenticated hand is authorized to issue the command; and issuing an authorized command as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users, further including distinguishing control gestures from proximate non-control gestures in a virtually augmented real environment, by: detecting the set of gestures performed by different users in a virtually augmented real environment; and identifying control gestures in the set of gestures that control responsiveness of the one of more virtual objects superimposed over a real environment.

Claim 24

Original Legal Text

24. An automated teller machine (ATM) system, including: a motion-capture program executing on a processor of an automated teller machine (ATM) for detecting a set of gestures performed by different users and identifying control gestures in the set of gestures that control responsiveness of one of more virtual objects, including capturing a plurality of images of a hand in a three-dimensional (3D) sensory space; a biometric processing module for processing one or more of the images to extract biometric features of the hand; and a command authorization module for authenticating the hand based on the extracted biometric features to determine a dominant user from among the users based at least on one or more biometric features extracted of the users, including: processing a sequence of the images as a hand gesture; determining a command indicated by the hand gesture; determining whether the authenticated hand is authorized to issue the command; and issuing an authorized command to the ATM as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users.

Plain English Translation

An ATM system is designed to authorize commands using hand gestures. It includes a motion-capture program that captures images of hands in 3D space. A biometric module processes these images to extract biometric features and a command authorization module authenticates the hand based on these features. The system identifies a "dominant" user based on biometric data, interprets hand gestures to determine commands, and only executes commands from authorized hands, controlling virtual objects on the ATM interface. Non-dominant users' gestures are ignored.

Claim 25

Original Legal Text

25. The automated teller machine system of claim 24 , wherein the authorized command controls a session manager of the ATM using a virtual object that effects transactions.

Plain English Translation

The automated teller machine (ATM) system including: a motion-capture program executing on a processor of an automated teller machine (ATM) for detecting a set of gestures performed by different users and identifying control gestures in the set of gestures that control responsiveness of one or more virtual objects, including capturing a plurality of images of a hand in a three-dimensional (3D) sensory space; a biometric processing module for processing one or more of the images to extract biometric features of the hand; and a command authorization module for authenticating the hand based on the extracted biometric features to determine a dominant user from among the users based at least on one or more biometric features extracted of the users, including: processing a sequence of the images as a hand gesture; determining a command indicated by the hand gesture; determining whether the authenticated hand is authorized to issue the command; and issuing an authorized command to the ATM as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users, where the authorized command controls a session manager of the ATM using a virtual object that effects transactions.

Claim 26

Original Legal Text

26. A system implementing the method of claim 1 , the system including: a processor and a computer readable storage medium storing computer instructions configured to cause the processor to detect a set of gestures performed by different users and identifying control gestures in the set of gestures that control responsiveness of one of more virtual objects, including: capture a plurality of images of a hand in a three-dimensional (3D) sensory space; process one or more of the images to extract biometric features of the hand; authenticate the hand based on the extracted biometric features; determine a dominant user from among the users based at least on one or more biometric features extracted of the users; process a sequence of the images as a hand gesture; determine a command indicated by the hand gesture; determine whether the authenticated hand is authorized to issue the command; and issue an authorized command as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users.

Plain English Translation

A system for authorizing commands using hand gestures includes a processor and storage medium with instructions. The instructions, when executed, capture images of hands in 3D space, extract biometric features, and authenticate the hand. The system identifies a dominant user based on biometrics, processes hand gestures to determine commands, and only executes commands from authorized hands, triggering responses from virtual objects. Gestures from non-dominant users are ignored. This allows control of virtual objects via biometric-authenticated gestures.

Claim 27

Original Legal Text

27. One or more non-transitory computer readable media having instructions stored thereon to detect a set of gestures performed by different users and identifying control gestures in the set of gestures that control responsiveness of one of more virtual objects, which when executed by one or more processors performs the method of claim 1 , the method including: capture a plurality of images of a hand in a three-dimensional (3D) sensory space; process one or more of the images to extract biometric features of the hand; authenticate the hand based on the extracted biometric features; determine a dominant user from among the users based at least on one or more biometric features extracted of the users; process a sequence of the images as a hand gesture; determine a command indicated by the hand gesture; determine whether the authenticated hand is authorized to issue the command; and issue an authorized command as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users.

Plain English Translation

One or more non-transitory computer-readable media containing instructions that, when executed, authorize commands using hand gestures. The process involves capturing images of hands in 3D space, extracting biometric features, and authenticating the hand. The system determines a "dominant" user, interprets hand gestures to identify commands, and only executes commands from authorized users, triggering responses from virtual objects while ignoring gestures from non-dominant users.

Claim 28

Original Legal Text

28. A system implementing distinguishing control gestures made by an authorized user from motions or gestures made by non-dominant hands, the system including: a processor and a computer readable storage medium storing computer instructions configured to cause the processor to: detect a set of gestures performed by different users in a virtually augmented real environment and identify control gestures in the set of gestures that control responsiveness of one of more virtual objects superimposed over a real environment by: capturing a plurality of images of at least one hand of a plurality of hands moving in a three-dimensional (3D) sensory space; processing one or more of the images to extract biometric features of the hand; authenticating the hand based on the extracted biometric features; determining a dominant user from among the users based at least on one or more biometric features of the users; processing the sequence of the images as a hand gesture; determining a command indicated by the hand gesture; determining whether the authenticated hand is authorized to issue the command; and issuing an authorized command as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users.

Plain English Translation

A system distinguishes control gestures made by an authorized user from motions or gestures made by non-dominant hands. It comprises a processor and a storage medium storing instructions to: detect gestures in an augmented reality environment, identify control gestures that manipulate virtual objects, capture images of hands in 3D space, extract biometric features, authenticate the hand, determine a dominant user based on biometric data, process hand gestures to identify commands, and issue authorized commands, triggering responses from virtual objects for the dominant user while ignoring gestures from non-dominant users.

Claim 29

Original Legal Text

29. One or more non-transitory computer readable media having instructions stored thereon to distinguishing control gestures made by an authorized user from motions or gestures made by non-dominant hands, which instructions when executed by one or more processors, implement, a method including: detecting a set of gestures performed by different users in a virtually augmented real environment and identifying control gestures in the set of gestures that control responsiveness of one of more virtual objects superimposed over the real environment by: capturing a plurality of images of at least one hand of a plurality of hands moving in a three-dimensional (3D) sensory space; processing one or more of the images to extract biometric features of the hand; and authenticating the hand based on the extracted biometric features; determining a dominant user from among the users based at least on one or more biometric features of the users; processing the sequence of the images as a hand gesture; determining a command indicated by the hand gesture; determining whether the authenticated hand is authorized to issue the command; and issuing an authorized command as indicated by the hand gesture triggering a response of the virtual objects to gestures performed by the dominant user without triggering a response to gestures performed by non-dominant users.

Plain English Translation

One or more non-transitory computer-readable media contain instructions for distinguishing control gestures made by an authorized user from those of non-dominant hands in an augmented reality environment. The instructions, when executed, implement a method of detecting gestures, identifying control gestures for virtual objects, capturing hand images in 3D space, extracting and authenticating biometric features, determining a dominant user, processing hand gestures, and issuing commands. The system triggers virtual object responses only for authorized users, ignoring gestures from non-dominant hands.

Classification Codes (CPC)

Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.

Patent Metadata

Filing Date

March 13, 2015

Publication Date

June 13, 2017

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, FAQs, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “Biometric aware object detection and tracking” (US-9679197). https://patentable.app/patents/US-9679197

© 2026 Nomic Interactive Technology LLC. Machine-readable context available at /api/llm-context/US-9679197. See llms.txt for full attribution policy.