Legal claims defining the scope of protection, as filed with the USPTO.
1. A computer-implemented method used in a computer program to enable gesture-based interactions between the computer program and a user, the method comprising: initiating the computer program; detecting that a condition has occurred by: determining an identity of a user based on facial changes associated with speech of the user; and determining that the user is a disabled user; automatically activating, based on the detection that the condition occurred, a gesture-based operation mode of the computer program; receiving first gesture data generated by a sensor, the first gesture data representing a first one of a plurality of gestures; determining that the first gesture does not correspond to a command; and performing a task based on the first gesture data, wherein performing the task comprises: determining a plurality of suggested commands using a machine-learning algorithm to analyze historical patterns of user behavior, the commands being determined based on first behavior data regarding a behavior related to the user; presenting, through a user interface, information regarding the commands; receiving an input from the user for selecting one of the commands; and executing the selected command.
2. The method of claim 1 , wherein detecting that the condition has occurred further comprises: receiving a signal indicating that an emergency has occurred.
3. The method of claim 1 , wherein detecting that the condition has occurred further comprises: receiving a second input from the user for activating the gesture-based operation mode.
4. The method of claim 1 , further comprising: receiving, from a server, second behavior data regarding behaviors of multiple users that use the computer program; and determining the commands based on the second behavior data.
5. The method of claim 1 , further comprising: presenting a prompt for the user to perform a second gesture, the prompt comprising the selected command; receiving second gesture data generated by the sensor, the second gesture data representing a second one of the gestures; determining the second gesture based on the second gesture data; and setting a corresponding relationship between the second gesture and the selected command.
6. The method of claim 1 , wherein performing the task further comprises: determining a plurality of gesture candidates based on a collective usage trend for a plurality of second gestures of multiple users, the collective usage trend being determined by evaluating how often the second gestures are used by the multiple users; presenting, through a user interface, information regarding the gesture candidates; and receiving a second input from the user for selecting a gesture candidate.
7. The method of claim 1 , wherein: receiving the gesture data comprises: presenting, through a user interface, a prompt for the user to perform the first gesture, and within a predetermined amount of time after the prompt is presented, receiving the first gesture data; and performing the task comprises: determining whether the first gesture data represents the first gesture; and when it is determined that the gesture data represents the first gesture, setting a corresponding relationship between the first gesture and a predetermined command.
8. The method of claim 1 , wherein performing the task comprises: determining a quality score based on the first gesture data; and generating, based on the quality score, suggestions for the user to improve performance of the first gesture.
9. The method of claim 1 , wherein determining an identity of the user is based on at least one of unique hand or finger positioning patterns related to a gesture of the user.
10. A non-transitory computer readable medium having stored instructions, which when executed, cause at least one processor to perform a method for enabling gesture-based interactions between a computer program and a user, the method comprising: initiating the computer program; detecting that a condition has occurred by: determining an identity of a user based on facial changes associated with speech of the user; and indicating that the user is a disabled user; automatically activating, based on the detection that the condition occurred, a gesture-based operation mode of the computer program; receiving first gesture data generated by a sensor, the first gesture data representing a first one of a plurality of gestures; determining that the first gesture does not correspond to a command; and performing a task based on the gesture data, wherein performing the task comprises: determining a plurality of suggested commands using a machine-learning algorithm to analyze historical patterns of user behavior, the commands being determined based on first behavior data regarding a behavior related to the user; presenting, through a user interface, information regarding the commands; receiving an input from the user for selecting one of the commands; and executing the selected command.
11. The medium of claim 10 , wherein detecting that the condition has occurred further comprises: receiving a signal indicating that an emergency has occurred.
12. The medium of claim 10 , wherein performing the task further comprises: receiving, from a server, second behavior data regarding behaviors of multiple users that use the computer program; and determining the commands based on the second behavior data.
13. The medium of claim 10 , wherein performing the task further comprises: presenting a prompt for the user to perform a second gesture, the prompt comprising the selected command; receiving new gesture data generated by the sensor, the new gesture data representing the second gesture performed by the user; determining the second gesture based on the new gesture data; and setting a corresponding relationship between the second gesture and the suggested command that is selected.
14. The medium of claim 10 , further comprising determining an identity of the user based on at least one of unique hand or finger positioning patterns related to a gesture of the user.
15. The medium of claim 10 , wherein performing the task further comprises: determining a plurality of gesture candidates based on a collective usage trend for a plurality of second gestures of multiple users, the collective usage trend being determined by evaluating how often the second gestures are used by the multiple users; presenting, through a user interface, information regarding the gesture candidates; and receiving a second input from the user for selecting a gesture candidate.
16. The medium of claim 10 , wherein presenting information regarding the suggested commands comprises providing an audio message.
17. A terminal, comprising: a memory storing instructions, the instructions being part of a computer program; and a processor configured to executed the instructions to perform operations comprising: initiating the computer program; detecting that a condition has occurred by: determining an identity of a user based on facial changes associated with speech of the user; and determining that the user is a disabled user; automatically activating, based on the detection that the condition occurred, a gesture-based operation mode of the computer program; receiving first gesture data generated by a sensor, the first gesture data representing a first one of a plurality of gestures; determining that the first gesture does not correspond to a command; and performing a task based on the first gesture data, wherein performing the task comprises: determining a plurality of suggested commands using a machine-learning algorithm to analyze historical patterns of user behavior, the commands being determined based on behavior data regarding a behavior related to the user; presenting, through a user interface, information regarding the suggested commands; receiving an input from the user for selecting one of the commands; and executing the selected command.
18. The terminal of claim 17 , wherein determining an identity of the user is based on at least one of unique hand or finger positioning patterns related to a gesture of the user.
19. The terminal of claim 17 , wherein performing the task further comprises: determining a plurality of gesture candidates based on a collective usage trend for a plurality of second gestures of multiple users, the collective usage trend being determined by evaluating how often the second gestures are used by the multiple users; presenting, through a user interface, information regarding the gesture candidates; and receiving a second input from the user for selecting a gesture candidate.
20. The terminal of claim 17 , the operations further comprising providing an audio cue prompting the user to perform a gesture.
Unknown
March 15, 2022
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.