Systems and methods herein describe a multi-modal interaction system. The multi-modal interaction system, receives a selection of an augmented reality (AR) experience within an application on a computer device, displays a set of AR objects associated with the AR experience on a graphical user interface (GUI) of the computer device, display textual cues associated with the set of augmented reality objects on the GUI, receives a hand gesture and a voice command, modifies a subset of augmented reality objects of the set of augmented reality objects based on the hand gesture and the voice command, and displays the modified subset of augmented reality objects on the GUI.
Legal claims defining the scope of protection, as filed with the USPTO.
3. The method of claim 2, wherein the selection is a user input received at the computer device.
4. The method of claim 3, wherein the augmented reality experience is displayed as a selectable user interface element within the application.
5. The method of claim 1, wherein the textual cues are hints associated with the hand gesture and the voice command.
6. The method of claim 1, wherein the textual cues are temporarily displayed on the GUI for a predetermined duration of time.
13. The computing system of claim 12, wherein the selection is a user input received at the computer device, and wherein the augmented reality experience is displayed as a selectable user interface element within the application.
14. The computing system of claim 11, wherein the textual cues are hints associated with the hand gesture and the voice command.
15. The computing system of claim 11, wherein the textual cues are temporarily displayed on the GUI for a predetermined duration of time.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
May 10, 2022
April 16, 2024
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.