The present disclosure provides an interface intelligent interaction control method, apparatus and system, and a storage medium, wherein the method comprises: receiving user-input speech information, and obtaining a speech recognition result; determining scenario elements associated with the speech recognition result; generating an entry corresponding to each scenario element and sending the speech recognition result and the entry to a cloud server; receiving an entry which is best matched with the speech recognition result, returned by the cloud server and selected from the received entries; performing an interface operation corresponding to the best-matched entry. The solution of the present disclosure can be applied to improve flexibility and accuracy of the speech control.
Legal claims defining the scope of protection, as filed with the USPTO.
1. An interface intelligent interaction control method, wherein the method comprises: receiving, by a smart device, user-input speech information, and obtaining, by the smart device, a speech recognition result; determining, by the smart device, scenario elements associated with the speech recognition result, wherein the scenario elements comprise an interface element presented on a screen of the smart device; generating, by the smart device, entries, each entry corresponding to each scenario element and sending the speech recognition result and the entries to a cloud server; receiving, by the smart device, an entry, which is best matched with the speech recognition result, returned by the cloud server and selected by the cloud server from the received entries received from the smart device; and performing, by the smart device an interface operation corresponding to the best-matched entry.
2. The method according to claim 1 , wherein the obtaining, by the smart device, the speech recognition result comprises: sending, by the smart device, the speech information to the cloud server; and receiving, by the smart device, the speech recognition result returned by the cloud server after performing speech recognition for the speech information.
3. The method according to claim 1 , wherein each entry of the entries generated by the smart device includes: an element label and a corresponding self-defined operation behavior information; and the performing an interface operation corresponding to the best-matched entry comprises: performing an interface operation according to the self-defined operation behavior information in the best-matched entry.
4. An interface intelligent interaction control method, wherein the method comprises: receiving, by a cloud server, a speech recognition result and entries from a smart device, wherein the speech recognition result is a speech recognition result of user-input speech information received by the smart device, and each of the entries is a corresponding entry generated for each scenario element after the smart device determines scenario elements associated with the speech recognition result, wherein the scenario elements comprise an interface element presented on a screen of the smart device; and selecting, by the cloud server, an entry best matched with the speech recognition result from the received entries, and returning, by the cloud server, the best-matched entry to the smart device so that the smart device performs an interface operation corresponding to the best-matched entry.
5. The method according to claim 4 , wherein before receiving, by the cloud server, the speech recognition result and the entries from the smart device, the method further comprises: receiving, by the cloud server, the speech information sent from the smart device; and performing, by the cloud server, speech recognition for the speech information to obtain the speech recognition result, and returning the speech recognition result to the smart device.
6. The method according to claim 4 , wherein each of the entries received from the smart device includes: an element label and a corresponding self-defined operation behavior information; the selecting, by the cloud server, the entry best matched with the speech recognition result from the received entries comprises: selecting, by the cloud server, the entry best matched with the speech recognition result from the received entries, according to the element label.
7. The method according to claim 6 , wherein the selecting, by the cloud server, the entry best matched with the speech recognition result from the received entries, according to the element label comprises: for each entry of the entries received from the smart device, respectively calculating an edit distance between the element label of the entry and the speech recognition result; and regarding an entry corresponding to the edit distance with a minimum value as the best-matched entry, wherein the edit distance comprises minimum times of editing operations for converting from one character string to the other character string between two character strings.
8. The method according to claim 6 , wherein each entry of the entries received from the smart device further comprises one or all of the following: an x value and a y value indicative of a row position and a column position where the scenario element lies, and an index value indicative of an arrangement serial number of the scenario element; and the selecting, by the cloud server, the entry best matched with the speech recognition result from the received entries comprises: according to the x value and y value or according to the index value, selecting the entry best matched with the speech recognition result from the received entries.
9. A smart device, comprising a memory, a processor and a computer program which is stored on the memory and runnable on the processor, wherein the processor, upon executing the program, implements an interface intelligent interaction control method, wherein the method comprises: receiving, by the smart device, user-input speech information, and obtaining, by the smart device, a speech recognition result; determining, by the smart device, scenario elements associated with the speech recognition result, wherein the scenario elements comprise an interface element presented on a screen of the smart device; generating, by the smart device, entries, each entry corresponding to each scenario element and sending the speech recognition result and the entries to a cloud server; receiving, by the smart device, an entry, which is best matched with the speech recognition result, returned by the cloud server and selected by the cloud server from the entries received from the smart device; and performing, by the smart device, an interface operation corresponding to the best-matched entry.
10. The smart device according to claim 9 , wherein the obtaining, by the smart device, the speech recognition result comprises: sending, by the smart device, the speech information to the cloud server; and receiving, by the smart device, the speech recognition result returned by the cloud server after performing speech recognition for the speech information.
11. The smart device according to claim 9 , wherein each of the entries generated by the smart device includes: an element label and a corresponding self-defined operation behavior information; and the performing an interface operation corresponding to the best-matched entry comprises: performing an interface operation according to the self-defined operation behavior information in the best-matched entry.
12. A non-transitory computer-readable storage medium on which a computer program is stored, wherein the computer program, when executed by a processor of a smart device, implements an interface intelligent interaction control method, wherein the method comprises: receiving, by the smart device, user-input speech information, and obtaining, by the smart device, a speech recognition result; determining, by the smart device, scenario elements associated with the speech recognition result, wherein the scenario elements comprise an interface element presented on a screen of the smart device; generating, by the smart device, entries, each entry corresponding to each scenario element and sending the speech recognition result and the entries to a cloud server; receiving, by the smart device, an entry, which is best matched with the speech recognition result, returned by the cloud server and selected by the cloud server from the entries received from the smart device; and performing, by the smart device, an interface operation corresponding to the best-matched entry.
13. The non-transitory computer-readable storage medium according to claim 12 , wherein the obtaining, by the smart device, the speech recognition result comprises: sending, by the smart device, the speech information to the cloud server; and receiving, by the smart device, the speech recognition result returned by the cloud server after performing speech recognition for the speech information.
14. The non-transitory computer-readable storage medium according to claim 12 , wherein each of the entries generated by the smart device includes: an element label and a corresponding self-defined operation behavior information; and the performing an interface operation corresponding to the best-matched entry comprises: performing an interface operation according to the self-defined operation behavior information in the best-matched entry.
15. A computer device, comprising a memory, a processor and a computer program which is stored on the memory and runnable on the processor, wherein the processor, upon executing the program, implements an interface intelligent interaction control method, wherein the method comprises: receiving, by the computer device, a speech recognition result and entries from a smart device, wherein the speech recognition result is a speech recognition result of user-input speech information received by the smart device, and each of the entries is a corresponding entry generated for each scenario element after the smart device determines scenario elements associated with the speech recognition result, wherein the scenario elements comprise an interface element presented on a screen of the smart device; and selecting, by the computer device, an entry best matched with the speech recognition result from the received entries, and returning, by the computer device, the best-matched entry to the smart device so that the smart device performs an interface operation corresponding to the best-matched entry.
16. The computer device according to claim 15 , wherein before receiving, by the computer device, the speech recognition result and the entries from the smart device, the method further comprises: receiving, by the computer device, the speech information sent from the smart device; and performing, by the computer device, speech recognition for the speech information to obtain the speech recognition result, and returning the speech recognition result to the smart device.
17. The computer device according to claim 15 , wherein each of the entries received from the smart device includes: a label and a corresponding self-defined operation behavior information; the selecting, by the computer device, the entry best matched with the speech recognition result from the received entries comprises: selecting, by the computer device, the entry best matched with the speech recognition result from the received entries, according to the element label.
18. The computer device according to claim 17 , wherein the selecting, by the computer device, the entry best matched with the speech recognition result from the received entries, according to the element label comprises: for each entry of the entries received from the smart device, respectively calculating an edit distance between the element label of the entry and the speech recognition result; and regarding an entry corresponding to the edit distance with a minimum value as the best-matched entry, wherein the edit distance comprises minimum times of editing operations for converting from one character string to the other character string between two character strings.
19. The computer device according to claim 17 , wherein each of the entires received from the smart device further comprises one or all of the following: an x value and a y value indicative of a row position and a column position where the scenario element lies, and an index value indicative of an arrangement serial number of the scenario element; and the selecting, by the computer device, the entry best matched with the speech recognition result from the received entries comprises: according to the x value and y value or according to the index value, selecting the entry best matched with the speech recognition result from the received entries.
20. A non-transitory computer-readable storage medium on which a computer program is stored, wherein the computer program, when executed by a processor of a computer device, implements an interface intelligent interaction control method, wherein the method comprises: receiving, by the computer device, a speech recognition result and entries from a smart device, wherein the speech recognition result is a speech recognition result of user-input speech information received by the smart device, and each of the entries is a corresponding entry generated for each scenario element after the smart device determines scenario elements associated with the speech recognition result, wherein the scenario elements comprise an interface element presented on a screen of the smart device; and selecting, by the computer device, an entry best matched with the speech recognition result from the received entries, and returning, by the computer device, the best-matched entry to the smart device so that the smart device performs an interface operation corresponding to the best-matched entry.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
August 28, 2018
October 13, 2020
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.