9837076

Customizing Actions Based on Contextual Data and Voice-Based Inputs

PublishedDecember 5, 2017
Assigneenot available in USPTO data we have
Technical Abstract

Patent Claims
20 claims

Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.

Claim 1

Original Legal Text

1. A computer-implemented method comprising: building an event model by identifying, from user data of one or more applications associated with a user, events related to the user; receiving a voice input from the user that includes a command to perform a specific action, the action having a plurality of parameters, and each parameter specifying information necessary to perform the action; determining whether the voice input includes sufficient information to perform the action; in response to determining that the voice input does not include sufficient information to perform the action, identifying one or more missing parameters from the voice input that are required to perform the action; identifying, using the event model, one or more current or future events related to the user that are relevant to the action, wherein each current or future event either is (i) currently occurring relative to a time when the voice input was received or (ii) will occur in the future relative to the time when the voice input was received; customizing the action based on the one or more current or future events, comprising assigning values to one or more of the identified missing parameters of the action based on data associated with the one or more current or future events; and performing the customized action in response to the voice input.

Plain English Translation

The system receives voice commands from a user to perform an action, where the action requires parameters (specific details) to complete. If the voice input is missing required parameters, the system uses an "event model" built from user data across applications to find relevant current or future events related to the user. It then fills in the missing parameters of the action with data from these events, customizing the action. Finally, it executes the customized action based on the voice input. The event model identifies events related to the user from one or more applications associated with the user.

Claim 2

Original Legal Text

2. The method of claim 1 , the event model further comprising: a structured collection of data and relationships associated with the events, wherein the data is indicative of people, places, and times associated with the events.

Plain English Translation

The system in the previous voice command description includes an "event model" that is a structured collection of data and relationships related to current or future events. This data indicates people, places, and times associated with the current or future events. The system uses this model to fill in missing parameters in voice commands by linking current or future events to those missing parameters. The event model helps to customize an action that may not have enough information in the voice input.

Claim 3

Original Legal Text

3. The method of claim 1 , further comprising: identifying an action to be performed in response to the voice input by: determining a context for the voice input that represents a subject of the voice input; and determining that the action is associated with the context for the voice input.

Plain English Translation

In the previous voice command description, the system identifies an action to perform by first determining the "context" of the voice input, representing the topic or subject of the voice input. Then, the system determines that the chosen action is associated with this derived context. This helps the system decide what the user intends to do with their voice input. The context helps in identifying the correct action, which has parameters that need to be filled in to be executed.

Claim 4

Original Legal Text

4. The method of claim 3 , further comprising: processing the voice input and the context to determine that there is insufficient information to assign a value to one or more missing parameters of the plurality of parameters based only on the voice input and the context; and assigning values to the one or more missing parameters based on data associated with the one or more current or future events.

Plain English Translation

In the previous voice command and context description, if the system determines that the voice input and its context *alone* provide insufficient information to fill in the missing parameters for the action, then the system assigns values to those missing parameters using data from relevant current or future events, as identified by the event model. This means even with an identified action, parameters will be filled in using data from current or future events if it is not present in the voice input itself.

Claim 5

Original Legal Text

5. The method of claim 1 , wherein: identifying, using the event model, one or more current or future events related to the user that are relevant to the action comprises: identifying user data from the event model that is potentially relevant to the action; determining a level of confidence for an association of one or more potentially relevant current or future events from the identified user data and the context of the voice input; and identifying one or more current or future events related to the user that are relevant to the action from the potentially relevant events based on the determined level of confidence.

Plain English Translation

In the previous voice command description, identifying relevant current or future events using the event model involves several steps. First, the system identifies user data from the event model that is potentially relevant to the desired action. Second, it determines a "level of confidence" for the association of these potentially relevant current or future events with the context of the voice input. Finally, based on this confidence level, the system identifies the current or future events that are most relevant to the action.

Claim 6

Original Legal Text

6. The method of claim 5 , further comprising, when the level of confidence is sufficiently low, presenting a refining prompt to allow the user to select one or more possible values for the one or more missing parameters, the one or more possible values being determined based on data associated with the one or more current or future events.

Plain English Translation

Building upon the previous voice command description, if the system determines the "level of confidence" in its suggested values for the missing parameters is sufficiently *low*, it presents a "refining prompt" to the user. This prompt allows the user to select the correct value for the missing parameter from a list of possible values derived from data associated with the identified current or future events. This lets the user clarify their intent when the system is unsure.

Claim 7

Original Legal Text

7. The method of claim 6 , further comprising, when the level of confidence is sufficiently high, assigning values to the one or more missing parameters based on data associated with the one or more current or future events without presenting the refining prompt.

Plain English Translation

Building upon the previous voice command and prompt description, if the system determines that the "level of confidence" in its suggested values for missing parameters is sufficiently *high*, it automatically assigns those values to the parameters using data associated with the identified current or future events, *without* showing a refining prompt to the user. This streamlines the interaction when the system is confident in its interpretation.

Claim 8

Original Legal Text

8. A system comprising one or more computers and one or more storage devices storing instructions that when executed by the one or more computers cause the one or more computers to perform operations comprising: building an event model by identifying, from user data of one or more applications associated with a user, events related to the user; receiving a voice input from the user that includes a command to perform a specific action, the action having a plurality of parameters, and each parameter specifying information necessary to perform the action; determining whether the voice input includes sufficient information to perform the action; in response to determining that the voice input does not include sufficient information to perform the action, identifying one or more missing parameters from the voice input required to perform the action; identifying, using the event model, one or more current or future events related to the user that are relevant to the action, wherein each current or future event either is (i) currently occurring relative to a time when the voice input was received or (ii) will occur in the future relative to the time when the voice input was received; customizing the action based on the one or more current or future events, comprising assigning values to one or more of the identified missing parameters of the action based on data associated with the one or more current or future events; and performing the customized action in response to the voice input.

Plain English Translation

A computer system receives voice commands from a user to perform an action, where the action requires parameters (specific details) to complete. If the voice input is missing required parameters, the system uses an "event model" built from user data across applications to find relevant current or future events related to the user. It then fills in the missing parameters of the action with data from these current or future events, customizing the action. Finally, it executes the customized action based on the voice input. The event model identifies events related to the user from one or more applications associated with the user.

Claim 9

Original Legal Text

9. The system of claim 8 , the event model further comprising: comprises structured collection of data and relationships associated with current or future events, wherein the data is indicative of people, places, and times associated with the events.

Plain English Translation

The system in the previous voice command description includes an "event model" that is a structured collection of data and relationships related to current or future events. This data indicates people, places, and times associated with the current or future events. The system uses this model to fill in missing parameters in voice commands by linking current or future events to those missing parameters. The event model helps to customize an action that may not have enough information in the voice input.

Claim 10

Original Legal Text

10. The system of claim 8 , the operations further comprising: identifying an action to be performed in response to the voice input by: determining a context for the voice input that represents a subject of the voice input; and determining that the action is associated with the context for the voice input.

Plain English Translation

In the previous voice command description, the system identifies an action to perform by first determining the "context" of the voice input, representing the topic or subject of the voice input. Then, the system determines that the chosen action is associated with this derived context. This helps the system decide what the user intends to do with their voice input. The context helps in identifying the correct action, which has parameters that need to be filled in to be executed.

Claim 11

Original Legal Text

11. The system of claim 10 , the operations further comprising: processing the voice input and the context to determine that there is insufficient information to assign a value to one or more missing parameters of the plurality of parameters based only on the voice input and the context; and assigning values to the one or more missing parameters based on data associated with the one or more current or future events.

Plain English Translation

In the previous voice command and context description, if the system determines that the voice input and its context *alone* provide insufficient information to fill in the missing parameters for the action, then the system assigns values to those missing parameters using data from relevant current or future events, as identified by the event model. This means even with an identified action, parameters will be filled in using data from current or future events if it is not present in the voice input itself.

Claim 12

Original Legal Text

12. The system of claim 8 , wherein: identifying, using the event model, one or more current or future events related to the user that are relevant to the action comprises: identifying user data from the event model that is potentially relevant to the action; determining a level of confidence for an association of the one or more potentially relevant current or future events from the identified user data and the context of the voice input; and identifying one or more current or future events related to the user that are relevant to the action from the potentially relevant events based on the determined level of confidence.

Plain English Translation

In the previous voice command description, identifying relevant current or future events using the event model involves several steps. First, the system identifies user data from the event model that is potentially relevant to the desired action. Second, it determines a "level of confidence" for the association of these potentially relevant current or future events with the context of the voice input. Finally, based on this confidence level, the system identifies the current or future events that are most relevant to the action.

Claim 13

Original Legal Text

13. The system of claim 12 , the operations further comprising, when the level of confidence is sufficiently low, presenting a refining prompt to allow the user to select one or more possible values for the one or more missing parameters, the one or more possible values being determined based on data associated with the one or more current or future events.

Plain English Translation

Building upon the previous voice command description, if the system determines the "level of confidence" in its suggested values for the missing parameters is sufficiently *low*, it presents a "refining prompt" to the user. This prompt allows the user to select the correct value for the missing parameter from a list of possible values derived from data associated with the identified current or future events. This lets the user clarify their intent when the system is unsure.

Claim 14

Original Legal Text

14. The system of claim 13 , the operations further comprising, when the level of confidence is sufficiently high, assigning values to the one or more missing parameters based on data associated with the one or more current or future events without presenting the refining prompt.

Plain English Translation

Building upon the previous voice command and prompt description, if the system determines that the "level of confidence" in its suggested values for missing parameters is sufficiently *high*, it automatically assigns those values to the parameters using data associated with the identified current or future events, *without* showing a refining prompt to the user. This streamlines the interaction when the system is confident in its interpretation.

Claim 15

Original Legal Text

15. One or more non-transitory computer storage media encoded with a computer program, the computer program comprising instructions that when executed by one or more computers cause the one or more computers to perform operations comprising: building an event model by identifying, from user data of one or more applications associated with a user, events related to the user; receiving a voice input from the user that includes a command to perform a specific action, the action having a plurality of parameters, and each parameter specifying information necessary to perform the action; determining whether the voice input includes sufficient information to perform the action; in response to determining that the voice input does not include sufficient information to perform the action, identifying one or more missing parameters from the voice input required to perform the action; identifying, using the event model, one or more current or future events related to the user that are relevant to the action, wherein each current or future event either is (i) currently occurring relative to a time when the voice input was received or (ii) will occur in the future relative to the time when the voice input was received; customizing the action based on the one or more current or future events, comprising assigning values to one or more of the identified missing parameters of the action based on data associated with the one or more current or future events; and performing the customized action in response to the voice input.

Plain English Translation

A computer program, stored on a non-transitory medium, when executed, enables a system to receive voice commands from a user to perform an action, where the action requires parameters (specific details) to complete. If the voice input is missing required parameters, the system uses an "event model" built from user data across applications to find relevant current or future events related to the user. It then fills in the missing parameters of the action with data from these current or future events, customizing the action. Finally, it executes the customized action based on the voice input. The event model identifies events related to the user from one or more applications associated with the user.

Claim 16

Original Legal Text

16. The non-transitory computer storage media of claim 15 , the operations further comprising: identifying an action to be performed in response to the voice input by: determining a context for the voice input that represents a subject of the voice input; and determining that the action is associated with the context for the voice input.

Plain English Translation

In the previous voice command and computer program description, the system identifies an action to perform by first determining the "context" of the voice input, representing the topic or subject of the voice input. Then, the system determines that the chosen action is associated with this derived context. This helps the system decide what the user intends to do with their voice input. The context helps in identifying the correct action, which has parameters that need to be filled in to be executed.

Claim 17

Original Legal Text

17. The non-transitory computer storage media of claim 15 , the operations further comprising: processing the voice input and the context to determine that there is insufficient information to assign a value to one or more missing parameters of the plurality of parameters based only on the voice input and the context; and assigning values to the one or more missing parameters based on data associated with the one or more current or near-term events.

Plain English Translation

In the previous voice command and computer program description, if the system determines that the voice input and its context *alone* provide insufficient information to fill in the missing parameters for the action, then the system assigns values to those missing parameters using data from relevant current or future events, as identified by the event model. This means even with an identified action, parameters will be filled in using data from current or future events if it is not present in the voice input itself.

Claim 18

Original Legal Text

18. The non-transitory computer storage media of claim 15 , wherein: identifying, using the event model, one or more current or future events related to the user that are relevant to the action comprises: identifying user data from the event model that is potentially relevant to the action; determining a level of confidence for an association of the one or more potentially relevant current or future events from the identified user data and the context of the voice input; and identifying one or more current or future events related to the user that are relevant to the action from the potentially relevant events based on the determined level of confidence.

Plain English Translation

In the previous voice command and computer program description, identifying relevant current or future events using the event model involves several steps. First, the system identifies user data from the event model that is potentially relevant to the desired action. Second, it determines a "level of confidence" for the association of these potentially relevant current or future events with the context of the voice input. Finally, based on this confidence level, the system identifies the current or future events that are most relevant to the action.

Claim 19

Original Legal Text

19. The non-transitory computer storage media of claim 18 , the operations further comprising, when the level of confidence is sufficiently low, presenting a refining prompt to allow the user to select one or more possible values for the one or more missing parameters, the one or more possible values being determined based on data associated with the one or more current or future events.

Plain English Translation

Building upon the previous voice command and computer program description, if the system determines the "level of confidence" in its suggested values for the missing parameters is sufficiently *low*, it presents a "refining prompt" to the user. This prompt allows the user to select the correct value for the missing parameter from a list of possible values derived from data associated with the identified current or future events. This lets the user clarify their intent when the system is unsure.

Claim 20

Original Legal Text

20. The non-transitory computer storage media of claim 19 , the operations further comprising, when the level of confidence is sufficiently high, assigning values to the one or more missing parameters based on data associated with the one or more current or future events without presenting the refining prompt.

Plain English Translation

Building upon the previous voice command, computer program, and prompt description, if the system determines that the "level of confidence" in its suggested values for missing parameters is sufficiently *high*, it automatically assigns those values to the parameters using data associated with the identified current or future events, *without* showing a refining prompt to the user. This streamlines the interaction when the system is confident in its interpretation.

Patent Metadata

Filing Date

Unknown

Publication Date

December 5, 2017

Inventors

Zoltan Stekkelpak
Gyula Simonyi

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, FAQs, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “CUSTOMIZING ACTIONS BASED ON CONTEXTUAL DATA AND VOICE-BASED INPUTS” (9837076). https://patentable.app/patents/9837076

© 2026 Nomic Interactive Technology LLC. Machine-readable context available at /api/llm-context/9837076. See llms.txt for full attribution policy.

CUSTOMIZING ACTIONS BASED ON CONTEXTUAL DATA AND VOICE-BASED INPUTS