Disclosed is a system for collecting information about operations performed on a client device and storing the operation information. Operations are combinations of view-structures and events that occur as a user interacts with applications on a client device. A view-structure may be a data structure including information about interface elements of a software application and information about content stored within the interface elements. An event may be an action performed with respect to an interface element, or another type of input to the system. The system receives information about events that occur on a client device and provides a channel of communication between an operation mimicry system and an operating system of the client device such that the operation mimicry system can store data about executed operations.
Legal claims defining the scope of protection, as filed with the USPTO.
1. A computer-implemented method for recording an operation performed by an operating system of a client device, the method comprising: receiving a report that an event has occurred on the client device; transmitting information about the report to an operation mimicry system; receiving a request from the operation mimicry system for information about a view-structure associated with the reported event; identifying a first set of instructions that, when executed by the operating system of the client device, results in a population of content within components of a display interface and results in an initialization of content values within input fields of the display interface, wherein data about the components of the display interface is stored in the view-structure; identifying a second set of instructions that, when executed by the operating system of the client device, results in execution of the event on the operating system; identifying a component of the view-structure that includes a user input value of content within the input fields of the display interface at the time of the event; transmitting the first set of instructions and the second set of instructions to the operation mimicry system for storage in relation to one another in an operation graph that includes nodes representative of view-structures and edges representative of events that prompt transitions between the view-structures; transmitting information about the identified component of the view-structure to the operation mimicry system for storage in an information back flow graph, wherein the information back flow graph specifies a path through nodes of the operation graph that represent view-structures which have been identified as including for display the user input value of content that was input for initialization during the execution of the first set of instructions; receiving a new user request from a user of the client device; transmitting a request for a sequence of operations to perform the new user request to the operation mimicry system; receiving, from the operation mimicry system, a sequence of operations, each operation comprising a view-structure and an event, to perform the new user request, the sequence of operations including one or more operations from the operation store that are specified by the path through the information back flow graph that includes information about the component of the view-structure that includes a user input; and executing the received sequence of operations.
2. The computer-implemented method of claim 1 , wherein the event is an action performed via a user interface element.
3. The computer-implemented method of claim 1 , wherein the view-structure is stored in relation to an event in the operation graph when the event involves an interaction with an interface component for which data is stored in the view-structure.
4. The computer-implemented method of claim 1 , wherein the operation graph comprises a set of operations, and wherein an operation comprises a view-structure and an event associated with the view-structure that causes a change in the state of the view-structure.
5. The computer-implemented method of claim 1 , wherein the first set of instructions further comprises instructions that enable rendering of the components of the interface stored in the view-structure for display at the client device.
6. A computer system comprising: at least one processor for executing computer program instructions; and a non-transitory computer-readable storage medium comprising stored instructions for recording an operation performed by an operating system of a client device, executable by the processor to: receive a report that an event has occurred on the client device; transmit information about the report to an operation mimicry system; receive a request from the operation mimicry system for information about a view-structure associated with the reported event; identify a first set of instructions that, when executed by the operating system of the client device, results in a population of content within components of a display interface and results in an initialization of content values within input fields of the display interface, wherein data about the components of the interface is stored in the view-structure; identify a second set of instructions that, when executed by the operating system of the client device, results in execution of the event on the operating system; identify a component of the view-structure that includes a user input value of content within the input fields of the display interface at the time of the event; transmit the first set of instructions and the second set of instructions to the operation mimicry system for storage in relation to one another in an operation graph that includes nodes representative of view-structures and edges representative of events that prompt transitions between the view-structures; transmit information about the identified component of the view-structure to the operation mimicry system for storage in an information back flow graph, wherein the information back flow graph specifies a path through nodes of the operation graph that represent view-structures which have been identified as including for display the user input value of content that was input for initialization during the execution of the first set of instructions; receive a new user request from a user of the client device; transmit a request for a sequence of operations to perform the new user request to the operation mimicry system; receive, from the operation mimicry system, a sequence of operations, each operation comprising a view-structure and an event, to perform the new user request, the sequence of operations including one or more operations from the operation store that are specified by the path through the information back flow graph that includes information about the component of the view-structure that includes a user input; and execute the receive sequence of operations.
7. The computer system of claim 6 , wherein the event is an action performed via a user interface element.
8. The computer system of claim 6 , wherein the view-structure is stored in relation to an event in the operation graph when the event involves an interaction with an interface component for which data is stored in the view-structure.
9. The computer system of claim 6 , wherein the operation graph comprises a set of operations, and wherein an operation comprises a view-structure and an event associated with the view-structure that causes a change in the state of the view-structure.
10. The computer system of claim 6 , wherein the first set of instructions further comprises instructions that enable rendering of the components of the interface stored in the view-structure for display at the client device.
11. A non-transitory computer-readable storage medium comprising stored computer program instructions for recording an operation performed by an operating system of a client device, executable by at least one processor, the instructions when executed causing the processor to: receive a report that an event has occurred on client device; transmit information about the report to an operation mimicry system; receive a request from the operation mimicry system for information about a view-structure associated with the reported event; identify a first set of instructions that, when executed by the operating system of the client device, results in a population of content within components of a display interface and results in an initialization of content values within input fields of the display interface, wherein data about the components of the interface is stored in the view-structure; identify a second set of instructions that, when executed by the operating system of the client device, results in execution of the event on the operating system; identify a component of the view-structure that includes a user input value of content within the input fields of the display interface at the time of the event; transmit the first set of instructions and the second set of instructions to the operation mimicry system for storage in relation to one another in an operation graph that includes nodes representative of view-structures and edges representative of events that prompt transitions between the view-structures; transmit information about the identified component of the view-structure to the operation mimicry system for storage in an information back flow graph, wherein the information back flow graph specifies a path through nodes of the operation graph that represent view-structures which have been identified as including for display the user input value of content that was input for initialization during the execution of the first set of instructions; receive a new user request from a user of the client device; transmit a request for a sequence of operations to perform the new user request to the operation mimicry system; receive, from the operation mimicry system, a sequence of operations, each operation comprising a view-structure and an event, to perform the new user request, the sequence of operations including one or more operations from the operation store that are specified by the path through the information back flow graph that includes information about the component of the view-structure that includes a user input; and execute the receive sequence of operations.
12. The non-transitory computer-readable storage medium of claim 11 , wherein the event is an action performed via a user interface element.
13. The non-transitory computer-readable storage medium of claim 11 , wherein a view-structure is stored in relation to an event in the operation graph when the event involves an interaction with an interface component for which data is stored in the view-structure.
14. The non-transitory computer-readable storage medium of claim 11 , wherein the operation graph comprises a set of operations, and wherein an operation comprises a view-structure and an event associated with the view-structure that causes a change in the state of the view-structure.
15. The non-transitory computer-readable storage medium of claim 11 , wherein the first set of instructions further comprises instructions that enable rendering of the components of the interface stored in the view-structure for display at the client device.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
December 15, 2017
April 27, 2021
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.