10785146

Scalable Cell-Based Packet Processing Service Using Client-Provided Decision Metadata

PublishedSeptember 22, 2020
Assigneenot available in USPTO data we have
Technical Abstract

Patent Claims
20 claims

Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.

Claim 1

Original Legal Text

1. A system, comprising: one or more computing devices of a packet processing service; wherein the one or more computing devices include instructions that upon execution on a processor cause the one or more computing devices to: assign, to a first application with a first set of source endpoints and a second set of destination endpoints, a first isolated packet processing cell of a plurality of isolated packet processing cells of the packet processing service, wherein the first isolated packet processing cell comprises (a) a plurality of action implementation nodes, including a first action implementation node and a second action implementation node, (b) one or more decision master nodes, and (c) one or more administration nodes, wherein at least the first action implementation node has a programmatically attached virtual network interface configured to receive network traffic originating at a first source endpoint of the first set, and wherein at least the second action implementation node has a programmatically attached virtual network interface configured to transmit network traffic along a path to a first destination endpoint of the second set; propagate, to the one or more decision master nodes, an indication of a forwarding information base of the first application, wherein the indication is received via a programmatic interface from a client of the packet processing service; provide, from a first decision master node of the one or more decision master nodes in response to an action query generated at the first action implementation node, a representation of a first packet processing action to be implemented with respect to a group of one or more packets originating at the first source endpoint, wherein the first packet processing action is based at least in part on (a) contents of the forwarding information base and (b) a packet processing policy indicated by the client; and perform, at the first action implementation node, the particular packet processing action with respect to a first packet of the group.

Plain English translation pending...
Claim 2

Original Legal Text

2. The system as recited in claim 1 , wherein the first application is assigned the first isolated packet processing cell in response to a programmatic request from a first client, wherein the instructions upon execution on the processor cause the one or more computing devices to: assign, to a second application of a second client, the first isolated packet processing cell; and perform, at the first action implementation node, a packet processing action of the second application.

Plain English Translation

The system involves a network processing architecture designed to enhance security and efficiency in packet handling. The problem addressed is the need for isolated and secure processing of network packets from multiple applications, ensuring that one application's processing does not interfere with another's. The system achieves this by assigning isolated packet processing cells to applications based on programmatic requests from clients. Each cell operates independently, preventing cross-application interference while allowing shared use of processing resources. The system includes a processor and memory storing instructions that, when executed, enable the assignment of isolated packet processing cells to applications. A first application from a first client is assigned a specific isolated packet processing cell in response to a request. The system further allows a second application from a second client to be assigned the same isolated packet processing cell. Despite sharing the cell, the system ensures that packet processing actions for the second application are performed at a designated action implementation node, maintaining isolation and security. This approach optimizes resource utilization while preventing unauthorized access or interference between applications. The system is particularly useful in environments where multiple applications require secure, isolated packet processing, such as cloud computing or multi-tenant network services.

Claim 3

Original Legal Text

3. The system as recited in claim 1 , wherein a cell reconfiguration operation initiated by the one or more administration nodes comprises modifying one or more of: (a) the number of action implementation nodes included in the first isolated packet processing cell or (b) the number of decision master nodes included in the first isolated packet processing cell.

Plain English Translation

This invention relates to a distributed network system for packet processing, specifically addressing the need for dynamic reconfiguration of isolated packet processing cells to optimize performance and resource allocation. The system includes multiple isolated packet processing cells, each containing action implementation nodes and decision master nodes. These cells operate independently to process network packets while maintaining isolation from other cells to prevent cascading failures. The invention enables dynamic reconfiguration of these cells through administration nodes, which can modify the structure of a cell by adjusting the number of action implementation nodes or decision master nodes within it. Action implementation nodes execute predefined actions on packets, such as filtering or routing, while decision master nodes determine the appropriate actions based on packet attributes. By altering the number of these nodes, the system can scale processing capacity, improve load balancing, or adapt to changing network conditions without disrupting ongoing operations. This reconfiguration ensures efficient resource utilization and maintains system stability by allowing fine-grained adjustments to cell composition in response to traffic patterns or performance requirements. The system thus provides a flexible and resilient framework for managing packet processing in large-scale networks.

Claim 4

Original Legal Text

4. The system as recited in claim 1 , wherein the first isolated packet processing cell comprises a plurality of action implementation nodes, wherein the instructions upon execution on the processor cause the one or more computing devices to: determine, using a shuffle sharding algorithm, that the first packet of the group is to be processed at least in part at the first action implementation node.

Plain English Translation

This invention relates to a distributed packet processing system designed to efficiently handle network traffic by dynamically assigning packets to specialized processing nodes. The system addresses the challenge of optimizing packet processing in high-throughput environments, where traditional centralized approaches can become bottlenecks. The system includes multiple isolated packet processing cells, each containing a set of action implementation nodes responsible for executing specific operations on network packets. These nodes are distributed across one or more computing devices, allowing parallel processing to improve performance and scalability. A key feature is the use of a shuffle sharding algorithm to determine which action implementation node should process a given packet. This algorithm ensures that packets are distributed evenly across nodes, preventing overload while maintaining low-latency processing. The system dynamically assigns packets to nodes based on factors such as current workload, node availability, and packet characteristics, enabling adaptive load balancing. The action implementation nodes execute predefined instructions to process packets, such as filtering, routing, or modifying packet headers, before forwarding them to their destination. This modular approach allows for flexible configuration and easy integration of new processing tasks. The overall system enhances network efficiency by reducing processing delays and improving resource utilization in distributed environments.

Claim 5

Original Legal Text

5. The system as recited in claim 1 , wherein the instructions upon execution on the processor cause the one or more computing devices to: determine, based at least in part on one or more metrics, that traffic associated with the first application is to be migrated to a second isolated packet processing cell; implement a migration to migrate the traffic of the first application to the second isolated packet processing cell.

Plain English Translation

This invention relates to network traffic management in computing systems, specifically addressing the challenge of efficiently migrating application traffic between isolated packet processing cells to optimize performance and resource utilization. The system monitors traffic associated with a first application and evaluates one or more metrics to determine whether migration to a second isolated packet processing cell is necessary. These metrics may include factors such as traffic load, latency, processing efficiency, or resource availability. Upon identifying the need for migration, the system executes a migration process to transfer the traffic of the first application to the second isolated packet processing cell. The isolated packet processing cells operate independently, ensuring that traffic migration does not disrupt other applications or system operations. This approach enhances scalability, fault tolerance, and performance by dynamically redistributing traffic based on real-time conditions. The system may also include mechanisms to monitor the migration process and ensure seamless transition without service interruption. The invention is particularly useful in cloud computing environments, data centers, or any system requiring dynamic traffic management across isolated processing units.

Claim 6

Original Legal Text

6. A method, comprising: performing, by one or more computing devices: assigning, to a first application with a source endpoint and a destination endpoint, a first isolated packet processing cell of a packet processing service, wherein the first isolated packet processing cell comprises (a) one or more action implementation nodes, including a first action implementation node, and (b) one or more decision master nodes including a first decision master node; obtaining, at the one or more decision master nodes, an indication of one or more packet forwarding rules of the first application; providing, from the first decision master node, in response to an action query generated at the first action implementation node, a representation of a first packet processing action to be implemented for a group of one or more packets originating at the source endpoint, wherein the first packet processing action is based at least in part on the one or more packet forwarding rules; executing, at the first action implementation node, the particular packet processing action with respect to a first packet of the group, wherein executing the particular packet processing action comprises transmitting at least one packet on a path to the destination endpoint.

Plain English Translation

This invention relates to a packet processing service for managing network traffic in a distributed computing environment. The problem addressed is the need for efficient, scalable, and isolated packet processing to support multiple applications with distinct forwarding rules while ensuring low-latency decision-making and action execution. The method involves assigning a dedicated isolated packet processing cell to a first application, which operates between a source endpoint and a destination endpoint. This cell includes action implementation nodes and decision master nodes. The decision master nodes obtain packet forwarding rules specific to the application and provide action representations in response to queries from the action implementation nodes. The action implementation nodes then execute these actions on packets, such as forwarding them along a path to the destination endpoint. The isolated cell structure ensures that each application's packet processing is independent, preventing interference between different applications. The decision master nodes handle rule-based decision-making, while the action implementation nodes perform the actual packet processing tasks, optimizing performance and scalability. This approach allows for dynamic, rule-driven packet handling tailored to individual applications while maintaining efficient network operations.

Claim 7

Original Legal Text

7. The method as recited in claim 6 , wherein the first application is assigned the first isolated packet processing cell in response to a programmatic request from a first client, the method further comprising performing, by the one or more computing devices: assigning, to a second application of a second client, the first isolated packet processing cell; and executing, at the first action implementation node, a packet processing action of the second application.

Plain English Translation

This invention relates to a system for dynamically assigning isolated packet processing cells to multiple applications from different clients. The technology addresses the challenge of efficiently managing packet processing resources in a shared computing environment, where multiple applications may require dedicated processing cells for handling network packets. The system enables flexible allocation of these cells to different applications based on programmatic requests, allowing for dynamic reconfiguration of processing resources as needed. The method involves assigning a first isolated packet processing cell to a first application of a first client in response to a programmatic request. The same cell can then be reassigned to a second application of a second client, allowing the system to execute packet processing actions for the second application within the same cell. This approach optimizes resource utilization by enabling shared use of processing cells across different applications, reducing the need for dedicated hardware or static allocations. The system ensures that each application's packet processing actions are executed within the assigned cell, maintaining isolation and security while dynamically adapting to changing workloads. The method is implemented by one or more computing devices that manage the assignment and execution of these processing actions, ensuring efficient and scalable packet processing in a multi-tenant environment.

Claim 8

Original Legal Text

8. The method as recited in claim 6 , wherein the first application comprises a routing application used to route packets between a pair of isolated networks, the method further comprising performing, by the one or more computing devices: assigning, to a second application, a second isolated packet processing cell of the plurality of isolated packet processing cells, wherein the second application is a multicast application; and executing, at the first action implementation node, a packet processing action of the second application.

Plain English Translation

This invention relates to network packet processing systems, specifically methods for managing isolated packet processing cells in a computing environment. The problem addressed is the need to efficiently route packets between isolated networks while also supporting additional network functions like multicast applications within the same system. The method involves assigning a first isolated packet processing cell to a routing application responsible for routing packets between two isolated networks. This routing application processes packets to ensure secure and efficient communication between the networks. Additionally, a second isolated packet processing cell is assigned to a multicast application, which handles the distribution of packets to multiple recipients within the network. Both applications operate within the same system, leveraging isolated packet processing cells to maintain security and performance. The method further includes executing packet processing actions for both the routing and multicast applications at a designated action implementation node. This node performs the necessary operations to process packets according to the requirements of each application, ensuring that the routing and multicast functions are carried out without interference. The isolated packet processing cells prevent conflicts between the applications, allowing them to coexist and function independently within the same system. This approach enhances network flexibility and efficiency by integrating multiple network functions into a unified framework.

Claim 9

Original Legal Text

9. The method as recited in claim 6 , wherein the first isolated packet processing cell comprises a plurality of action implementation nodes, the method further comprising performing, by the one or more computing devices: determining, using a shuffle sharding algorithm, that the first packet of the group is to be processed at the first action implementation node.

Plain English Translation

This invention relates to packet processing in distributed computing systems, specifically improving efficiency and scalability in handling network packets. The problem addressed is the need for flexible and scalable packet processing in systems where packets must be distributed across multiple processing nodes while maintaining performance and consistency. The method involves a distributed packet processing architecture using isolated packet processing cells. Each cell contains multiple action implementation nodes responsible for executing specific processing tasks on network packets. The method includes grouping packets for parallel processing and determining which node within a cell should handle each packet. A shuffle sharding algorithm is used to assign packets to specific action implementation nodes based on packet characteristics or system load, ensuring balanced distribution and efficient processing. The shuffle sharding algorithm dynamically decides which node processes a given packet, optimizing resource utilization and reducing bottlenecks. This approach allows the system to scale horizontally by adding more nodes as processing demands increase. The method ensures that packets are processed in a consistent and predictable manner, improving overall system reliability and performance. The invention is particularly useful in high-throughput networking environments where efficient packet distribution is critical.

Claim 10

Original Legal Text

10. The method as recited in claim 6 , further comprising performing, by the one or more computing devices: determining, based at least in part on one or more metrics, that traffic associated with the first application is to be migrated to a second isolated packet processing cell; implementing a migration to migrate the traffic of the first application to the second isolated packet processing cell, wherein, in at least one stage of the migration, a path selection weight is assigned to a path between the source endpoint of the application and the first action implementation node.

Plain English Translation

This invention relates to network traffic management, specifically migrating application traffic between isolated packet processing cells in a network. The problem addressed is efficiently and dynamically relocating traffic flows to optimize performance, security, or resource utilization without disrupting service. The method involves monitoring traffic associated with a first application and determining, based on one or more metrics (e.g., latency, throughput, security risks), that the traffic should be migrated to a second isolated packet processing cell. The migration process includes assigning a path selection weight to a path between the application's source endpoint and the first action implementation node during at least one stage of the migration. This weight influences routing decisions to ensure smooth traffic transition. The migration may involve multiple stages, where traffic is gradually shifted to the new cell while maintaining connectivity. The isolated packet processing cells are distinct network segments that handle traffic independently, allowing for better isolation, security, or performance tuning. The method ensures minimal disruption by carefully managing the migration process, including path selection and traffic redistribution. This approach is useful in cloud computing, data centers, or any network environment requiring dynamic traffic management.

Claim 11

Original Legal Text

11. The method as recited in claim 6 , further comprising performing, by the one or more computing devices: establishing, within a first availability container of a provider network, (a) at least one action implementation node of the one or more action implementation node and (b) at least one decision master cell of the one or more decision master nodes; and establishing, within a second availability container of the provider network, (a) at least one action implementation node of the one or more action implementation nodes and (b) at least one decision master node of the one or more decision master nodes.

Plain English Translation

This invention relates to distributed computing systems within provider networks, specifically addressing fault tolerance and high availability in automated decision-making and action execution. The system involves multiple availability containers, each hosting redundant components to ensure continuous operation despite failures. Within each container, action implementation nodes execute predefined actions, while decision master nodes make decisions based on system state or external inputs. The redundancy across containers ensures that if one container fails, another can take over without service disruption. The system is designed for environments requiring high reliability, such as cloud computing platforms, where automated workflows must remain operational despite hardware or software failures. The invention improves fault tolerance by distributing critical components across independent availability zones or regions, reducing single points of failure. This approach is particularly useful for applications requiring continuous availability, such as financial transactions, healthcare monitoring, or real-time data processing. The method ensures that both decision-making and action execution remain resilient by maintaining redundant, synchronized instances of these components across separate availability domains.

Claim 12

Original Legal Text

12. The method as recited in claim 6 , wherein the one or more action implementation nodes are established within an isolated virtual network of a virtualized computing service of a provider network.

Plain English Translation

A method for implementing actions within a virtualized computing service involves establishing one or more action implementation nodes in an isolated virtual network. The virtual network is part of a provider network, which offers virtualized computing resources. The isolated virtual network ensures that the action implementation nodes operate in a secure and controlled environment, separate from other network traffic or resources. This isolation helps prevent unauthorized access, data leaks, or interference with other services running in the provider network. The action implementation nodes are configured to execute specific actions, such as processing data, running applications, or managing network resources, based on predefined rules or triggers. The virtualized computing service provides the necessary infrastructure, including virtual machines, containers, or serverless functions, to host these nodes. By deploying the nodes within an isolated virtual network, the method ensures that the actions are performed in a secure and scalable manner, leveraging the provider network's capabilities while maintaining isolation from other network segments. This approach is particularly useful for sensitive workloads, compliance requirements, or multi-tenant environments where security and isolation are critical.

Claim 13

Original Legal Text

13. The method as recited in claim 6 , further comprising performing, by the one or more computing devices: storing, in a cache of the first action implementation node, the representation of the first packet processing action; and utilizing, at the first action implementation node without submitting an additional action query, the cached representation to respond to a packet of the group.

Plain English Translation

This invention relates to packet processing in network systems, specifically optimizing the handling of packet processing actions by caching representations of those actions to reduce query overhead. The problem addressed is the inefficiency in repeatedly querying for the same packet processing actions, which consumes computational resources and delays network performance. The solution involves a method where a first action implementation node, responsible for executing packet processing actions, stores a representation of a first packet processing action in its cache. When subsequent packets from the same group require the same action, the node retrieves the cached representation instead of submitting a new action query. This reduces latency and processing load by avoiding redundant queries. The method ensures that the cached representation is used to respond to packets in the group without requiring additional queries, improving system efficiency. The approach is particularly useful in high-traffic networks where repeated action queries would otherwise degrade performance. The invention may be part of a larger system where multiple nodes handle different packet processing actions, and caching at each node prevents unnecessary communication with a central controller or database. The key innovation is the local caching of action representations to streamline packet processing workflows.

Claim 14

Original Legal Text

14. The method as recited in claim 6 , further comprising performing, by the one or more computing devices: obtaining, via a programmatic interface, an indication of a first virtual network interface to be used for transmitting packets of the first application; and storing metadata indicating an association between the first application, the first virtual network interface, and the first isolated packet processing cell.

Plain English Translation

This invention relates to network packet processing in virtualized computing environments. The problem addressed is efficiently routing packets from specific applications through designated virtual network interfaces while maintaining isolation between different packet processing workflows. The method involves a system where applications are assigned to isolated packet processing cells, which are dedicated processing units that handle network traffic for those applications. Each cell operates independently to ensure traffic isolation. The method further includes dynamically associating a specific application with a virtual network interface for transmitting its packets. This association is stored as metadata, allowing the system to direct the application's traffic through the correct interface. The metadata also links the application to its assigned isolated packet processing cell, ensuring that packets are processed in the correct isolated environment. The system obtains the virtual network interface assignment via a programmatic interface, enabling dynamic configuration without manual intervention. This approach improves network traffic management by ensuring that packets from different applications are routed through the appropriate interfaces while maintaining isolation between processing cells. The method is particularly useful in cloud computing and virtualized environments where multiple applications share network resources but require secure, isolated traffic handling.

Claim 15

Original Legal Text

15. The method as recited in claim 6 , wherein the one or more action implementation nodes comprise a plurality of action implementation nodes, and wherein the one or more decision master nodes comprise a plurality of decision master nodes, the method further comprising performing, by the one or more computing devices: transmitting respective sets of health queries from the first action implementation node to individual ones of other action implementation nodes of the first isolated packet processing cell; generating, at the first action implementation node, based at least in part on responses received to the respective sets of health queries, an indication of a reachability status of the one or more other action implementation nodes; providing, from the action implementation nodes, the indication of the reachability status to the first decision master node; and utilizing, at the first decision master node, the indication of the reachability status to select the first action implementation node to perform at least one action.

Plain English Translation

In the domain of distributed computing systems, particularly those involving isolated packet processing cells, a challenge exists in ensuring reliable communication and coordination among multiple nodes to maintain system health and functionality. This invention addresses this problem by implementing a method for monitoring and managing node reachability within an isolated packet processing cell. The method involves a plurality of action implementation nodes and decision master nodes operating within the cell. A first action implementation node transmits health queries to other action implementation nodes in the cell. These queries assess the operational status and reachability of the nodes. Based on the responses, the first action implementation node generates a reachability status indication, which is then provided to a first decision master node. The decision master node uses this status information to select the first action implementation node to perform specific actions, ensuring efficient and reliable system operation. This approach enhances fault detection and recovery, improving overall system resilience.

Claim 16

Original Legal Text

16. Non-transitory computer-accessible storage media storing program instructions that when executed on one or more processors cause one or more computer systems to: assign, to a first packet processing application, a first isolated packet processing cell of a packet processing service, wherein the first isolated packet processing cell comprises (a) a first action implementation node, and (b) a first decision master node; cause an indication of one or more processing rules of the first packet processing application to be transmitted to the first decision master node; and enable network packets from one or more source endpoints associated with the first packet processing application to be transmitted to the first action implementation node, wherein, in response to receiving a particular packet, the first action implementation node (a) obtains a representation of a particular action to be performed from the first decision master node, wherein the particular action is based at least in part on the one or more packet processing rules, and (b) executes the particular action.

Plain English Translation

This invention relates to a packet processing service that isolates packet processing applications within dedicated cells to enhance security and efficiency. The system addresses the challenge of securely processing network packets while allowing customizable rule-based actions. The packet processing service includes isolated cells, each containing an action implementation node and a decision master node. The action implementation node processes incoming network packets, while the decision master node stores and evaluates processing rules. When a packet arrives, the action implementation node queries the decision master node for the appropriate action based on the rules. The decision master node returns the action, which the action implementation node then executes. This isolation ensures that each packet processing application operates independently, preventing interference or security breaches between different applications. The system dynamically assigns isolated cells to applications, allowing scalable and secure packet processing. The invention improves network security by isolating rule evaluation and execution, reducing the risk of unauthorized access or rule tampering.

Claim 17

Original Legal Text

17. Non-transitory computer-accessible storage media as recited in claim 16 , wherein the first application is assigned the first isolated packet processing cell in response to a programmatic request from a first client, wherein the instructions when executed on one or more processors cause the one or more computer systems to: assign the first isolated packet processing cell to a second application of a second client; and cause a packet processing action of the second application at the first action implementation node.

Plain English Translation

This invention relates to a system for dynamically assigning isolated packet processing cells to applications in a networked computing environment. The problem addressed is the need for flexible and secure allocation of processing resources to different applications, particularly in scenarios where multiple clients require dedicated packet processing capabilities. The system involves non-transitory computer-accessible storage media storing instructions that, when executed, enable a computer system to manage isolated packet processing cells. These cells are specialized processing units designed to handle network packets independently and securely. The system assigns a first isolated packet processing cell to a first application of a first client in response to a programmatic request. This assignment ensures that the first application can perform packet processing tasks at a designated action implementation node, which is a specific location in the network where the processing occurs. Additionally, the system can reassign the same isolated packet processing cell to a second application of a second client. Upon reassignment, the system ensures that the second application can perform its packet processing tasks at the same action implementation node. This dynamic reassignment allows for efficient resource utilization and flexible allocation of processing capabilities across different applications and clients. The system ensures that each application operates within its assigned cell, maintaining isolation and security between different processing tasks.

Claim 18

Original Legal Text

18. Non-transitory computer-accessible storage media as recited in claim 16 , wherein the instructions when executed on one or more processors cause the one or more computer systems to: analyze one or more metrics of the first isolated packet processing cell; and based at least in part on the analysis, add one or more nodes to the first isolated packet processing cells, wherein the one or more nodes comprise one or more of: an action implementation node, or a decision master node.

Plain English Translation

This invention relates to a system for dynamically scaling packet processing in a network environment. The problem addressed is the need for efficient and flexible packet processing in high-performance networking systems, where static configurations may not adapt to varying workloads or requirements. The system involves a packet processing architecture that includes isolated packet processing cells, each capable of handling network packets independently. These cells are implemented using computer-accessible storage media containing instructions that, when executed, enable dynamic adjustments to the processing capabilities of the cells. Specifically, the system monitors one or more performance metrics of a packet processing cell, such as throughput, latency, or resource utilization. Based on this analysis, the system can automatically add new nodes to the cell to enhance its functionality. These nodes include action implementation nodes, which execute specific packet processing tasks, and decision master nodes, which manage decision-making processes within the cell. By dynamically adding these nodes, the system can scale processing capacity and adapt to changing network conditions without manual intervention. This approach improves efficiency, reduces bottlenecks, and ensures optimal performance in high-demand networking scenarios.

Claim 19

Original Legal Text

19. Non-transitory computer-accessible storage media as recited in claim 16 , wherein the instructions when executed on one or more processors cause the one or more computer systems to: determine, based at least in part on one or more metrics, that traffic associated with the first application is to be migrated to a second isolated packet processing cell; and migrate the traffic of the first application to the second isolated packet processing cell.

Plain English Translation

This invention relates to network traffic management in computer systems, specifically addressing the challenge of efficiently migrating application traffic between isolated packet processing cells to optimize performance and resource utilization. The system involves a non-transitory computer-accessible storage medium containing instructions that, when executed, enable a computer system to monitor and analyze traffic associated with a first application. The system evaluates one or more metrics, such as network latency, bandwidth usage, or processing load, to determine whether the traffic should be migrated to a second isolated packet processing cell. Upon detecting conditions that warrant migration, the system automatically transfers the traffic from the first application to the second cell, ensuring seamless and efficient traffic handling. The isolated packet processing cells operate independently, allowing for improved scalability, security, and fault isolation. This approach enhances system performance by dynamically redistributing workloads based on real-time metrics, reducing bottlenecks and improving overall network efficiency. The invention is particularly useful in cloud computing environments, data centers, or any system requiring dynamic traffic management to maintain optimal performance.

Claim 20

Original Legal Text

20. Non-transitory computer-accessible storage media as recited in claim 16 , wherein the first action implementation node or the first decision master node is implemented at least in part within a virtual machine of a virtualized computing service.

Plain English Translation

A system and method for managing workflow execution in a distributed computing environment addresses the challenge of efficiently coordinating and executing complex workflows across multiple computing nodes. The system includes a workflow definition that specifies a sequence of actions and decision points, where each action is implemented by an action implementation node and each decision point is managed by a decision master node. The workflow is executed by dynamically routing data between these nodes based on predefined rules, ensuring that actions are performed and decisions are made in the correct sequence. The system optimizes performance by minimizing data transfer and latency, particularly in environments where nodes may be geographically distributed or operate with varying levels of availability. Additionally, the system supports fault tolerance by allowing workflows to resume from a previous state if an error occurs. In some embodiments, the action implementation nodes or decision master nodes are implemented within virtual machines of a virtualized computing service, enabling flexible deployment and resource allocation. This approach enhances scalability and adaptability, allowing the system to handle varying workloads and integrate with cloud-based infrastructure. The system is particularly useful in applications requiring reliable, distributed workflow execution, such as data processing pipelines, automated decision-making systems, and multi-step computational tasks.

Patent Metadata

Filing Date

Unknown

Publication Date

September 22, 2020

Inventors

Paul John Tillotson
Bashuman Deb
Thomas Spendley
Omer Hashmi
Baihu Qian
Alexander Justin Penney

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, FAQs, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “SCALABLE CELL-BASED PACKET PROCESSING SERVICE USING CLIENT-PROVIDED DECISION METADATA” (10785146). https://patentable.app/patents/10785146

© 2026 Nomic Interactive Technology LLC. Machine-readable context available at /api/llm-context/10785146. See llms.txt for full attribution policy.

SCALABLE CELL-BASED PACKET PROCESSING SERVICE USING CLIENT-PROVIDED DECISION METADATA