Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A system for automated testing of functionally complex systems, comprising: a test manager module operating on a server computer and adapted for managing testing of failures caused by interactions between hardware and software in a distributed functionally complex system comprising hardware and software components of at least two functional types connected across a network and a plurality of networking connectivity components; a test data storage subsystem coupled to the test manager module and adapted to store test cases and test results; a log collection module operating on a server computer and adapted to receive log data from a plurality of log collectors; a test execution module operating on a server computer; and a correlation engine; wherein the test manager module causes tests to be executed by the test execution engine prior to the distributed functionally complex system being placed into production in order to detect complex failure modes caused by interactions between hardware and software in the distributed functionally complex system prior to placing the distributed functionally complex system into production; wherein, on detection of an anomalous test result, the test manager module causes additional testing to be performed and analyzes the results of the additional testing in order to isolate each interaction between hardware and software exhibiting anomalous behavior, wherein the correlation engine performs at least a correlation analysis on the anomalous test result and the results of the additional testing to identify at least one precursor pattern, and wherein if the at least one precursor pattern matches a previously identified precursor pattern, the test manager module sends an alert to a user and initiates an automated action to avoid an impending fault.
The system is designed for automated testing of complex distributed systems that integrate hardware and software components of multiple functional types across a network. These systems often experience failures due to interactions between hardware and software elements, which are difficult to predict and detect. The system includes a test manager module that oversees testing before the system is deployed to production, focusing on identifying complex failure modes caused by these interactions. A test data storage subsystem stores test cases and results, while a log collection module gathers log data from multiple sources. A test execution module runs the tests, and a correlation engine analyzes the results. When an anomalous test result is detected, the system performs additional testing to isolate problematic interactions. The correlation engine analyzes the results to identify precursor patterns that may indicate an impending fault. If a detected pattern matches a known precursor, the system sends an alert to a user and triggers automated actions to prevent the fault. This approach ensures that complex failures are identified and mitigated before the system is deployed, improving reliability and reducing downtime.
2. The system of claim 1 , wherein the system is operated as a cloud-based service that provides automated pre-production testing to a plurality of operators of functionally complex systems located substantially remotely from the cloud-based service.
This invention relates to a cloud-based system for automated pre-production testing of functionally complex systems. The system is designed to address the challenge of ensuring the reliability and performance of complex systems before they are deployed, particularly when the systems are operated by multiple users located remotely from the testing infrastructure. The system provides automated testing services to a plurality of operators, allowing them to validate the functionality, performance, and compatibility of their systems without requiring local testing resources. The cloud-based architecture enables centralized management of test environments, reducing the need for each operator to maintain their own testing infrastructure. The system is configured to handle the complexity of the systems being tested, which may include software applications, hardware components, or integrated systems with multiple interdependent functions. The automated testing capabilities include the execution of predefined test scripts, real-time monitoring of system behavior, and the generation of detailed test reports. The system can simulate various operational scenarios, including edge cases and failure conditions, to ensure robustness. The cloud-based service allows operators to access testing resources on-demand, scale testing efforts as needed, and collaborate with other operators or stakeholders in the testing process. By centralizing testing operations in the cloud, the system reduces costs, improves efficiency, and ensures consistent testing standards across different operators. The remote operation of the system enables testing to be conducted regardless of the physical location of the operators or the systems being tested, making it particularly useful for distributed teams or g
3. The system of claim 1 , wherein the system is operated as a cloud-based service that provides automated testing to a plurality of operators of functionally complex systems located substantially remotely from the cloud-based service.
This invention relates to a cloud-based automated testing system designed for functionally complex systems operated by multiple remote users. The system provides centralized, automated testing services to operators of these complex systems, which are located far from the cloud-based service. The core system includes a testing framework that generates test cases, executes them, and analyzes results to ensure the proper functioning of the complex systems. The cloud-based architecture allows remote operators to access testing capabilities without needing local infrastructure, reducing costs and improving scalability. The system also includes a user interface for managing test configurations and reviewing results, ensuring that operators can monitor and control testing processes from any location. By automating testing, the system reduces manual effort, minimizes errors, and ensures consistent performance across distributed systems. The cloud-based approach further enables real-time collaboration and data sharing among operators, enhancing efficiency and reliability in testing complex systems.
4. A method for automated testing of functionally complex systems, the method comprising the steps of: (a) under direction of a test manager module operating on a server computer and adapted for managing testing of failures caused by interactions between hardware and software in a distributed functionally complex system comprising hardware components of at least two functional types connected across a network and a plurality of networking connectivity components, prior to placing the functionally complex system into production; (b) logging results of periodic testing and storing the results in a test data storage subsystem; (c) executing tests prior to the functionally complex system being placed into production in order to detect complex failure modes prior to placing the functionally complex system into production; (d) upon detection of an anomalous result, executing a plurality of additional tests to isolate at least one interaction between hardware and software exhibiting anomalous behavior; (e) performing a correlation analysis on the anomalous test result and the results of the additional tests to identify a precursor pattern, and (f) sending an alert to a user and initiating an automated action to avoid an impending fault if the precursor pattern matches a previously identified precursor pattern.
This invention relates to automated testing of functionally complex systems, particularly those involving interactions between hardware and software components across a network. The system includes hardware components of at least two different functional types and multiple networking connectivity components. The challenge addressed is detecting complex failure modes caused by these interactions before the system is deployed into production. The method involves a test manager module running on a server computer that oversees the testing process. It logs test results periodically and stores them in a dedicated test data storage subsystem. Testing is conducted before the system enters production to identify potential failures early. If an anomalous result is detected, additional tests are automatically executed to isolate the specific hardware-software interaction causing the issue. A correlation analysis is then performed on the anomalous result and the additional test data to identify precursor patterns indicative of potential faults. If a precursor pattern matches a known pattern from prior testing, an alert is sent to a user, and an automated action is triggered to prevent the impending fault. This approach ensures that complex system failures are detected and mitigated before deployment, improving system reliability.
5. The method of claim 4 , wherein steps (a) through (d) are carried out using a cloud-based testing platform, and wherein the functionally complex system to be tested is operated by an entity different from the entity that operates the cloud-based testing platform, and is located remotely from the cloud-based testing platform.
This invention relates to cloud-based testing of functionally complex systems, addressing the challenge of testing such systems when they are operated by a different entity and located remotely from the testing platform. The method involves using a cloud-based testing platform to perform testing steps on a functionally complex system that is operated by a separate entity and situated remotely. The testing process includes executing test cases, collecting test results, analyzing the results, and generating a test report. The cloud-based platform handles these steps while interfacing with the remote system, ensuring that testing can be conducted efficiently despite the physical and operational separation between the testing platform and the system under test. This approach enables scalable, centralized testing of complex systems without requiring direct control or local access to the system being tested, improving testing flexibility and resource utilization. The method leverages cloud infrastructure to manage testing workflows, data collection, and reporting, allowing for seamless collaboration between different entities involved in the testing process.
Unknown
April 14, 2020
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.