{"schema_version":"1.0","canonical_url":"https://patentable.app/patents/US-12005578","patent":{"patent_number":"US-12005578","title":"Real-time real-world reinforcement learning systems and methods","assignee":null,"inventors":[],"filing_date":"2019-09-04T00:00:00.000Z","publication_date":"2024-06-11T00:00:00.000Z","cpc_codes":["B25J","B25J","G06F","G06N","G06N","G06V","G06V","G05B","G06N"],"num_claims":25,"abstract":"A reinforcement learning architecture for facilitating reinforcement learning in connection with operation of an external real-time system that includes a plurality of devices operating in a real-world environment. The reinforcement learning architecture includes a plurality of communicators, a task manager, and a reinforcement learning agent that interact with each other to effectuate a policy for achieving a defined objective in the real-world environment. Each of the communicators receives sensory data from a corresponding device and the task manager generates a joint state vector based on the sensory data. The reinforcement learning agent generates, based on the joint state vector, a joint action vector, which the task manager parses into a plurality of actuation commands. The communicators transmit the actuation commands to the plurality of devices in the real-world environment."},"analysis":{"summary":null,"layman_explanation":null,"technical_analysis":null,"business_analysis":null,"faqs":null,"topics":[],"tech_cluster":null},"seo":{"title":"Real-time real-world reinforcement learning systems and methods","description":"A reinforcement learning architecture for facilitating reinforcement learning in connection with operation of an external real-time system that includes a plurality of devices operating in a real-worl","keywords":[]},"attribution":{"source":"Patentable","source_url":"https://patentable.app","canonical_url":"https://patentable.app/patents/US-12005578","license":"CC-BY-4.0-like","license_terms":"AI-generated analysis on this page (summary, layman_explanation, technical_analysis, business_analysis, faqs) may be reused with attribution and a visible link back to the canonical URL above. Patent abstracts, claims, and bibliographic data are USPTO public domain.","required_link":"https://patentable.app/patents/US-12005578","citation_suggestion":"Patentable. \"Real-time real-world reinforcement learning systems and methods\" (US-12005578). https://patentable.app/patents/US-12005578","copyright_holder":"Nomic Interactive Technology LLC"},"links":{"html":"https://patentable.app/patents/US-12005578","json":"https://patentable.app/api/llm-context/US-12005578","site":"https://patentable.app","llms_txt":"https://patentable.app/llms.txt"},"generated_at":"2026-05-31T14:08:51.193Z"}