{"schema_version":"1.0","canonical_url":"https://patentable.app/patents/US-11243532","patent":{"patent_number":"US-11243532","title":"Evaluating varying-sized action spaces using reinforcement learning","assignee":null,"inventors":[],"filing_date":"2018-09-26T00:00:00.000Z","publication_date":"2022-02-08T00:00:00.000Z","cpc_codes":["B60W","G05D","G05D","G05D","G06N","G06N","B60W","B60W","B60W","B60W","B60W","B60W","B60W","G06N","G06N","G06N"],"num_claims":20,"abstract":"A set of actions corresponding to a particular state of the environment of a vehicle is identified. A respective encoding is generated for different actions of the set, using elements such as distinct colors to distinguish attributes such as target lane segments. Using the encodings as inputs to respective instances of a machine learning model, respective value metrics are estimated for each of the actions. One or more motion-control directives to implement a particular action selected using the value metrics are transmitted to motion-control subsystems of the vehicle."},"analysis":{"summary":null,"layman_explanation":null,"technical_analysis":null,"business_analysis":null,"faqs":null,"topics":[],"tech_cluster":null},"seo":{"title":"Evaluating varying-sized action spaces using reinforcement learning","description":"A set of actions corresponding to a particular state of the environment of a vehicle is identified. A respective encoding is generated for different actions of the set, using elements such as distinct","keywords":[]},"attribution":{"source":"Patentable","source_url":"https://patentable.app","canonical_url":"https://patentable.app/patents/US-11243532","license":"CC-BY-4.0-like","license_terms":"AI-generated analysis on this page (summary, layman_explanation, technical_analysis, business_analysis, faqs) may be reused with attribution and a visible link back to the canonical URL above. Patent abstracts, claims, and bibliographic data are USPTO public domain.","required_link":"https://patentable.app/patents/US-11243532","citation_suggestion":"Patentable. \"Evaluating varying-sized action spaces using reinforcement learning\" (US-11243532). https://patentable.app/patents/US-11243532","copyright_holder":"Nomic Interactive Technology LLC"},"links":{"html":"https://patentable.app/patents/US-11243532","json":"https://patentable.app/api/llm-context/US-11243532","site":"https://patentable.app","llms_txt":"https://patentable.app/llms.txt"},"generated_at":"2026-05-30T18:47:50.024Z"}