{"schema_version":"1.0","canonical_url":"https://patentable.app/patents/US-10540598","patent":{"patent_number":"US-10540598","title":"Interpolation of transition probability values in Markov decision processes","assignee":null,"inventors":[],"filing_date":"2015-09-09T00:00:00.000Z","publication_date":"2020-01-21T00:00:00.000Z","cpc_codes":["G06N"],"num_claims":17,"abstract":"According to some embodiments of the present invention there is provided a method for determining a control action in a control system using a Markov decision process. The method comprises an action of receiving two or more predefined transition probability values of a Markov decision process (MDP) of a control system, where each of the predefined transition probability values is associated with a transition between a first state and a second state, both from two or more system states, resulting from execution of one or more control actions of the control system. The method comprises an action of computing one or more new transition probability values by an analysis of the predefined transition probability values, the system states and the control actions. The method comprises an action of determining one or more recommended control actions for the respective system state based on the new transition probability value."},"analysis":{"summary":null,"layman_explanation":null,"technical_analysis":null,"business_analysis":null,"faqs":null,"topics":[],"tech_cluster":null},"seo":{"title":"Interpolation of transition probability values in Markov decision processes","description":"According to some embodiments of the present invention there is provided a method for determining a control action in a control system using a Markov decision process. The method comprises an action o","keywords":[]},"attribution":{"source":"Patentable","source_url":"https://patentable.app","canonical_url":"https://patentable.app/patents/US-10540598","license":"CC-BY-4.0-like","license_terms":"AI-generated analysis on this page (summary, layman_explanation, technical_analysis, business_analysis, faqs) may be reused with attribution and a visible link back to the canonical URL above. Patent abstracts, claims, and bibliographic data are USPTO public domain.","required_link":"https://patentable.app/patents/US-10540598","citation_suggestion":"Patentable. \"Interpolation of transition probability values in Markov decision processes\" (US-10540598). https://patentable.app/patents/US-10540598","copyright_holder":"Nomic Interactive Technology LLC"},"links":{"html":"https://patentable.app/patents/US-10540598","json":"https://patentable.app/api/llm-context/US-10540598","site":"https://patentable.app","llms_txt":"https://patentable.app/llms.txt"},"generated_at":"2026-05-30T19:16:10.559Z"}