{"schema_version":"1.0","canonical_url":"https://patentable.app/patents/US-10509397","patent":{"patent_number":"US-10509397","title":"Action information learning device, action information optimization system and computer readable medium","assignee":null,"inventors":[],"filing_date":"2017-12-29T00:00:00.000Z","publication_date":"2019-12-17T00:00:00.000Z","cpc_codes":["G05B","G05B","G05B","G05B","G05B","G05B"],"num_claims":6,"abstract":"To perform reinforcement learning that enables selecting action information for shortening a cycle time while also avoiding the occurrence of overheating. An action information learning device (300) includes: a state information acquisition means (310) for acquiring state information including an operation pattern of a spindle and a combination of parameters related to machining of a machine tool (100); an action information output means (320) for outputting action information including adjustment information for the operation pattern and the combination of parameters included in the state information; a reward calculation means (333) for acquiring judgment information which is information for temperature of the machine tool (100) and a machining time related to the machining of the machine tool (100), and calculating a value of a reward for reinforcement learning based on the judgment information thus acquired; and a value function update means (332) for updating a value function by performing the reinforcement learning based on the value of the reward, the state information and the action information."},"analysis":{"summary":null,"layman_explanation":null,"technical_analysis":null,"business_analysis":null,"faqs":null,"topics":[],"tech_cluster":null},"seo":{"title":"Action information learning device, action information optimization system and computer readable medium","description":"To perform reinforcement learning that enables selecting action information for shortening a cycle time while also avoiding the occurrence of overheating. An action information learning device (300) i","keywords":[]},"attribution":{"source":"Patentable","source_url":"https://patentable.app","canonical_url":"https://patentable.app/patents/US-10509397","license":"CC-BY-4.0-like","license_terms":"AI-generated analysis on this page (summary, layman_explanation, technical_analysis, business_analysis, faqs) may be reused with attribution and a visible link back to the canonical URL above. Patent abstracts, claims, and bibliographic data are USPTO public domain.","required_link":"https://patentable.app/patents/US-10509397","citation_suggestion":"Patentable. \"Action information learning device, action information optimization system and computer readable medium\" (US-10509397). https://patentable.app/patents/US-10509397","copyright_holder":"Nomic Interactive Technology LLC"},"links":{"html":"https://patentable.app/patents/US-10509397","json":"https://patentable.app/api/llm-context/US-10509397","site":"https://patentable.app","llms_txt":"https://patentable.app/llms.txt"},"generated_at":"2026-05-30T17:15:45.924Z"}