{"schema_version":"1.0","canonical_url":"https://patentable.app/patents/US-11253783","patent":{"patent_number":"US-11253783","title":"Method for training AI bot in computer game","assignee":null,"inventors":[],"filing_date":"2020-01-20T00:00:00.000Z","publication_date":"2022-02-22T00:00:00.000Z","cpc_codes":["A63F","A63F","A63F","A63F","G06N","G06N","G06N"],"num_claims":11,"abstract":"The invention discloses a pure end-to-end deep reinforcement learning for training car racing game AI bot that uses only the velocity information extracted from screen for both training and testing phases without using any internal state from game environment, such as the car facing angle. The learned AI bot can play better than the average performance of human players. In addition, the reward function is designed to consist only the velocity value, and use Ape-X distributed training framework combined with a variant of Deep Q Network to solve the sparse training signal problem caused by the reward function of an original design. Moreover, limit learner rate method is designed that improves the training efficiency and training performance. The AI bot trained in this way can achieve performance beyond the average human level and reach a level close to professional players."},"analysis":{"summary":null,"layman_explanation":null,"technical_analysis":null,"business_analysis":null,"faqs":null,"topics":[],"tech_cluster":null},"seo":{"title":"Method for training AI bot in computer game","description":"The invention discloses a pure end-to-end deep reinforcement learning for training car racing game AI bot that uses only the velocity information extracted from screen for both training and testing ph","keywords":[]},"attribution":{"source":"Patentable","source_url":"https://patentable.app","canonical_url":"https://patentable.app/patents/US-11253783","license":"CC-BY-4.0-like","license_terms":"AI-generated analysis on this page (summary, layman_explanation, technical_analysis, business_analysis, faqs) may be reused with attribution and a visible link back to the canonical URL above. Patent abstracts, claims, and bibliographic data are USPTO public domain.","required_link":"https://patentable.app/patents/US-11253783","citation_suggestion":"Patentable. \"Method for training AI bot in computer game\" (US-11253783). https://patentable.app/patents/US-11253783","copyright_holder":"Nomic Interactive Technology LLC"},"links":{"html":"https://patentable.app/patents/US-11253783","json":"https://patentable.app/api/llm-context/US-11253783","site":"https://patentable.app","llms_txt":"https://patentable.app/llms.txt"},"generated_at":"2026-05-30T19:42:58.014Z"}