{"schema_version":"1.0","canonical_url":"https://patentable.app/patents/US-10521701","patent":{"patent_number":"US-10521701","title":"Parallel decoding using autoregressive machine learning models","assignee":null,"inventors":[],"filing_date":"2019-05-20T00:00:00.000Z","publication_date":"2019-12-31T00:00:00.000Z","cpc_codes":["G06N","G06F","G06F","G06F","G06N","G06N","G06N","G06N","G06V","G06V"],"num_claims":21,"abstract":"Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing parallel generation of output from an autoregressive sequence to sequence model. In one aspect, a blockwise parallel decoding method takes advantage of the fact that some architectures can score sequences in sublinear time. By generating predictions for multiple time steps at once then backing off to a longest prefix validated by the scoring model, the methods can substantially improve the speed of greedy decoding without compromising performance."},"analysis":{"summary":null,"layman_explanation":null,"technical_analysis":null,"business_analysis":null,"faqs":null,"topics":[],"tech_cluster":null},"seo":{"title":"Parallel decoding using autoregressive machine learning models","description":"Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing parallel generation of output from an autoregressive sequence to sequence model. In one a","keywords":[]},"attribution":{"source":"Patentable","source_url":"https://patentable.app","canonical_url":"https://patentable.app/patents/US-10521701","license":"CC-BY-4.0-like","license_terms":"AI-generated analysis on this page (summary, layman_explanation, technical_analysis, business_analysis, faqs) may be reused with attribution and a visible link back to the canonical URL above. Patent abstracts, claims, and bibliographic data are USPTO public domain.","required_link":"https://patentable.app/patents/US-10521701","citation_suggestion":"Patentable. \"Parallel decoding using autoregressive machine learning models\" (US-10521701). https://patentable.app/patents/US-10521701","copyright_holder":"Nomic Interactive Technology LLC"},"links":{"html":"https://patentable.app/patents/US-10521701","json":"https://patentable.app/api/llm-context/US-10521701","site":"https://patentable.app","llms_txt":"https://patentable.app/llms.txt"},"generated_at":"2026-05-30T18:50:00.401Z"}