{"schema_version":"1.0","canonical_url":"https://patentable.app/patents/US-11501168","patent":{"patent_number":"US-11501168","title":"Learning longer-term dependencies in neural network using auxiliary losses","assignee":null,"inventors":[],"filing_date":"2019-02-11T00:00:00.000Z","publication_date":"2022-11-15T00:00:00.000Z","cpc_codes":["G06N","G06N","G06N","G06N"],"num_claims":20,"abstract":"Methods, systems, and apparatus, including computer programs encoded on computer storage media, for structuring and training a recurrent neural network. This describes a technique that improves the ability to capture long term dependencies in recurrent neural networks by adding an unsupervised auxiliary loss at one or more anchor points to the original objective. This auxiliary loss forces the network to either reconstruct previous events or predict next events in a sequence, making truncated backpropagation feasible for long sequences and also improving full backpropagation through time."},"analysis":{"summary":null,"layman_explanation":null,"technical_analysis":null,"business_analysis":null,"faqs":null,"topics":[],"tech_cluster":null},"seo":{"title":"Learning longer-term dependencies in neural network using auxiliary losses","description":"Methods, systems, and apparatus, including computer programs encoded on computer storage media, for structuring and training a recurrent neural network. This describes a technique that improves the ab","keywords":[]},"attribution":{"source":"Patentable","source_url":"https://patentable.app","canonical_url":"https://patentable.app/patents/US-11501168","license":"CC-BY-4.0-like","license_terms":"AI-generated analysis on this page (summary, layman_explanation, technical_analysis, business_analysis, faqs) may be reused with attribution and a visible link back to the canonical URL above. Patent abstracts, claims, and bibliographic data are USPTO public domain.","required_link":"https://patentable.app/patents/US-11501168","citation_suggestion":"Patentable. \"Learning longer-term dependencies in neural network using auxiliary losses\" (US-11501168). https://patentable.app/patents/US-11501168","copyright_holder":"Nomic Interactive Technology LLC"},"links":{"html":"https://patentable.app/patents/US-11501168","json":"https://patentable.app/api/llm-context/US-11501168","site":"https://patentable.app","llms_txt":"https://patentable.app/llms.txt"},"generated_at":"2026-05-31T05:13:33.087Z"}