{"schema_version":"1.0","canonical_url":"https://patentable.app/patents/US-10490182","patent":{"patent_number":"US-10490182","title":"Initializing and learning rate adjustment for rectifier linear unit based artificial neural networks","assignee":null,"inventors":[],"filing_date":"2016-12-29T00:00:00.000Z","publication_date":"2019-11-26T00:00:00.000Z","cpc_codes":["G10L","G06N","G06N","G06N","G10L","G10L","G10L","G10L","G10L","G06N","G06N","G10L","G10L"],"num_claims":21,"abstract":"A data processing technique uses an Artificial Neural Network (ANN) with Rectifier Linear Units (ReLU) to yield improve accuracy in a runtime task, for example, in processing audio-based data acquired by a speech-enabled device. The technique includes a first aspect that relates to initialization of the ANN weights to initially yield a high fraction of positive outputs from the ReLU. These weights are then modified using an iterative procedure in which the weights are incrementally updated. A second aspect relates to controlling the size of the incremental updates (a “learning rate”) during the iterations of training according to a variance of the weights at each layer."},"analysis":{"summary":null,"layman_explanation":null,"technical_analysis":null,"business_analysis":null,"faqs":null,"topics":[],"tech_cluster":null},"seo":{"title":"Initializing and learning rate adjustment for rectifier linear unit based artificial neural networks","description":"A data processing technique uses an Artificial Neural Network (ANN) with Rectifier Linear Units (ReLU) to yield improve accuracy in a runtime task, for example, in processing audio-based data acquired","keywords":[]},"attribution":{"source":"Patentable","source_url":"https://patentable.app","canonical_url":"https://patentable.app/patents/US-10490182","license":"CC-BY-4.0-like","license_terms":"AI-generated analysis on this page (summary, layman_explanation, technical_analysis, business_analysis, faqs) may be reused with attribution and a visible link back to the canonical URL above. Patent abstracts, claims, and bibliographic data are USPTO public domain.","required_link":"https://patentable.app/patents/US-10490182","citation_suggestion":"Patentable. \"Initializing and learning rate adjustment for rectifier linear unit based artificial neural networks\" (US-10490182). https://patentable.app/patents/US-10490182","copyright_holder":"Nomic Interactive Technology LLC"},"links":{"html":"https://patentable.app/patents/US-10490182","json":"https://patentable.app/api/llm-context/US-10490182","site":"https://patentable.app","llms_txt":"https://patentable.app/llms.txt"},"generated_at":"2026-05-31T06:24:18.749Z"}