{"schema_version":"1.0","canonical_url":"https://patentable.app/patents/US-10489703","patent":{"patent_number":"US-10489703","title":"Memory efficiency for convolutional neural networks operating on graphics processing units","assignee":null,"inventors":[],"filing_date":"2016-05-20T00:00:00.000Z","publication_date":"2019-11-26T00:00:00.000Z","cpc_codes":["G06N","G06F","G06N","G06V","G06V","G06V","G06V"],"num_claims":1,"abstract":"Aspects of the present disclosure are directed to techniques that improve performance of CNN systems through the effect of improved memory efficiencies for CNNs operating on GPUs. Aspects of the disclosure demonstrate that off-chip memory in such CNN systems is underutilized due to at least three characteristics namely, data layout, data locality and inter-kernel redundancy. Aspects of the disclosure examine the performance impact of different data layouts and then describe a method to produce data layout selection for various layers of the CNN including a fast transformation implementation. Disclosed are improvements to data locality from working set expansion, elimination of inter-kernel redundancy and increase of TLP using kernel reconstruction techniques including kernel fusion and thread injection. Disclosed experimental results show that our optimizations are very effective to boost the performance of CNNs by amounts up to 9.76 times for a single kernel and 2.05 times for a network."},"analysis":{"summary":null,"layman_explanation":null,"technical_analysis":null,"business_analysis":null,"faqs":null,"topics":[],"tech_cluster":null},"seo":{"title":"Memory efficiency for convolutional neural networks operating on graphics processing units","description":"Aspects of the present disclosure are directed to techniques that improve performance of CNN systems through the effect of improved memory efficiencies for CNNs operating on GPUs. Aspects of the discl","keywords":[]},"attribution":{"source":"Patentable","source_url":"https://patentable.app","canonical_url":"https://patentable.app/patents/US-10489703","license":"CC-BY-4.0-like","license_terms":"AI-generated analysis on this page (summary, layman_explanation, technical_analysis, business_analysis, faqs) may be reused with attribution and a visible link back to the canonical URL above. Patent abstracts, claims, and bibliographic data are USPTO public domain.","required_link":"https://patentable.app/patents/US-10489703","citation_suggestion":"Patentable. \"Memory efficiency for convolutional neural networks operating on graphics processing units\" (US-10489703). https://patentable.app/patents/US-10489703","copyright_holder":"Nomic Interactive Technology LLC"},"links":{"html":"https://patentable.app/patents/US-10489703","json":"https://patentable.app/api/llm-context/US-10489703","site":"https://patentable.app","llms_txt":"https://patentable.app/llms.txt"},"generated_at":"2026-05-31T20:33:32.298Z"}