11893483

Attention-Based Sequence Transduction Neural Networks

PublishedFebruary 6, 2024
Assigneenot available in USPTO data we have
Technical Abstract

Patent Claims
3 claims

Legal claims defining the scope of protection, as filed with the USPTO.

5

5. The system of claim 4, wherein the sequence of transformations comprises two learned linear transformations separated by an activation function.

9

9. The system of claim 8, wherein the self-attention sub-layer is configured to combine the attention outputs generated by the self-attention layers to generate the output for the self-attention sub-layer.

10

10. The system of claim 8, wherein the attention layers operate in parallel.

Patent Metadata

Filing Date

Unknown

Publication Date

February 6, 2024

Inventors

Noam M. Shazeer
Aidan Nicholas Gomez
Lukasz Mieczyslaw Kaiser
Jakob D. Uszkoreit
Llion Owen Jones
Niki J. Parmar
Illia Polosukhin
Ashish Teku Vaswani

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “ATTENTION-BASED SEQUENCE TRANSDUCTION NEURAL NETWORKS” (11893483). https://patentable.app/patents/11893483

© 2026 Patentable. All rights reserved.

Patentable is a research and drafting-assistant tool, not a law firm, and does not provide legal advice. Documents we generate are drafts for review by a licensed patent attorney.