attention-is-all-you-need 开源项目推荐（368 个）

jadore801120 /attention-is-all-you-need-pytorch

基于 PyTorch 的《Attention is All You Need》中 Transformer 模型的实现。

Kyubyong /transformer

Transformer的TensorFlow实现：注意力就是你所需要的一切

linto-ai /whisper-timestamped

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

amitshekhariitbhu /llm-internals

Learn LLM internals step by step - from tokenization to attention to inference optimization.

hkproj /pytorch-transformer

Attention is all you need implementation

awslabs /sockeye

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

gordicaleksa /pytorch-original-transformer

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

Separius /awesome-fast-attention

list of efficient attention modules

brightmart /bert_language_understanding

面向语言理解的深度双向 Transformer 预训练：预训练 TextCNN

kaituoxu /Speech-Transformer

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

kyegomez /LongNet

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

lsdefine /attention-is-all-you-need-keras

Keras+TensorFlow 实现变换器：注意力就是你所需要的全部

feifeibear /long-context-attention

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

sooftware /kospeech

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition leveraging PyTorch and Hydra.

FreedomIntelligence /TextClassificationBenchmark

A Benchmark of Text Classification in PyTorch

jayparks /transformer

Pytorch 实现的“注意力就是你所需要的全部”和“机器翻译加权变换器网络”

lvapeab /nmt-keras

Neural Machine Translation with Keras

hkproj /transformer-from-scratch-notes

关于《注意力就是你所需要的》视频笔记（https://www.youtube.com/watch?v=bCz4OMemCcA）

sgrvinod /a-PyTorch-Tutorial-to-Transformers

关注就是你所需要的全部 |PyTorch 变形金刚教程

kyegomez /ScreenAI

Implementation of the ScreenAI model from the paper: "A Vision-Language Model for UI and Infographics Understanding"