transformer-architecture 开源项目推荐（543 个）

Plachtaa /VALL-E-X

Microsoft VALL-E X 零样本 TTS 模型的开源实现。演示可在 https://plachtaa.github.io/vallex/ 获取

cmhungsteve /Awesome-Transformer-Attention

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

tairov /llama2.mojo

Inference Llama 2 in one file of pure 🔥

nlpodyssey /spago

Self-contained Machine Learning and Natural Language Processing library in Go

Ma-Lab-Berkeley /CRATE

Code for CRATE (Coding RAte reduction TransformEr).

awslabs /sockeye

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

berniwal /swin-transformer-pytorch

Implementation of the Swin Transformer in PyTorch.

joeynmt /joeynmt

用于教育目的的极简 NMT

linwhitehat /ET-BERT

The repository of ET-BERT, a network traffic classification model on encrypted traffic. The work has been accepted as The Web Conference (WWW) 2022 accepted paper.

wgcban /ChangeFormer

[IGARSS'22]: A Transformer-Based Siamese Network for Change Detection

kyegomez /zeta

Build high-performance AI models with modular building blocks

cuiziteng /Illumination-Adaptive-Transformer

🌕 [BMVC 2022] You Only Need 90K Parameters to Adapt Light: A Light Weight Transformer for Image Enhancement and Exposure Correction. SOTA for low light enhancement, 0.004 seconds try this for pre-processing.

google-research /maxvit

[ECCV 2022] Official repository for "MaxViT: Multi-Axis Vision Transformer". SOTA foundation models for classification, detection, segmentation, image quality, and generative modeling...

FudanNLP /CPT

CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation

abdur75648 /Deep-Learning-Specialization-Coursera

This repo contains the updated version of all the assignments/labs (done by me) of Deep Learning Specialization on Coursera by Andrew Ng. It includes building various deep learning models from scratch and implementing them for object detection, facial recognition, autonomous driving, neural machine translation, trigger word detection, etc.

kyegomez /MultiModalMamba

A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.

hkproj /transformer-from-scratch-notes

关于《注意力就是你所需要的》视频笔记（https://www.youtube.com/watch?v=bCz4OMemCcA）

sgrvinod /a-PyTorch-Tutorial-to-Transformers

关注就是你所需要的全部 |PyTorch 变形金刚教程

wjf5203 /SeqFormer

SeqFormer: Sequential Transformer for Video Instance Segmentation (ECCV 2022 Oral)

ZixuanKe /PyContinual

PyContinual (An Easy and Extendible Framework for Continual Learning)