transformer-models 开源项目推荐（434 个）

cmhungsteve /Awesome-Transformer-Attention

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

OpenNMT /CTranslate2

Transformer 模型的快速推理引擎

sovrasov /flops-counter.pytorch

Flops counter for neural networks in pytorch framework

VITA-Group /TransGAN

[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang

vturrisi /solo-learn

solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightning

uncbiag /Awesome-Foundation-Models

A curated list of foundation models for vision and language tasks

harleyszhang /llm_note

LLM笔记，包括模型推理、变换器模型结构和LLM框架代码分析笔记。

imperial-qore /TranAD

[VLDB'22] Anomaly Detection using Transformers, self-conditioning and adversarial training.

daiquocnguyen /Graph-Transformer

Universal Graph Transformer Self-Attention Networks (TheWebConf WWW 2022) (Pytorch and Tensorflow)

philipturner /metal-flash-attention

FlashAttention (Metal Port)

cuiziteng /Illumination-Adaptive-Transformer

🌕 [BMVC 2022] You Only Need 90K Parameters to Adapt Light: A Light Weight Transformer for Image Enhancement and Exposure Correction. SOTA for low light enhancement, 0.004 seconds try this for pre-processing.

ScalaConsultants /Aspect-Based-Sentiment-Analysis

💭 基于切面的情感分析：变换器与可解释机器学习（TensorFlow）

audeering /w2v2-how-to

How to use our public wav2vec2 dimensional emotion model

RetroCirce /HTS-Audio-Transformer

The official code repo of "HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection"

moonshine-ai /useful-transformers

Efficient Inference of Transformer models

HHousen /TransformerSum

Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive summarization datasets to the extractive task.

ThilinaRajapakse /pytorch-transformers-classification

Based on the Pytorch-Transformers library by HuggingFace. To be used as a starting point for employing Transformer models in text classification tasks. Contains code to easily train BERT, XLNet, RoBERTa, and XLM models for text classification.

dpressel /mint

MinT: Minimal Transformer Library and Tutorials

AnkurDeria /MFT

Pytorch implementation of Multimodal Fusion Transformer for Remote Sensing Image Classification.

OpenMachine-ai /transformer-tricks

A collection of tricks and tools to speed up transformer models