pre-train 开源项目推荐（8 个）

brightmart /sentiment_analysis_fine_grain

Multi-label Classification with BERT; Fine Grained Sentiment Analysis from AI challenger

NVlabs /FAN

Official PyTorch implementation of Fully Attentional Networks

NVlabs /GCVit

[ICML 2023] Official PyTorch implementation of Global Context Vision Transformers

med-air /Endo-FM

[MICCAI'23] Foundation Model for Endoscopy Video Analysis via Large-scale Self-supervised Pre-train

brightmart /xlnet_zh

中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large

ymcui /LERT

LERT: A Linguistically-motivated Pre-trained Language Model（语言学信息增强的预训练模型LERT）

rootlu /L2P-GNN

Codes and datasets for AAAI-2021 paper "Learning to Pre-train Graph Neural Networks"

cuiyuheng /repomix

📦 Repomix (formerly Repopack) is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, and Gemini.