peft-fine-tuning-llm 开源项目推荐（204 个）

peremartra /Large-Language-Model-Notebooks-Course

Practical course about Large Language Models.

dvgodoy /FineTuningLLMs

Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with PyTorch and Hugging Face"

tsiendragon /qwen-image-finetune

Repo for Qwen Image Finetune

liuqidong07 /MOELoRA-peft

[SIGIR'24] The official implementation code of MOELoRA.

TUDB-Labs /MoE-PEFT

An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT

nbasyl /DoRA

Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"

km1994 /AwesomeMultiModel

【AIGC 实战入门笔记 —— AIGC 摩天大楼】分享 大语言模型（LLMs），大模型高效微调（SFT）,检索增强生成（RAG），智能体（Agent），PPT自动生成, 角色扮演，文生图（Stable Diffusion） ，图像文字识别（OCR），语音识别（ASR），语音合成（TTS），人像分割（SA），多模态（VLM），Ai 换脸(Face Swapping), 文生视频(VD)，图生视频（SVD），Ai 动作迁移，Ai 虚拟试衣，数字人，全模态理解（Omni），Ai音乐生成 干货学习 等 实战与经验。

UCDvision /NOLA

Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"

ROIM1998 /APT

[ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference

brown-palm /AntGPT

Official code implemtation of paper AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?

SkyuForever /CRE-LLM

CRE-LLM: A Domain-Specific Chinese Relation Extraction Framework with Fine-tuned Large Language Model

misonsky /HiFT

memory-efficient fine-tuning; support 24G GPU memory fine-tuning 7B

MAGICS-LAB /GERM

[ICML 2025] Fast and Low-Cost Genomic Foundation Models via Outlier Removal.

ForgeOpus /ModelForge

A no-code toolkit to finetune LLMs on your local GPU—just upload data, pick a task, and deploy later. Perfect for hackathons or prototyping, with automatic hardware detection and a guided React interface.

StarLight1212 /LLM-and-Generative-Models-Community

AI Community Tutorial, including: LoRA/Qlora LLM fine-tuning, Training GPT-2 from scratch, Generative Model Architecture, Content safety and control implementation, Model distillation techniques, Dreambooth techniques, Transfer learning, etc for practice with real project!

Mahdi-Maaref /Persian-To-English-Translator

An ultra-lightweight neural machine translation model fine-tuned specifically for Persian-to-English tasks, leveraging efficient PEFT (LoRA) techniques to deliver strong performance while staying fast and highly resource-efficient for real-world deployment.

PRITHIVSAKTHIUR /GALLO-3XL

High Quality Image Generation Model - Powered with NVIDIA A100

wrmthorne /cycleformers

A Python library for efficient and flexible cycle-consistency training of transformer models via iteratie back-translation. Memory and compute efficient techniques such as PEFT adapter switching allow for 7.5x larger models to be trained on the same hardware.

DongmingShenDS /Mistral_From_Scratch

Mistral and Mixtral (MoE) from scratch

monade /smol-but-mighty

Addestra il tuo Mini Language Model!