bitsandbytes 开源项目推荐（142 个）

dvgodoy /FineTuningLLMs

Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with PyTorch and Hugging Face"

DaoyuanLi2816 /can-i-finetune-this

Single-GPU LLM fine-tuning preflight: memory estimates, runnable LoRA/QLoRA recipes, and local measurements.

bobazooba /xllm

🦖 X—LLM：前沿与简易LLM精炼

patientx-cfz /comfyui-rocm

Windows-only version of ComfyUI which uses AMD's official ROCm and PyTorch libraries to get better performance with AMD GPUs. [auto-installation and popular performance enhancing packages like triton * sage-attention * flash-attention * bitsandbytes included ]

EricRollei /Comfy_HunyuanImage3

Nodes to run Hunyuan Image 3 locally with BF16 and NF4 quantized options in Comfyui

shaheennabi /Production-Ready-Instruction-Finetuning-of-Meta-Llama-3.2-3B-Instruct-Project

Instruction Fine-Tuning of Meta Llama 3.2-3B Instruct on Kannada Conversations. Tailoring the model to follow specific instructions in Kannada, enhancing its ability to generate relevant, context-aware responses based on conversational inputs. Using the Kannada Instruct dataset for fine-tuning! Happy Finetuning 🎋

stackav-oss /conch

A "standard library" of Triton kernels.

Vitgracer /Offline-Voice-LLM-Assistant

Running small but capable language models entirely offline

jajmangold /vllm-sm70

vLLM for nVidia Volta (sm_70)

akimfromparis /RAG-Japanese

Open source RAG with Llama Index for Japanese LLM in low resource settting

antonio-f /Orca2

Orca 2 on Colab

eljandoubi /AI-Photo-Editing-with-Inpainting

A web app that allows you to select a subject and then change its background, OR keep the background and change the subject.

ChaitanyaK77 /Verifiable-Reasoning-Post-Training-for-Qwen3-8B

Single-GPU post-training pipeline for Qwen3-8B math reasoning. Combines QLoRA SFT, DPO, and GRPO with verifiable rewards (correctness + format + length). Seven Colab notebooks, +6pp GSM8K from SFT alone

to-aoki /bitsandbytes

bitsandbytes modify for jetson orin

dasdristanta13 /LLM-Lora-PEFT_accumulate

LLM-Lora-PEFT_accumulate explores optimizations for Large Language Models (LLMs) using PEFT, LORA, and QLORA. Contribute experiments and implementations to enhance LLM efficiency. Join discussions and push the boundaries of LLM optimization. Let's make LLMs more efficient together!

Abeshith /FineTuning_LanguageModels

🎯 Fine-tune large language models and use them for text-related tasks. This repository provides a straightforward approach to fine-tuning models like Gemma, Llama 🦙, and Mistral 🌪️ for various NLP tasks. 🔧 It includes training 📚, fine-tuning 🛠️, and inference pipelines ⚙️. 🚀

ryan-air /Alpaca-3B-Fine-Tuned

In this project, I have provided code and a Colaboratory notebook that facilitates the fine-tuning process of an Alpaca 3B parameter model originally developed at Stanford University. The model was adapted using LoRA to run with fewer computational resources and training parameters and used HuggingFace's PEFT library.

BBC-Esq /Torch-CUDA-Compatibility-Checker

Check compatibility between torch, cuda, triton, xformers, and bitsandbytes.

namnguyen0503 /mi50-gfx906-unsloth-bnb4bit-lab

ROCm/Unsloth/bitsandbytes 4-bit lab and VRAM benchmarks for AMD MI50/gfx906 LLM fine-tuning

kalaiselvan-t /openvla-fr3

FR3 robot in Gazebo integrated with 4-bit quantized OpenVLA and MoveIt