autoround 开源项目推荐（9 个）

intel /intel-extension-for-transformers

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

albond /DGX_Spark_Qwen3.5-122B-A10B-AR-INT4

DGX Spark上的Qwen3.5-122B-A10B：28.3→51 tok/s（+80%）

dime-online /qwen3.8-Flash-DGX-UltraFast

Qwen3.8 Flash at 74 tok/s on a single DGX Spark / GB10. vLLM + MTP recipe, 212 tok/s at 8 streams.

0xBakeer /Qwen3.8-27B-4-bit-on-a-single-DGX-Spark

Serving 4-bit Qwen3.8-27B on a single DGX Spark (GB10): 75 tok/s single-stream, 246 tok/s aggregate at 8-way concurrency. NVFP4 vs MixedInt4-AutoRound vs the FP8 baseline, measured on one harness — including why the quantization advantage collapses to +0.2% by c16.

jajmangold /vllm-sm70

vLLM for nVidia Volta (sm_70)

drewid74 /optimized-qwen35-hybrid-v2-runbook-public

Production runbook for Qwen3.5-122B hybrid INT4+FP8 on NVIDIA DGX Spark GB10 — optimization stack, PD firmware wedge diagnosis, bench results

fei121 /Qwen3-8B-Quantization

Qwen3-8B quantization study across vLLM, TensorRT-LLM, AutoRound, INT8, and MXFP4

BobClawblaw /qwen38-flashnext-int4mixed-2x-dgx-sparks

Qwen3.8-Flash-Next INT4-Mixed on native TensorFold, 2x DGX Spark (TP=2): prose 78 / code 127 tok/s at 1 stream, 304 / 516 at 16, 0.04 s first token · text, images, video, tools, 1M context · AutoRound INT4

technigmaai /qwen3.8-flash-next-int4-rtxpro6000-tp1

Qwen3.8-Flash-Next AutoRound INT4 on NVIDIA RTX PRO 6000 Blackwell 96GB: vLLM TP1, 512k, MTP3, FP8 KV and enforced tools