在 Qwen 3.6 27B(温度 0.6)上,解码 TPS 提升 2.24 倍 | 在 Apple Silicon 上无需外部 Drafter 的原生 MTP 推测解码。
mtplx 开源项目推荐(14 个)
mtplx 话题在 GitHub 上没有填写简介,这里按 Star 数汇总最相关的热门仓库。
热门项目 全部 14
GitHub 共 14 个仓库,已全部展示Run local MLX models with Pi — zero config, automatic model discovery, and live token-speed monitoring.
One-click uncensored AI agent server for Apple Silicon Macs. MLX + MTPLX speculative decoding, OpenAI-compatible on your LAN. Up to 79.4 t/s decode, MTP speculative decoding on.
One-click uncensored AI agent server for Apple Silicon Macs. OpenAI-compatible on your LAN. Gemma 4 and Qwen. Up to 239 t/s decode. (GGUF,MLX,Splash)
CLI to deploy and control a fleet of LLMs on local machine / LAN / Tailscale or AWS. Spin up your agent loop.
Run an isolated Claude Science app copy through local or OpenAI-compatible model backends.
Beautiful, zero-dependency realtime dashboard + live activity log for a local MTPLX inference server — reads the /metrics endpoint, no build step.
Double Qwen 3.8 27B inference speed on Apple Silicon with a one-click local coding agent
A heads-up display with per-turn/session telemetry for both local engine and cloud models. Data straight from the engine. Look for it in the sidebar.
Local LLM benchmarks on a 64GB Mac M5 Max: mtplx with Qwen3.8-27B and Qwen3.6-35B-A3B (MTP, long context, engines, settings)
A lightweight, parallel-first desktop GUI for MTPLX — browse packs, launch multiple models on their own ports, watch them side by side.
Native macOS menu-bar controller for local MTPLX model daemons.
Recover the native MTP predictor missing from the 8-bit MLX Qwen3.8-27B-Uncensored package, build a BF16 sidecar, and reproduce a 15.59 → 48.75 tok/s controlled M4 Max result with MTPLX.
Local OpenAI/Anthropic-compatible LLM gateway that starts, stops and switches local runtimes (MTPLX, LM Studio, oMLX, Ollama) behind one stable endpoint for your coding agents.
关于这个话题
- 清单取自 GitHub 话题页并按 Star 数排序,每次展示前 14 个项目;原始页面见 https://github.com/topics/mtplx。
- 该话题在 GitHub 上共有 14 个仓库, 本站收录的是其中最热门的 14 个,不是全量列表。
- Star / Fork 每日自动刷新一次,实时数据以 GitHub 为准。
- 当前 14 个项目累计 2705 Star,覆盖 7 种主要语言,数据更新于 2026-11-08。
- 中文介绍来自 GitHub 官方话题说明(github/explore)的机器翻译,可点「查看原文」对照;译文缺失时会先展示原文。