LLM speculative inference server for heterogeneous hardware & consumer GPUs

rtx3090 开源项目推荐(29 个)
rtx3090 话题在 GitHub 上没有填写简介,这里按 Star 数汇总最相关的热门仓库。
热门项目 前 20
按 Star 数排序展示前 20 个 · GitHub 共 29 个仓库⚡️ Get notified as soon as your next CPU, GPU, or game console is in stock
BestBuy Bot is an Add to cart and Auto Checkout Bot. This auto buying bot can search the item repeatedly on the ITEM page using one keyword. Once the desired item is available it can add to cart and checkout very fast. This auto purchasing BestBuy Bot can work on Firefox Browser so it can run in all Operating Systems. It can run for multiple ite…
Using the famous cnn model in Pytorch, we run benchmarks on various gpu.
Qwen3.8-Flash-Next on 2× RTX 3090: with 128 GB RAM up to 4,191 tok/s prefill · 111.5 tok/s decode (131K prompt), full 256K window at 2,865 tok/s; with 64 GB RAM 3,410 tok/s prefill · 84 tok/s decode. New: opt-in uncensored mode (runtime abliteration, no new weights).
适用于跨平台和CUDA版本的llama-cpp-python预制轮子
Best Buy Bullet Bot, abbreviated to 3B Bot, is a stock checking bot with auto-checkout created to instantly purchase out-of-stock items on Best Buy once restocked. It was designed for speed with ultra-fast auto-checkout, as well as the ability to utilize all cores of your CPU with multiprocessing for optimal performance.
Qwen3.8-27B EXL3 (4.00 bpw) + DFlash2 speculative decoding for ExLlamaV3, validated at 262k context on a 24 GB RTX 3090
Run Qwen3.8-Flash-Next on ONE RTX 3090 (24 GB) + 64 GB RAM: 128K context, up to 2,100 tok/s prefill, 43–51 tok/s decode. vLLM runtime with hot MoE experts on the GPU and cold experts computed on the CPU, INT8 KV cache, Docker, OpenAI-compatible API.
The local LLM solution to cutting cloud API bills, smartly.
Open source DIY AI computing platform: Build a powerful RTX 3090 GPU rig under €1,300 for local LLM inference, training, and AI development. Complete with parts list, assembly guide, Ubuntu setup, and remote access configuration. Ideal for students, researchers, and hobbyists wanting affordable AI hardware without cloud dependencies.
NVIDIA vGPU on a consumer GeForce RTX 3090 (GA102) via legacy mdev. Working config, the exact kernel requirement, ~80 measured dead ends, and a tool to port the fix to other driver builds. Fixes the runlist-disable leak behind 'Immediate pteblit timed out' and silent no-render guests.
🌐 Automate and manage BitBrowser tasks for efficient Google One student discount processing in one streamlined system.
GLM-5.3-Flash on 2× RTX 3090 + 128 GB RAM: full 256K context, up to 1,155 tok/s prefill · 47–50 tok/s decode. vLLM + ExLlamaV3 (EXL3 3.05 bpw) runtime with CPU expert offload, Docker, OpenAI-compatible API.
Full benchmark traces: Laguna S 2.1 INT4 vs DFlash speculative decoding on 4x RTX 3090 (vLLM 0.25, TP4, 96GB VRAM). 152 measurements, raw JSON + GPU telemetry.
PlantCare AI | High-performance Plant Disease Detection system optimized for RTX 3090. Identifies 38 diseases with 93% accuracy. Features a futuristic Glassmorphism UI, real-time diagnosis, and AI-driven treatment recommendations. 🌿🌱
poolside Laguna-S-2.1 INT4 + DFlash speculative decoding on 4x RTX 3090: 200K context, 282 tok/s peak decode, gate-proven with a 190K-token prompt. Full levers menu + failure catalog.
Windows GPU UNLOCK: RTX3090 UEFI port, Korean no-reset Windows boot guide, verified source and benchmark evidence
Qwen3.8 Flash Next on 4x RTX 3090: full-GPU PLE, CUDA Graph, IQ4_NL, 262K context, multimodal / 四卡3090部署优化
Reproducibly turn a compatible Swift-Qwen3.8-27B W4A16 checkpoint into a syv-optimised single-GPU fast variant: target-calibrated draft vocabulary, GPTQ int4 lm_head/MTP, structural verification, RTX 3090 benchmarks.
关于这个话题
- 清单取自 GitHub 话题页并按 Star 数排序,每次展示前 20 个项目;原始页面见 https://github.com/topics/rtx3090。
- 该话题在 GitHub 上共有 29 个仓库, 本站收录的是其中最热门的 20 个,不是全量列表。
- Star / Fork 每日自动刷新一次,实时数据以 GitHub 为准。
- 当前 20 个项目累计 5599 Star,覆盖 7 种主要语言,数据更新于 2026-11-10。
- 中文介绍来自 GitHub 官方话题说明(github/explore)的机器翻译,可点「查看原文」对照;译文缺失时会先展示原文。