int8-inference 开源项目推荐（18 个）

anilsathyan7 /Portrait-Segmentation

面向移动设备的实时人像分割

DerryHub /BEVFormer_tensorrt

BEVFormer inference on TensorRT, including INT8 Quantization and Custom TensorRT Plugins (float/half/half2/int8).

BUG1989 /caffe-int8-convert-tools

Generate a quantization parameter file for ncnn framework int8 inference

jahongir7174 /YOLOv8-qat

Quantization Aware Training

Howell-Yang /onnx2trt

将端上模型部署过程中，常见的问题以及解决办法记录并汇总，希望能给其他人带来一点帮助。

whitelok /tensorrt-int8-python-sample

TensorRT Int8 Python version sample. TensorRT Int8 Python 实现例子。TensorRT Int8 Pythonの例です

ENOT-AutoDL /gpt-j-6B-tensorrt-int8

GPT-J 6B inference on TensorRT with INT-8 precision

ENOT-AutoDL /ENOT-transformers

该项目在 GitHub 上没有填写描述

JohnClaw /chatllm.vb

VB.NET api wrapper for llm-inference chatllm.cpp

JohnClaw /chatllm.cs

C# api wrapper for llm-inference chatllm.cpp

yester31 /TensorRT_ONNX

Generating tensorrt model using onnx

daniel-rychlewski /cnn-planesnet

Compressed CNNs for airplane classification in satellite images (APoZ-based parameter pruning, INT8 weight quantization)

JohnClaw /gemma-2-2b-it.cs

gemma-2-2b-it int8 cpu inference in one file of pure C#

g023 /xinf

g023's TurboXInf 🚀: 2x+ faster inference for Qwen3-1.77B or Qwen3.5-2B on RTX 3060! Custom Triton INT8 GEMV kernels halve memory traffic by fusing dequantization, paired with torch.compile. Hits 113 tok/s (vs 56.4 baseline) with no quality loss with INT8 even better results for INT4. MIT License.

Lamouchi-Bayrem /Physical-AI-FPGA-ROS2-Accelerator

The project combines VHDL RTL design, INT8 AI arithmetic, computer-vision preprocessing, motor control, safety mechanisms, and ROS 2 integration in one modular platform. Its purpose is to provide a practical learning and development environment for building hardware-accelerated Physical AI systems.

GoDiao /SparseFlow

Qwen3.6-first tiered-memory CPU inference for sparse expert models.

akashAD98 /yolov7_vino_with_object_tracking

it has support for openvino converted model of yolov7-int.xml ,yolov7x,

mseminatore /pyann

Python wrapper for the libann neural network library with a Keras-like API.