inference-framework 开源项目推荐（12 个）

ai-techsystems /deepC

vendor independent TinyML deep learning library, compiler and inference framework microcomputers and micro-controllers

harleyszhang /dl_note

深度学习系统笔记，包含深度学习数学基础知识、神经网络基础部件详解、深度学习炼丹策略、模型压缩算法详解。

grctest /Electron-BitNet

Running Microsoft's BitNet via Electron, React & Astro

MedFlow2025 /medflow

Qingnang Smart Diagnosis is an end-to-end AI healthcare framework with field-proven application capabilities, designed to provide efficient and intelligent solutions for the medical industry.

SongQiPing /KuiperInfer_rs

使用 Rust 语言重新实现 https://github.com/zjhellofss/KuiperInfer 和 https://github.com/zjhellofss/kuiperdatawhale 中的深度学习推理框架。

dbiswas55 /vlmhub

A lightweight, config-driven framework for unified vision-language model inference across local and cloud backends, built on LiteLLM and Transformers.

tuanhe /ArmnnBackendFramework

This is the Framework used for developing ArmNN backend. It can compiled without error under armnn_21_05

huaweicloud-samples /ai-ollama-image

该项目在 GitHub 上没有填写描述

sanbuphy /awesome-nano-mini-deepinfer-everything-anything

deepinfer: high-performance, large-scale keyword engineering for deepseek models. nano, mini, awesome, everything, anything. implementation: todo.

hrf666666 /deepinfer-iluvatar

DeepInfer 推理框架的 Iluvatar BI-V150 / CoreX 第三后端移植 — port of the DeepInfer inference framework as a third accelerator backend (DEEPINFER_ACCELERATOR=iluvatar)

Mk9207 /Constructive-Causal-Integration-Framework-

A constructive framework that systematically integrates causal structures across domains, enabling adaptive reasoning, predictive modeling, and cross-contextual understanding in AI and data systems. 構成的因果統合理論は、因果構造を領域横断的に統合し、AIやデータシステムにおける適応的推論・予測モデリング・文脈横断的理解を可能にする枠組みです。

huaweicloud-samples /ai-llama.cpp-image

该项目在 GitHub 上没有填写描述