inference-api 开源项目推荐（157 个）

roboflow /inference

将任何计算机或边缘设备变成你计算机视觉项目的指挥中心。

qualcomm /ai-hub-models

Qualcomm® AI Hub Models 是我们的一系列先进机器学习模型，针对性能（延迟、内存等）进行了优化，并可直接部署在 Qualcomm® 设备上。

basetenlabs /truss

The simplest way to serve AI/ML models in production

qualcomm /ai-hub-apps

The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

inference-gateway /inference-gateway

An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

Michael-OvO /Yolov7-Flask

A Beautiful Flask Web API for Yolov7 (and custom) models

mustafamerttunali /deep-learning-training-gui

Train and predict your model on pre-trained deep learning models through the GUI (web app). No more many parameters, no more data preprocessing.

pszemraj /textsum

CLI & Python API to easily summarize text-based files with transformers

YoannDev90 /awesome-free-ai-api

A list of 80 APIs providing AI models, free of charge, no credit card needed. Regular updates.

BMW-InnovationLab /BMW-Classification-Training-GUI

This repository allows you to get started with training a State-of-the-art Deep Learning model with little to no configuration needed! You provide your labeled dataset and you can start the training right away. You can even test your model with our built-in Inference REST API. Training classification models with GluonCV has never been so easy.

intelligencedev /eternal

Eternal is an experimental platform for machine learning models and workflows.

hupe1980 /go-huggingface

🤗 Hugging Face Inference Client written in Go

BMW-InnovationLab /BMW-Classification-Inference-GPU-CPU

This is a repository for an image classification inference API using the Gluoncv framework. The inference REST API works on CPU/GPU. It's supported on Windows and Linux Operating systems. Models trained using our Gluoncv Classification training repository can be deployed in this API. Several models can be loaded and used at the same time.

TommyLemon /CVAuto

👁 零代码零标注 CV AI 自动化测试工具 🚀 免除大量人工画框和打标签等，直接零代码快速自动化测试 CV 计算机视觉 AI 人工智能图像识别算法：行人检测、动植物分类、人脸识别、OCR 车牌识别、旋转校正、舞蹈姿态、抠图分割 等，还可一键 下载测试报告、导出训练和测试数据集

RightNow-AI /TIDE

Dynamic per-token early exit for LLM inference. Skip layers tokens don't need

Prismadic /magnet

the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly

stephanj /Llama3JavaChatCompletionService

Llama3.java Inference engine with OpenAI Chat Completion REST API/

CoreyLeath-code /Facial-Emotion-Recognition-System

PyTorch/FastAPI facial-expression classification research scaffold with reproducible evaluation contracts, CI/security automation, versioned releases, and explicit TBD model-quality metrics.

OBA-Research /VAAS

VAAS is an inference-first, research-driven library for image integrity analysis. It integrates Vision Transformer Attention Mechanisms with patch-level self-consistency analysis to enable fine-grained localization and detection of visual inconsistencies across diverse image analysis tasks.

TimMikeladze /huggingface

Typescript wrapper for the Hugging Face Inference API.