mobile-inference 开源项目推荐（14 个）

cactus-compute /engine

面向手机、可穿戴设备、智能家居和机器人的量化、内核、运行时和推理引擎。

google /XNNPACK

High-efficiency floating-point neural network inference operators for mobile, server, and Web

software-mansion /react-native-executorch

High-performance, privacy-first on-device AI inference library for React Native, powered by PyTorch's ExecuTorch runtime

csarron /awesome-emdl

Embedded and mobile deep learning research resources

AndreiiArhire /LightMIS

LightMIS: Ultra-Lightweight Medical Image Segmentation Without a Stage-Wise Decoder

Abhinivesh2729 /Thinai

Thinai is a privacy-focused Android app that runs small language models locally on your device, with a local API for integrating and accessing on-device AI inference.

umitkacar /awesome-ncnn

NCNN Framework: High-performance neural network inference for mobile, embedded, and edge AI deployment.

umitkacar /awesome-mobile-ai

Mobile AI: iOS CoreML, Android TFLite, on-device inference, ONNX, TensorRT, and ML deployment for smartphones.

Data-Sapien /awesome-on-device-mobile-llms

Curated resource for mobile teams shipping on-device LLMs — runtime benchmarks, model picks, GDPR-friendly architecture, and real production use cases.

software-mansion-labs /react-native-executorch-gallery

On-device AI examples for React Native ExecuTorch - computer vision, LLMs, speech transcription & more.

wfloat /wfloat

On-device AI SDKs for Web, React Native, and Python.

Rplu2687 /awesome-on-device-mobile-llms

Ship production-ready large language models on Android and iOS devices using battle-tested guidance and technical resources.

MusaShams /Routide

Flash-backed mixture-of-experts inference on Apple devices with Swift/MLX.

matfeb /covid19_pocus_mobile

Open source mobile deep learning model for COVID-19 detection with POCUS