ondevice-ai 话题在 GitHub 上没有填写简介，这里按 Star 数汇总最相关的热门仓库。
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.
Android专用设备内AI套件。Google AI Edge Gallery 分支，支持llama.cpp、whisper.cpp、stable-diffusion.cpp、GGUF 导入、语音聊天、视觉 AI、设备内图像生成、生物识别锁、加密历史记录以及 CPU/NPU/GPU 加速。
A free photo editor. No account, no subscription, no tracking. RAW, masks and on-device AI for macOS, Windows and Linux. Self-hostable.
🎨 Multiplatform AI image generation app powered by Stable Diffusion • Built with Kotlin Multiplatform & Compose • Supports SDXL, FLUX, SD3 & more • Native performance via C++/JNI • Android/iOS & Desktop ready
Runtime protection for AI agents
Distributed 56M-parameter LLM inference across 3 ESP32-S3 boards via ESP-NOW , Split-PLE + KV cache, fully offline.
All-in-one offline document viewer for Android with OCR and desktop-class rendering — private, open-source, zero tracking
Android application allows you to use ai on device
A high-performance, private, on-device AI chat client built with Flutter. AstraLM runs Large Language Models (LLMs) and Vision models 100% locally on device hardware (CPU & GPU) with zero data leaving your phone.(until you choose to use cloud model which is completely OPTIONAL)
Private. Local. Yours. Cross-platform On-device LLM & Agent Client powered by LiteRT-LM & Compose Multiplatform.
AI-powered disaster response platform with offline-first architecture using Gemma 3n. Provides computer vision hazard detection, voice analysis with emergency keywords, PDF report generation, and multi-user coordination - all working without internet access.
Rust bindings for Qualcomm GenieX SDK - Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code.
tacit is a Free, On-Device/Local macOS app that listens as you talk and turns it into notes your AI can search
Online Self-Distillation Fine-Tuning (SDFT) for Small Language Models (SLM)
Curated resource for mobile teams shipping on-device LLMs — runtime benchmarks, model picks, GDPR-friendly architecture, and real production use cases.
On-device AI framework inspired by LangChain, purpose-built for mobile. Build, compose, and extend AI features using platform-native models — all processing happens locally on the device.
UMC 동아리 운영 iOS 앱 — 출석·스터디·커리큘럼 관리. SwiftUI, Clean Architecture, 모듈화.
[SenSys '26] PELM: Power Efficient On-Device LLM Inference with Speculative Decoding and Dynamic Voltage Frequency Scaling
On-device DPO + QLoRA fine-tuning pipeline to ground a SLM in oil-and-gas jargons. Cloudera AMP: https://cloudera.github.io/Applied-ML-Prototypes/#/community
该项目在 GitHub 上没有填写描述