ondeviceai 开源项目推荐（24 个）

ashvardanian /SwiftSemanticSearch

使用USearch和UForm AI Swift SDK为苹果设备🍏提供实时设备文本转图像和图像间语义搜索，配合视频流摄像头捕捉

wladimiravila /esp32s3-distributed-ai

Distributed 56M-parameter LLM inference across 3 ESP32-S3 boards via ESP-NOW , Split-PLE + KV cache, fully offline.

rajveer43 /VeloxQuant-MLX

Fast KV-cache quantization for Apple Silicon (MLX) — 43 research-adapted compression methods with Metal kernels

1adrianb /expert-binary-networks

Code for High-Capacity Expert Binary Networks (ICLR 2021).

dinoy-raj /gemini-nano-playground

Experimental Android app designed to showcase Android's Built In on-device AI. Utilises the Gen-AI Prompt API to interface locally with Google's Gemini Nano model, featuring a modern architecture built entirely in Kotlin and Jetpack Compose.

krit-vardhan-mishra /SyncTax

Privacy first Android music player & recommender with on-device ML and YouTube Music support.

christofilojohn /MacVisionTools

A Mac OS menu bar utility that runs on-device Computer Vision models for simple, fun tasks

hyodotdev /locanara

On-device AI framework inspired by LangChain, purpose-built for mobile. Build, compose, and extend AI features using platform-native models — all processing happens locally on the device.

drk-m-s /on_device_asr-llm-tts

demo for a lightning fast on-device ASR-LLM-TTS chatbot

zhangshi0512 /SlideSpeak

Text to PPT & Speech Generator

imec-nu /PELM

[SenSys '26] PELM: Power Efficient On-Device LLM Inference with Speculative Decoding and Dynamic Voltage Frequency Scaling

jhaabhijeet864 /My_Kanha_Project

It's an embodiment of Kanha (Krishna), in your mobile applications, to gain knopwledge about Gita, and talk directly to the image of Kanha himself.

zeyneddinoz /subMFL

subMFL: Compatible subModel Generation for Federated Learning in Device Heterogeneous Environment

BapNesS /android-LocalAI

Android LocalAI is an Android application that allows you to use generative AI models locally or remotely via APIs. This project is designed to be flexible, secure, and easy to configure.

S-k-Srivastava /SerenAI

SerenAI is a self-hosted AI chatbot platform that turns your documents into intelligent conversational assistants. Upload PDFs, Word docs, or text files—and instantly create chatbots that can answer questions about your content using RAG (Retrieval-Augmented Generation).

k-ashix /edu-babu

A local-first, privacy-respecting AI study companion

sg2technologies /safeprompt_agent

On-device DLP security for AI prompts and file uploads. Scan, mask, warn, or block sensitive data before it reaches AI tools.

Vibhu1710 /AutoDel

Flutter based Photo Gallery Mobile App offering auto suggestions for deleting non-essential images on the device

BlackwellGPT /Blackwell-GPT-App

BlackwellGPT uses a cloud or on-device large language model (Llama 2) to increase the accessibility of basic medical information even in areas with limited internet connectivity.

vijay033 /OnDevice_Sentiment-Analysis

Sentiment Data Training and Testing On Mobile Phone