tinyllama 开源项目推荐（164 个）

mlc-ai /web-llm-chat

与浏览器中本地运行的人工智能大型语言模型聊天。享受私人、无服务器、无缝的人工智能对话。

TinyLLaVA /TinyLLaVA_Factory

小尺度大型多模态模型框架

rafaelmateo123 /Arena-of-Autonomous-Threads

Top AI Agent Simulator: Build a Local Reddit Forum for LLM Testing 2026

mikepapadim /llama-shepherd-cli

A CLI to manage install and configure llama inference implemenation in multiple languages

justADeni /intel-npu-llm

A simple Python script for running LLMs on Intel's Neural Processing Units (NPUs)

latestissue /AltaeraAI

一组 bash 脚本，用于在 Android - Termux 上借助 KoboldCpp 自动化部署 GGML/GGUF 模型 [默认：RWKV]

risvn /voice-assistant

A real-time offline voice-to-voice AI assistant built for Raspberry Pi

varun-soni-ai /RAG-Ollama-Chat-with-PDF

This application allows users to upload PDF files, process them, and ask questions about the content using a locally hosted language model. The system uses Retrieval-Augmented Generation (RAG) to provide accurate answers based on the uploaded PDFs.

SxryxnshS5 /onenm_local_llm

onenm_local_llm is a Flutter plugin that simplifies on-device language model inference on Android using llama.cpp. It removes the complexity of setting up native runtimes, model loading, and inference pipelines, so developers can integrate local AI into their apps through a simple API.

Vishal-sys-code /latent-trajectories

Trajectory Geometry of Transformer Representations Across Layers

rupeshs /ovllm_node_addon

OpenVINO LLM Node.js C++ addon

nmicic /int-llm

Integer-only LLM stack in pure C — run TinyLlama and train a tiny GPT in Q16.48 fixed-point, zero floating point. A reproducible fun experiment.

congmnguyen /viet-math-distillation

Vietnamese math reasoning distillation from Phi-3 to TinyLlama-1.1B using QLoRA and judge-filtered reasoning traces.

ankit1057 /sipllm

sipllm — a dependency-free streaming GGUF LLM inference engine in C++17. Runs quantized Llama models on-device with flat RAM (it sips weights off disk), Ollama-style CLI, validated layer-by-layer against llama.cpp.

yas-sim /openvino-llm-minimal-code

Most simple and minimal code to run an LLM chatbot from HuggingFace hub with OpenVINO

tezodipta /MindEase

MindEase is a mental health assistant that combines IoT hardware with AI to provide emotional support. It uses an ESP32 for audio input/output and integrates with AI models and cloud services for natural language understanding and response generation.

perfecxion-ai /banana-backdoor-demo

Educational research demonstrating weight manipulation attacks in SafeTensors models. Proves format validation alone is insufficient for AI model security.

Manishdatasci /ai-assistant-by-manish

An offline AI-powered chatbot built using Streamlit and TinyLlama. It responds to your messages in real-time without needing internet access. Great for experimenting with lightweight local language models.

Muneeb1030 /FineTune-Tiny-Llama

Fine-tuning the Tiny Llama model to mimic my professor's writing style using the Llama Factory. The project involves data collection, preprocessing, preparation, fine-tuning, and evaluation.

luboyang-a /qbb

Reproduction and exploration of QBB-based low-bit LLM quantization on TinyLlama, with 2-bit/4-bit experiments and WikiText-2 PPL evaluation.