multimodel-large-language-model 开源项目推荐（22 个）

FlagOpen /RoboBrain2.5

RoboBrain 2.5: Advanced version of RoboBrain. Depth in Sight, Time in Mind. 🎉🎉🎉

JIA-Lab-research /Seg-Zero

Project Page For "Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement"

jqtangust /Robust-R1

🔥🔥🔥[AAAI 2026 Oral] Official Implementation of Robust-R1: Degradation-Aware Reasoning for Robust Visual Understanding

sun-hailong /TVC

[ACL 2025] “Mitigating Visual Forgetting via Take-along Visual Conditioning for Multi-modal Long CoT Reasoning”的 PyTorch 代码仓库。

theboringhumane /echoOLlama

🦙 echoOLlama: A real-time voice AI platform powered by local LLMs. Features WebSocket streaming, voice interactions, and OpenAI API compatibility. Built with FastAPI, Redis, and PostgreSQL. Perfect for private AI conversations and custom voice assistants.

BIGBALLON /BeyondCLIP

这不是一份中立的调查——而是为制造、培训和生产规模多模式检索的工程师准备的实地手册。C-L-I三角（压缩·定位 ·指令）、MLLM编码器与晚期互动、MUVERA经济学以及2030年前可证伪预测。

xinyanghuang7 /Basic-Visual-Language-Model

Build a simple basic multimodal large model from scratch. 从零搭建一个简单的基础多模态大模型🤖

sherifican /Agent-FleetOps

Operational tooling & discipline for multi-agent AI engineering fleets — mutation-proven guards, a Textual terminal monitor, generalized skills, and specs. Every check ships with proof it can fail.

SufyanDanish /VLM-Survey-

A comprehensive survey of Vision–Language Models: Pretrained models, fine-tuning, prompt engineering, adapters, and benchmark datasets

zhangguanghao523 /CMMCoT

[AAAI'26] Official implementation of CMMCoT: Enhancing Complex Multi-Image Comprehension via Multi-Modal Chain-of-Thought and Memory Augmentation

Jiahao000 /SSL-R1

[ACMMM 2026 Oral] SSL-R1: Self-Supervised Visual Reinforcement Post-Training for Multimodal Large Language Models

balaji1233 /AI-Radiology-Reporting

Using MAIRA-2 multimodal transformer designed for the generation of grounded or non-grounded radiology reports from chest X-rays.

ramihuunguyen /LLMP2

Evaluating ‘Graphical Perception’ with Multimodal Large Language Models

mubashir1837 /Luma-Health

Multi-Modal Healthcare Assistant

264Gaurav /gemma-image-text-ai

Gemma3 Vision - AI Image Analysis & Chat

iamafridi /elaMath

ElaMath is a smart, voice-enabled math assistant that helps students solve and understand math problems using both spoken questions and images. It’s powered by the powerful multimodal meta-llama/llama-4-scout-17b-16e-instruct model via Groq API, combined with Whisper for speech recognition and ElevenLabs/gTTS for natural voice responses.

iamafridi /elarova-2.0

Elarova — A smart, multimodal research assistant designed to help students by combining speech, text, and other input modes for efficient academic research and study support. Powered by state-of-the-art speech recognition, text-to-speech, and AI models, including meta-llama/llama-4-scout-17b-16e-instruct, with an easy-to-use Gradio web interface.

Nileshsan /Digital-product-feature-multimodel-large-language-model

Create a tool that uses a multimodal LLM to describe testing instructions for any digital product's features, based on the screenshots.

KuchikiRenji /llmchat

LLMChat is an open-source, privacy-first AI chatbot (powering LLMChat.co). It’s a Next.js + TypeScript monorepo that gives you one interface for multiple LLMs (OpenAI, Anthropic, Google, Groq, Ollama, etc.) with Deep Research and Pro Search modes, optional auth and credits and local-first storage (IndexedDB) so chat history stays in the browser.

hmshb /langchain-google-gemini-integration

This repo contains integration of LangChain with Google Gemini LLM