multimodal-deep-learning 开源项目推荐（606 个）

salesforce /LAVIS

LAVIS——面向语言-视觉智能的一站式库

AI4Finance-Foundation /FinRobot

FinRobot：基于大语言模型的金融应用开源 AI Agent 平台

KimMeen /Time-LLM

[ICLR 2024] Official implementation of " 🦙 Time-LLM: Time Series Forecasting by Reprogramming Large Language Models"

Yutong-Zhou-cv /Awesome-Text-to-Image

(ෆ`꒳´ෆ) A Survey on Text-to-Image Generation/Synthesis.

kyegomez /BitNet

Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch

AlibabaResearch /AdvancedLiterateMachinery

面向 Advanced Literate Machinery 的原创、创新想法与算法集合。本项目由阿里巴巴集团通义实验室语言技术实验室 OCR 团队维护。

jrzaurin /pytorch-widedeep

一个灵活的多模态深度学习包，使用 Pytorch 中的 Wide and Deep 模型将表格数据与文本和图像结合

DWCTOD /CVPR2024-Papers-with-Code-Demo

收集 CVPR 最新的成果，包括论坛、代码和演示视频等，欢迎大家推荐！收集最新的CVPR（计算机视觉与模式识别会议）成果，包括论文、代码、演示视频等，并欢迎大家推荐！

yuewang-cuhk /awesome-vision-language-pretraining-papers

视觉和语言预训练模型（VL-Ptms）的最新进展

TheShadow29 /awesome-grounding

awesome grounding: A curated list of research papers in visual grounding

richard-peng-xia /awesome-multimodal-in-medical-imaging

A collection of resources on applications of multi-modal learning in medical imaging.

declare-lab /multimodal-deep-learning

This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.

omriav /blended-latent-diffusion

Official implementation for "Blended Latent Diffusion" [SIGGRAPH 2023]

MMMU-Benchmark /MMMU

This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"

remyxai /VQASynth

Compose multimodal datasets 🎹

Correr-Zhou /OmniShow

[ICML 2026] ByteDance's All-in-One Video Generation Model for Human-Object Interaction Video Generation

kyegomez /Med-PaLM

Towards Generalist Biomedical AI

theislab /scarches

单细胞基因组学的参考图谱

jianghaojun /Awesome-Parameter-Efficient-Transfer-Learning

A collection of parameter-efficient transfer learning papers focusing on computer vision and multimodal domains.

fcakyon /content-moderation-deep-learning

Deep learning based content moderation from text, audio, video & image input modalities.