multimodal-fusion 开源项目推荐（143 个）

sstary /SSRS

面向遥感的语义分割

icey-zhang /SuperYOLO

SuperYOLO is accepted by TGRS

v-modal /vmodal_sdk_robotics

机器人视觉 SDK

mahmoodlab /MCAT

Multimodal Co-Attention Transformer for Survival Prediction in Gigapixel Whole Slide Images - ICCV 2021

v-iashin /BMT

Source code for "Bi-modal Transformer for Dense Video Captioning" (BMVC 2020)

declare-lab /Multimodal-Infomax

This repository contains the official implementation code of the paper Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis, accepted at EMNLP 2021.

ForeverBlue816 /PhysioWave

[NeurIPS 2025] PhysioWave 与 PhysioWave-T：面向 EEG、ECG 和 sEMG 的令牌高效小波基础模型，具备可靠性感知的多模态融合。

thuiar /MIntRec

MIntRec: A New Dataset for Multimodal Intent Recognition (ACM MM 2022)

icey-zhang /E2E-MFD

E2E-MFD-OOD

Wenchuan-Zhang /Patho-AgenticRAG

[AAAI-2026] Patho-AgenticRAG: Towards Multimodal Agentic Retrieval-Augmented Generation for Pathology VLMs via Reinforcement Learning

akashe /Multimodal-action-recognition

基于多模态输入选择动作的代码。此处的输入为语音和文本。

open-edge-platform /scenescape

Multimodal object tracking and scene analytics for highly actionable, real-world contextualized data

ai-forever /fusion_brain_aij2021

Creating multimodal multitask models

declare-lab /hfusion

Multimodal sentiment analysis using hierarchical fusion with context modeling

gholste /breast_mri_fusion

[CVAMD 2021] "End-to-End Learning of Fused Image and Non-Image Feature for Improved Breast Cancer Classification from MRI"

Asichurter /MalFusionFSL

Few-Shot malware classification using fused features of static analysis and dynamic analysis （基于静态+动态分析的混合特征的小样本恶意代码分类框架）

brightest66 /InfMasking

[TPAMI 2026 | NeurIPS 2025 Spotlight] Official implementation of "InfMasking, a unified framework for supervised and unsupervised synergistic multimodal learning."

albrateanu /ModalFormer

[2025] ModalFormer: Multimodal Transformer for Low-Light Image Enhancement

shengyangsun /MSBT

Official implementation of "Multi-scale Bottleneck Transformer for Weakly Supervised Multimodal Violence Detection"

imadhou /multimodal-sentiment-analysis

Multimodal sentiment analysis