avsr 开源项目推荐（11 个）

amanvirparhar /chaplin

一种实时无声语音识别工具。

georgesterpu /avsr-tf1

Audio-Visual Speech Recognition using Sequence to Sequence Models

joannahong /AV-RelScore

Audio-Visual Corruption Modeling of our paper "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling and Reliability Scoring" in CVPR23

Exgc /OpenSR

The official implementation of OpenSR (ACL2023 Oral)

SMIL-SPCRAS /DAVIS

Official repo for "Audio-Visual Speech Recognition In-the-Wild: Multi-Angle Vehicle Cabin Corpus and Attention-based Method" in ICASSP 2024

hmeutzner /kaldi-avsr

Kaldi-based audio-visual speech recognition

loganngarcia /chaplin-ui

用于实时无声语音识别工具的Web界面。

Pol-Buitrago /SynthAVSR

🚀 SynthAVSR is a research framework for training and evaluating audiovisual speech recognition (AVSR) models using synthetic data — with a focus on low-resource languages like Spanish and Catalan.

Mahmood-Anaam /msp

A multimodal speech perception models that converts and understands speech to text through audio and lip-reading signals

AnhVan17 /MOTA-AVSR-Monotone-Optimal-Transport-Alignment-for-AVSR

SOTA

sodonne6 /Data_Augmentation_for_AVSR

Preprocessing and multimodal augmentation code for AV-HuBERT-based audio-visual speech recognition, including interpolation-based offsets and viseme-aware blurring.