msvd 开源项目推荐（18 个）

ArrowLuo /CLIP4Clip

“CLIP 4剪辑：CLIP用于端到端视频剪辑检索的实证研究”的官方实现

xuguohai /X-CLIP

An official implementation for "X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval"

jssprz /video_captioning_datasets

Summary about Video-to-Text datasets. This repository is part of the review paper *Bridging Vision and Language from the Video-to-Text Perspective: A Comprehensive Review*

MikeWangWZHL /VidIL

Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners

nasib-ullah /video-captioning-models-in-Pytorch

A PyTorch implementation of state of the art video captioning models from 2015-2019 on MSVD and MSRVTT datasets.

tuyunbin /Video-Description-with-Spatial-Temporal-Attention

[ACM MM 2017 & IEEE TMM 2020] This is the Theano code for the paper "Video Description with Spatial Temporal Attention"

WingsBrokenAngel /Semantics-AssistedVideoCaptioning

Source code for Semantics-Assisted Video Captioning Model Trained with Scheduled Sampling Strategy

WingsBrokenAngel /delving-deeper-into-the-decoder-for-video-captioning

Source code for Delving Deeper into the Decoder for Video Captioning

jssprz /visual_syntactic_embedding_video_captioning

Source code of the paper titled *Improving Video Captioning with Temporal Composition of a Visual-Syntactic Embedding*

jssprz /video_features_extractor

Python implementation of extraction of several visual features representations from videos

jssprz /attentive_specialized_network_video_captioning

Source code of the paper titled *Attentive Visual Semantic Specialized Network for Video Captioning*

tuyunbin /Enhancing-the-Alignment-between-Target-Words-and-Corresponding-Frames-for-Video-Captioning

[Pattern Rcognition 2021] This is the Theano code for our paper "Enhancing the Alignment between Target Words and Corresponding Frames for Video Captioning".

suyash-chintawar /Spatio-Temporal-Attention-based-Video-Captioning

To build attention based encoder-decoder model for video captioning on the MSVD dataset

willyfh /msvd-indonesian

MSVD-Indonesian: A Benchmark for Multimodal Video-Text Tasks in Indonesian (Bahasa Indonesia).

HaydenFaulkner /Attributes_SVO_Video_Captioning

LSTM RNN and Transformer networks video captioning on MSVD and MSR-VTT using attributes and SVOS

Pandla-Vijay /Video-Captioning-using-Spatio-temporal-features-and-Gaussian-Attention

This project utilizes advanced deep learning techniques to automatically generate contextually relevant captions for videos by extracting spatial and temporal features, while incorporating Gaussian attention to focus on important regions. This enhances video indexing, retrieval, and accessibility for visually impaired individuals.

nasri-attari /text-to-video-retrieval

Zero-shot text-to-video retrieval using CLIP ViT-L/14 with multi-scale frame sampling and temporal attention, evaluated on MSVD

GregoryKogan /yt-framework-livecoding-demo

Demo pipeline on YT Framework and YTsaurus: list MSVD videos in S3, join captions, extract frames, and export ChatML training data at scale.