SOTAVerified

Video Captioning

Video Captioning is a task of automatic captioning a video by understanding the action and event in the video which can help in the retrieval of the video efficiently through text.

Source: NITS-VC System for VATEX Video Captioning Challenge 2020

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 251–300 of 473 papers

TitleStatusHype
Motion Guided Region Message Passing for Video Captioning—0
Move Forward and Tell: A Progressive Generator of Video Descriptions—0
Evaluation of Automatic Video Captioning Using Direct Assessment—0
Enhancing Multimodal LLM for Detailed and Accurate Video Captioning using Multi-Round Preference Optimization—0
End-to-end Generative Pretraining for Multimodal Video Captioning—0
A Review of Deep Learning for Video Captioning—0
MSVD-Turkish: A Comprehensive Multimodal Dataset for Integrated Vision and Language Research in Turkish—0
A Restricted Visual Turing Test for Deep Scene and Event Understanding—0
End-to-end Dense Video Captioning as Sequence Generation—0
Activitynet 2019 Task 3: Exploring Contexts for Dense Captioning Events in Videos—0
End-to-end Dense Video Captioning as Sequence Generation—0
End-to-end Concept Word Detection for Video Captioning, Retrieval, and Question Answering—0
Multi-modal Dependency Tree for Video Captioning—0
Multi-Modal interpretable automatic video captioning—0
Multimodal Machine Learning: Integrating Language, Vision and Speech—0
Multimodal Machine Translation through Visuals and Speech—0
Multimodal Memory Modelling for Video Captioning—0
Encoder-Decoder Based Long Short-Term Memory (LSTM) Model for Video Captioning—0
Multimodal Semantic Attention Network for Video Captioning—0
Multi-Task Video Captioning with Video and Entailment Generation—0
Vatex Video Captioning Challenge 2020: Multi-View Features and Hybrid Reward Strategies for Video Captioning—0
MUTT: Metric Unit TesTing for Language Generation Tasks—0
VideoCoCa: Video-Text Modeling with Zero-Shot Transfer from Contrastive Captioners—0
Empirical Autopsy of Deep Video Captioning Frameworks—0
NarrativeBridge: Enhancing Video Captioning with Causal-Temporal Narrative—0
Nepali Video Captioning using CNN-RNN Architecture—0
E-MMAD: Multimodal Advertising Caption Generation Based on Structured Information—0
NITS-VC System for VATEX Video Captioning Challenge 2020—0
NMT-Keras: a Very Flexible Toolkit with a Focus on Interactive NMT and Online Learning—0
A Recipe for Scaling up Text-to-Video Generation with Text-free Videos—0
Normalized and Geometry-Aware Self-Attention Network for Image Captioning—0
Not All Words are Equal: Video-specific Information Loss for Video Captioning—0
O2NA: An Object-Oriented Non-Autoregressive Approach for Controllable Video Captioning—0
Object-aware Aggregation with Bidirectional Temporal Graph for Video Captioning—0
OVC-Net: Object-Oriented Video Captioning with Temporal Graph and Detail Enhancement—0
Object Relational Graph with Teacher-Recommended Learning for Video Captioning—0
DVCFlow: Modeling Information Flow Towards Human-like Video Captioning—0
Vision and Language: from Visual Perception to Content Creation—0
Dual-Level Decoupled Transformer for Video Captioning—0
OmniVL:One Foundation Model for Image-Language and Video-Language Tasks—0
On Flow Profile Image for Video Representation—0
On Scaling Up a Multilingual Vision and Language Model—0
Open-book Video Captioning with Retrieve-Copy-Generate Network—0
Optimizing Latency for Online Video CaptioningUsing Audio-Visual Transformers—0
An Integrated Approach for Video Captioning and Applications—0
Visual-aware Attention Dual-stream Decoder for Video Captioning—0
Diverse Video Captioning Through Latent Variable Expansion—0
Discourse Analysis for Evaluating Coherence in Video Paragraph Captions—0
Directed Domain Fine-Tuning: Tailoring Separate Modalities for Specific Training Tasks—0
PIC 4th Challenge: Semantic-Assisted Multi-Feature Encoding and Multi-Head Decoding for Dense Video Captioning—0
Show:102550
← PrevPage 6 of 10Next →
All datasetsMSR-VTTMSVDYouCook2VATEXActivityNet CaptionsMSRVTT-CTNMSVD-CTNHindi MSR-VTTTVCChinaOpen-1kMSVD-IndonesianShot2Story20K

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1mPLUG-2CIDEr80—Unverified
2VASTCIDEr78—Unverified
3GIT2CIDEr75.9—Unverified
4VLABCIDEr74.9—Unverified
5COSACIDEr74.7—Unverified
6VALORCIDEr74—Unverified
7MaMMUT (ours)CIDEr73.6—Unverified
8VideoCoCaCIDEr73.2—Unverified
9RTQCIDEr69.3—Unverified
10HowToCaptionCIDEr65.3—Unverified
#ModelMetricClaimedVerifiedStatus
1MaMMUTCIDEr195.6—Unverified
2VLABCIDEr179.8—Unverified
3COSACIDEr178.5—Unverified
4VALORCIDEr178.5—Unverified
5mPLUG-2CIDEr165.8—Unverified
6HowToCaptionCIDEr154.2—Unverified
7HiTeACIDEr146.9—Unverified
8Vid2SeqCIDEr146.2—Unverified
9VIOLETv2CIDEr139.2—Unverified
10RTQCIDEr123.4—Unverified
#ModelMetricClaimedVerifiedStatus
1VASTBLEU-418.2—Unverified
2UniVL + MELTRBLEU-417.92—Unverified
3UniVLBLEU-417.35—Unverified
4VideoCoCaBLEU-414.2—Unverified
5VLMBLEU-412.27—Unverified
6E2vidD6-MASSvid-BiDBLEU-412.04—Unverified
7TextKGBLEU-411.7—Unverified
8COOTBLEU-411.3—Unverified
9COSABLEU-410.1—Unverified
10HowToCaptionBLEU-48.8—Unverified
#ModelMetricClaimedVerifiedStatus
1VALORBLEU-445.6—Unverified
2VASTBLEU-445—Unverified
3COSABLEU-443.7—Unverified
4VideoCoCaBLEU-439.7—Unverified
5IcoCap (ViT-B/16)BLEU-437.4—Unverified
6IcoCap (ViT-B/32)BLEU-436.9—Unverified
7VASTA (Kinetics-backbone)BLEU-436.25—Unverified
8CoCap (ViT/L14)BLEU-435.8—Unverified
9ORG-TRLBLEU-432.1—Unverified
10NITS-VCBLEU-420—Unverified
#ModelMetricClaimedVerifiedStatus
1VideoCoCaBLEU414.7—Unverified
2VLTinT (ae-test split) C3D/LingBLEU414.5—Unverified
3VLCap (ae-test split) - Appearance + LanguageBLEU413.38—Unverified
4COOT (ae-test split) - Only Appearance featuresBLEU410.85—Unverified
5MART (ae-test split) - Appearance + FlowBLEU410.33—Unverified
#ModelMetricClaimedVerifiedStatus
1CENCIDEr49.87—Unverified
2GITCIDEr32.43—Unverified
3SEM-POSCIDEr26.01—Unverified
4AKGNNCIDEr25.9—Unverified
#ModelMetricClaimedVerifiedStatus
1CENCIDEr63.51—Unverified
2GITCIDEr45.63—Unverified
3SEM-POSCIDEr37.16—Unverified
4AKGNNCIDEr35.08—Unverified
#ModelMetricClaimedVerifiedStatus
1SBD_KeyframeBLEU441.01—Unverified
2V+S-Att-basedBLEU436.2—Unverified
#ModelMetricClaimedVerifiedStatus
1VASTBLEU-419.9—Unverified
2COSABLEU-418.8—Unverified
#ModelMetricClaimedVerifiedStatus
1GVTBLEU417.7—Unverified
#ModelMetricClaimedVerifiedStatus
1VNS-GRU (Cross-Lingual)BLEU-458.68—Unverified
#ModelMetricClaimedVerifiedStatus
1Shot2StoryCIDEr37.4—Unverified
#ModelMetricClaimedVerifiedStatus
1Vid2SeqCIDEr120.5—Unverified