SOTAVerified

Video Captioning

Video Captioning is a task of automatic captioning a video by understanding the action and event in the video which can help in the retrieval of the video efficiently through text.

Source: NITS-VC System for VATEX Video Captioning Challenge 2020

Papers

Showing 401450 of 473 papers

TitleStatusHype
Bridging Vision and Language: Modeling Causality and Temporality in Video Narratives0
Understanding Action Sequences based on Video Captioning for Learning-from-Observation0
Bridge Video and Text with Cascade Syntactic Structure0
Boosting Video-Text Retrieval with Explicit High-Level Semantics0
Boosting Video Representation Learning with Multi-Faceted Integration0
Boosting Video Captioning with Dynamic Loss Network0
Bidirectional Multirate Reconstruction for Temporal Modeling in Videos0
Variational Stacked Local Attention Networks for Diverse Video Captioning0
Bidirectional Long-Short Term Memory for Video Description0
Beyond Caption To Narrative: Video Captioning With Multiple Sentences0
VATEX Captioning Challenge 2019: Multi-modal Information Fusion and Multi-stage Training Strategy for Video Captioning0
Vector Learning for Cross Domain Representations0
VersaVid-R1: A Versatile Video Understanding and Reasoning Model from Question Answering to Captioning Tasks0
Best Vision Technologies Submission to ActivityNet Challenge 2018-Task: Dense-Captioning Events in Videos0
ViCaS: A Dataset for Combining Holistic and Pixel-level Video Understanding using Captions with Grounded Segmentation0
Empowering LLMs with Pseudo-Untrimmed Videos for Audio-Visual Temporal Understanding0
Automatic Generation of Descriptive Titles for Video Clips Using Deep Learning0
Auto-captions on GIF: A Large-scale Video-sentence Dataset for Vision-language Pre-training0
Attract me to Buy: Advertisement Copywriting Generation with Multimodal Multi-structured Information0
Attention is all you need for Videos: Self-attention based Video Summarization using Universal Transformers0
AdaCM^2: On Understanding Extremely Long-Term Video with Adaptive Cross-Modality Memory Reduction0
Video Captioning: a comparative review of where we are and which could be the route0
Video Captioning in Compressed Video0
Video Captioning Using Weak Annotation0
Video Captioning via Hierarchical Reinforcement Learning0
Video Captioning with Aggregated Features Based on Dual Graphs and Gated Fusion0
Video Captioning with Boundary-aware Hierarchical Language Decoding and Joint Video Prediction0
Video Captioning with Guidance of Multimodal Latent Topics0
Video Captioning with Multi-Faceted Attention0
Attention based video captioning framework for Hindi0
Video Captioning with Text-based Dynamic Attention and Step-by-Step Learning0
Video Captioning with Transferred Semantic Attributes0
Attention Based Encoder Decoder Model for Video Captioning in Nepali (2023)0
Graph Similarities and Dual Approach for Sequential Text-to-Image Retrieval0
Grounded Objects and Interactions for Video Captioning0
Global2Local: A Joint-Hierarchical Attention for Video Captioning0
GUI Action Narrator: Where and When Did That Action Take Place?0
Guidance Module Network for Video Captioning0
Guiding the Flowing of Semantics: Interpretable Video Captioning via POS Tag0
Get In Video: Add Anything You Want to the Video0
Generative Adversarial Network Applications in Creating a Meta-Universe0
Generating Video Descriptions with Topic Guidance0
Hierarchical Banzhaf Interaction for General Video-Language Representation Learning0
Hierarchical Boundary-Aware Neural Encoder for Video Captioning0
Hierarchical LSTMs with Adaptive Attention for Visual Captioning0
Hierarchical LSTM with Adjusted Temporal Attention for Video Captioning0
Hierarchical memory decoder for visual narrating0
Hierarchical Memory Decoding for Video Captioning0
Exploiting Auxiliary Caption for Video Grounding0
Hierarchical Multimodal Transformer to Summarize Videos0
Show:102550
← PrevPage 9 of 10Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1mPLUG-2CIDEr80Unverified
2VASTCIDEr78Unverified
3GIT2CIDEr75.9Unverified
4VLABCIDEr74.9Unverified
5COSACIDEr74.7Unverified
6VALORCIDEr74Unverified
7MaMMUT (ours)CIDEr73.6Unverified
8VideoCoCaCIDEr73.2Unverified
9RTQCIDEr69.3Unverified
10HowToCaptionCIDEr65.3Unverified
#ModelMetricClaimedVerifiedStatus
1MaMMUTCIDEr195.6Unverified
2VLABCIDEr179.8Unverified
3COSACIDEr178.5Unverified
4VALORCIDEr178.5Unverified
5mPLUG-2CIDEr165.8Unverified
6HowToCaptionCIDEr154.2Unverified
7HiTeACIDEr146.9Unverified
8Vid2SeqCIDEr146.2Unverified
9VIOLETv2CIDEr139.2Unverified
10RTQCIDEr123.4Unverified
#ModelMetricClaimedVerifiedStatus
1VASTBLEU-418.2Unverified
2UniVL + MELTRBLEU-417.92Unverified
3UniVLBLEU-417.35Unverified
4VideoCoCaBLEU-414.2Unverified
5VLMBLEU-412.27Unverified
6E2vidD6-MASSvid-BiDBLEU-412.04Unverified
7TextKGBLEU-411.7Unverified
8COOTBLEU-411.3Unverified
9COSABLEU-410.1Unverified
10HowToCaptionBLEU-48.8Unverified
#ModelMetricClaimedVerifiedStatus
1VALORBLEU-445.6Unverified
2VASTBLEU-445Unverified
3COSABLEU-443.7Unverified
4VideoCoCaBLEU-439.7Unverified
5IcoCap (ViT-B/16)BLEU-437.4Unverified
6IcoCap (ViT-B/32)BLEU-436.9Unverified
7VASTA (Kinetics-backbone)BLEU-436.25Unverified
8CoCap (ViT/L14)BLEU-435.8Unverified
9ORG-TRLBLEU-432.1Unverified
10NITS-VCBLEU-420Unverified
#ModelMetricClaimedVerifiedStatus
1VideoCoCaBLEU414.7Unverified
2VLTinT (ae-test split) C3D/LingBLEU414.5Unverified
3VLCap (ae-test split) - Appearance + LanguageBLEU413.38Unverified
4COOT (ae-test split) - Only Appearance featuresBLEU410.85Unverified
5MART (ae-test split) - Appearance + FlowBLEU410.33Unverified
#ModelMetricClaimedVerifiedStatus
1CENCIDEr49.87Unverified
2GITCIDEr32.43Unverified
3SEM-POSCIDEr26.01Unverified
4AKGNNCIDEr25.9Unverified
#ModelMetricClaimedVerifiedStatus
1CENCIDEr63.51Unverified
2GITCIDEr45.63Unverified
3SEM-POSCIDEr37.16Unverified
4AKGNNCIDEr35.08Unverified
#ModelMetricClaimedVerifiedStatus
1SBD_KeyframeBLEU441.01Unverified
2V+S-Att-basedBLEU436.2Unverified
#ModelMetricClaimedVerifiedStatus
1VASTBLEU-419.9Unverified
2COSABLEU-418.8Unverified
#ModelMetricClaimedVerifiedStatus
1GVTBLEU417.7Unverified
#ModelMetricClaimedVerifiedStatus
1VNS-GRU (Cross-Lingual)BLEU-458.68Unverified
#ModelMetricClaimedVerifiedStatus
1Shot2StoryCIDEr37.4Unverified
#ModelMetricClaimedVerifiedStatus
1Vid2SeqCIDEr120.5Unverified