SOTAVerified

Video Captioning

Video Captioning is a task of automatic captioning a video by understanding the action and event in the video which can help in the retrieval of the video efficiently through text.

Source: NITS-VC System for VATEX Video Captioning Challenge 2020

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 201–250 of 473 papers

TitleStatusHype
Syntax Customized Video Captioning by Imitating Exemplar SentencesCode0
Temporal Deformable Convolutional Encoder-Decoder Networks for Video CaptioningCode0
Temporal Tessellation: A Unified Approach for Video AnalysisCode0
Top-down Visual Saliency Guided by CaptionsCode0
Towards Automatic Learning of Procedures from Web Instructional VideosCode0
Tragedy Plus Time: Capturing Unintended Human Activities from Weakly-labeled VideosCode0
Translating Videos to Natural Language Using Deep Recurrent Neural NetworksCode0
VideoBERT: A Joint Model for Video and Language Representation LearningCode0
Video Description using Bidirectional Recurrent Neural NetworksCode0
Video Summarization: Towards Entity-Aware CaptionsCode0
Visual Transformation TellingCode0
VLM: Task-agnostic Video-Language Model Pre-training for Video UnderstandingCode0
Watch, Listen, and Describe: Globally and Locally Aligned Cross-Modal Attentions for Video CaptioningCode0
Knowledge Guided Entity-aware Video Captioning and A Basketball Benchmark—0
Fine-Grained Video Captioning for Sports Narrative—0
LASER: A Neuro-Symbolic Framework for Learning Spatial-Temporal Scene Graphs with Weak Supervision—0
Fine-grained length controllable video captioning with ordinal embeddings—0
Rethinking and Improving Natural Language Generation with Layer-Wise Multi-View Decoding—0
Learning Actions from Human Demonstration Video for Robotic Manipulation—0
Learning Audio-Video Modalities from Image Captions—0
FINECAPTION: Compositional Image Captioning Focusing on Wherever You Want at Any Granularity—0
Learning Interactive Real-World Simulators—0
Fill-in-the-Blank: A Challenging Video Understanding Evaluation Framework—0
Learning to Compose Topic-Aware Mixture of Experts for Zero-Shot Video Captioning—0
Fighting FIRe with FIRE: Assessing the Validity of Text-to-Video Retrieval Benchmarks—0
Exploring the Role of Audio in Video Captioning—0
Less Is More: Picking Informative Frames for Video Captioning—0
Video Captioning with Text-based Dynamic Attention and Step-by-Step Learning—0
Exploring Temporal Event Cues for Dense Video Captioning in Cyclic Co-learning—0
LongCaptioning: Unlocking the Power of Long Caption Generation in Large Multimodal Models—0
Video Captioning with Transferred Semantic Attributes—0
Low-Rank HOCA: Efficient High-Order Cross-Modal Attention for Video Captioning—0
Exploring Group Video Captioning with Efficient Relational Approximation—0
Exploration of Visual Features and their weighted-additive fusion for Video Captioning—0
M3: Multimodal Memory Modelling for Video Captioning—0
Exploiting long-term temporal dynamics for video captioning—0
Attention is all you need for Videos: Self-attention based Video Summarization using Universal Transformers—0
MAMS: Model-Agnostic Module Selection Framework for Video Captioning—0
Exo2EgoDVC: Dense Video Captioning of Egocentric Procedural Activities Using Web Instructional Videos—0
MAViC: Multimodal Active Learning for Video Captioning—0
MCF-VC: Mitigate Catastrophic Forgetting in Class-Incremental Learning for Multimodal Video Captioning—0
AdaCM^2: On Understanding Extremely Long-Term Video with Adaptive Cross-Modality Memory Reduction—0
EVLM: An Efficient Vision-Language Model for Visual Understanding—0
Attention based video captioning framework for Hindi—0
Attention Based Encoder Decoder Model for Video Captioning in Nepali (2023)—0
Attend and Interact: Higher-Order Object Interactions for Video Understanding—0
Middle-Out Decoding—0
MMCOMPOSITION: Revisiting the Compositionality of Pre-trained Vision-Language Models—0
Modality Alignment between Deep Representations for Effective Video-and-Language Learning—0
Models See Hallucinations: Evaluating the Factuality in Video Captioning—0
Show:102550
← PrevPage 5 of 10Next →
All datasetsMSR-VTTMSVDYouCook2VATEXActivityNet CaptionsMSRVTT-CTNMSVD-CTNHindi MSR-VTTTVCChinaOpen-1kMSVD-IndonesianShot2Story20K

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1mPLUG-2CIDEr80—Unverified
2VASTCIDEr78—Unverified
3GIT2CIDEr75.9—Unverified
4VLABCIDEr74.9—Unverified
5COSACIDEr74.7—Unverified
6VALORCIDEr74—Unverified
7MaMMUT (ours)CIDEr73.6—Unverified
8VideoCoCaCIDEr73.2—Unverified
9RTQCIDEr69.3—Unverified
10HowToCaptionCIDEr65.3—Unverified
#ModelMetricClaimedVerifiedStatus
1MaMMUTCIDEr195.6—Unverified
2VLABCIDEr179.8—Unverified
3COSACIDEr178.5—Unverified
4VALORCIDEr178.5—Unverified
5mPLUG-2CIDEr165.8—Unverified
6HowToCaptionCIDEr154.2—Unverified
7HiTeACIDEr146.9—Unverified
8Vid2SeqCIDEr146.2—Unverified
9VIOLETv2CIDEr139.2—Unverified
10RTQCIDEr123.4—Unverified
#ModelMetricClaimedVerifiedStatus
1VASTBLEU-418.2—Unverified
2UniVL + MELTRBLEU-417.92—Unverified
3UniVLBLEU-417.35—Unverified
4VideoCoCaBLEU-414.2—Unverified
5VLMBLEU-412.27—Unverified
6E2vidD6-MASSvid-BiDBLEU-412.04—Unverified
7TextKGBLEU-411.7—Unverified
8COOTBLEU-411.3—Unverified
9COSABLEU-410.1—Unverified
10HowToCaptionBLEU-48.8—Unverified
#ModelMetricClaimedVerifiedStatus
1VALORBLEU-445.6—Unverified
2VASTBLEU-445—Unverified
3COSABLEU-443.7—Unverified
4VideoCoCaBLEU-439.7—Unverified
5IcoCap (ViT-B/16)BLEU-437.4—Unverified
6IcoCap (ViT-B/32)BLEU-436.9—Unverified
7VASTA (Kinetics-backbone)BLEU-436.25—Unverified
8CoCap (ViT/L14)BLEU-435.8—Unverified
9ORG-TRLBLEU-432.1—Unverified
10NITS-VCBLEU-420—Unverified
#ModelMetricClaimedVerifiedStatus
1VideoCoCaBLEU414.7—Unverified
2VLTinT (ae-test split) C3D/LingBLEU414.5—Unverified
3VLCap (ae-test split) - Appearance + LanguageBLEU413.38—Unverified
4COOT (ae-test split) - Only Appearance featuresBLEU410.85—Unverified
5MART (ae-test split) - Appearance + FlowBLEU410.33—Unverified
#ModelMetricClaimedVerifiedStatus
1CENCIDEr49.87—Unverified
2GITCIDEr32.43—Unverified
3SEM-POSCIDEr26.01—Unverified
4AKGNNCIDEr25.9—Unverified
#ModelMetricClaimedVerifiedStatus
1CENCIDEr63.51—Unverified
2GITCIDEr45.63—Unverified
3SEM-POSCIDEr37.16—Unverified
4AKGNNCIDEr35.08—Unverified
#ModelMetricClaimedVerifiedStatus
1SBD_KeyframeBLEU441.01—Unverified
2V+S-Att-basedBLEU436.2—Unverified
#ModelMetricClaimedVerifiedStatus
1VASTBLEU-419.9—Unverified
2COSABLEU-418.8—Unverified
#ModelMetricClaimedVerifiedStatus
1GVTBLEU417.7—Unverified
#ModelMetricClaimedVerifiedStatus
1VNS-GRU (Cross-Lingual)BLEU-458.68—Unverified
#ModelMetricClaimedVerifiedStatus
1Shot2StoryCIDEr37.4—Unverified
#ModelMetricClaimedVerifiedStatus
1Vid2SeqCIDEr120.5—Unverified