SOTAVerified

Video Captioning

Video Captioning is a task of automatic captioning a video by understanding the action and event in the video which can help in the retrieval of the video efficiently through text.

Source: NITS-VC System for VATEX Video Captioning Challenge 2020

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 351–400 of 473 papers

TitleStatusHype
Sora as an AGI World Model? A Complete Survey on Text-to-Video Generation—0
Sparse Graph to Sequence Learning for Vision Conditioned Long Textual Sequence Generation—0
Spatio-Temporal Attention Models for Grounded Video Captioning—0
Spatio-Temporal Dynamics and Semantic Attribute Enriched Visual Encoding for Video Captioning—0
Spatio-Temporal Graph for Video Captioning with Knowledge Distillation—0
Spatio-Temporal Ranked-Attention Networks for Video Captioning—0
SPECTRUM: Semantic Processing and Emotion-informed video-Captioning Through Retrieval and Understanding Modalities—0
STOA-VLP: Spatial-Temporal Modeling of Object and Action for Video-Language Pre-training—0
Watch and Learn: Leveraging Expert Knowledge and Language for Surgical Video Understanding—0
Story Generation from Visual Inputs: Techniques, Related Tasks, and Challenges—0
Storytelling of Photo Stream with Bidirectional Multi-thread Recurrent Neural Network—0
Streaming Dense Video Captioning—0
Watch It Twice: Video Captioning with a Refocused Video Encoder—0
Style-transfer based Speech and Audio-visual Scene Understanding for Robot Action Sequence Acquisition from Videos—0
SOVC: Subject-Oriented Video Captioning—0
Supervising Neural Attention Models for Video Captioning by Human Gaze Data—0
Active Learning for Video Description With Cluster-Regularized Ensemble Ranking—0
CoCo-BERT: Improving Video-Language Pre-training with Contrastive Cross-modal Matching and Denoising—0
CLIP4Caption: CLIP for Video Caption—0
Weakly Supervised Dense Video Captioning—0
Classifier-Guided Captioning Across Modalities—0
Task-Driven Dynamic Fusion: Reducing Ambiguity in Video Description—0
TCR: Short Video Title Generation and Cover Selection with Attention Refinement—0
Team RUC_AIM3 Technical Report at Activitynet 2020 Task 2: Exploring Sequential Events Detection for Dense Video Captioning—0
Technical Report for Soccernet 2023 -- Dense Video Captioning—0
Chinese Whispers: Cooperative Paraphrase Acquisition—0
Weakly Supervised Dense Video Captioning via Jointly Usage of Knowledge Distillation and Cross-modal Matching—0
Temporally Grounding Natural Sentence in Video—0
Temporal Object Captioning for Street Scene Videos from LiDAR Tracks—0
Temporal Perceiving Video-Language Pre-training—0
A Dataset for Telling the Stories of Social Media Videos—0
Characterizing the impact of using features extracted from pre-trained models on the quality of video captioning sequence-to-sequence models—0
Text with Knowledge Graph Augmented Transformer for Video Captioning—0
The 8th AI City Challenge—0
The Devil is in the Distributions: Explicit Modeling of Scene Content is Key in Zero-Shot Video Captioning—0
The Use of Video Captioning for Fostering Physical Activity—0
Capturing Rich Behavior Representations: A Dynamic Action Semantic-Aware Graph Transformer for Video Captioning—0
TimeSoccer: An End-to-End Multimodal Large Language Model for Soccer Commentary Generation—0
Title Generation for User Generated Videos—0
Whats in a Video: Factorized Autoregressive Decoding for Online Dense Video Captioning—0
Adaptive Feature Abstraction for Translating Video to Text—0
Towards Bridging Event Captioner and Sentence Localizer for Weakly Supervised Dense Event Captioning—0
Towards Holistic Language-video Representation: the language model-enhanced MSR-Video to Text Dataset—0
Prediction and Description of Near-Future Activities in Video—0
Wolf: Captioning Everything with a World Summarization Framework—0
Transformer in action: a comparative study of transformer-based acoustic models for large scale speech recognition applications—0
Translating Videos to Natural Language Using Deep Recurrent Neural Networks—0
TRECVID 2019: An Evaluation Campaign to Benchmark Video Activity Detection, Video Captioning and Matching, and Video Search & Retrieval—0
FIOVA: A Multi-Annotator Benchmark for Human-Aligned Video Captioning—0
Towards Surveillance Video-and-Language Understanding: New Dataset, Baselines, and Challenges—0
Show:102550
← PrevPage 8 of 10Next →
All datasetsMSR-VTTMSVDYouCook2VATEXActivityNet CaptionsMSRVTT-CTNMSVD-CTNHindi MSR-VTTTVCChinaOpen-1kMSVD-IndonesianShot2Story20K

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1mPLUG-2CIDEr80—Unverified
2VASTCIDEr78—Unverified
3GIT2CIDEr75.9—Unverified
4VLABCIDEr74.9—Unverified
5COSACIDEr74.7—Unverified
6VALORCIDEr74—Unverified
7MaMMUT (ours)CIDEr73.6—Unverified
8VideoCoCaCIDEr73.2—Unverified
9RTQCIDEr69.3—Unverified
10HowToCaptionCIDEr65.3—Unverified
#ModelMetricClaimedVerifiedStatus
1MaMMUTCIDEr195.6—Unverified
2VLABCIDEr179.8—Unverified
3COSACIDEr178.5—Unverified
4VALORCIDEr178.5—Unverified
5mPLUG-2CIDEr165.8—Unverified
6HowToCaptionCIDEr154.2—Unverified
7HiTeACIDEr146.9—Unverified
8Vid2SeqCIDEr146.2—Unverified
9VIOLETv2CIDEr139.2—Unverified
10RTQCIDEr123.4—Unverified
#ModelMetricClaimedVerifiedStatus
1VASTBLEU-418.2—Unverified
2UniVL + MELTRBLEU-417.92—Unverified
3UniVLBLEU-417.35—Unverified
4VideoCoCaBLEU-414.2—Unverified
5VLMBLEU-412.27—Unverified
6E2vidD6-MASSvid-BiDBLEU-412.04—Unverified
7TextKGBLEU-411.7—Unverified
8COOTBLEU-411.3—Unverified
9COSABLEU-410.1—Unverified
10HowToCaptionBLEU-48.8—Unverified
#ModelMetricClaimedVerifiedStatus
1VALORBLEU-445.6—Unverified
2VASTBLEU-445—Unverified
3COSABLEU-443.7—Unverified
4VideoCoCaBLEU-439.7—Unverified
5IcoCap (ViT-B/16)BLEU-437.4—Unverified
6IcoCap (ViT-B/32)BLEU-436.9—Unverified
7VASTA (Kinetics-backbone)BLEU-436.25—Unverified
8CoCap (ViT/L14)BLEU-435.8—Unverified
9ORG-TRLBLEU-432.1—Unverified
10NITS-VCBLEU-420—Unverified
#ModelMetricClaimedVerifiedStatus
1VideoCoCaBLEU414.7—Unverified
2VLTinT (ae-test split) C3D/LingBLEU414.5—Unverified
3VLCap (ae-test split) - Appearance + LanguageBLEU413.38—Unverified
4COOT (ae-test split) - Only Appearance featuresBLEU410.85—Unverified
5MART (ae-test split) - Appearance + FlowBLEU410.33—Unverified
#ModelMetricClaimedVerifiedStatus
1CENCIDEr49.87—Unverified
2GITCIDEr32.43—Unverified
3SEM-POSCIDEr26.01—Unverified
4AKGNNCIDEr25.9—Unverified
#ModelMetricClaimedVerifiedStatus
1CENCIDEr63.51—Unverified
2GITCIDEr45.63—Unverified
3SEM-POSCIDEr37.16—Unverified
4AKGNNCIDEr35.08—Unverified
#ModelMetricClaimedVerifiedStatus
1SBD_KeyframeBLEU441.01—Unverified
2V+S-Att-basedBLEU436.2—Unverified
#ModelMetricClaimedVerifiedStatus
1VASTBLEU-419.9—Unverified
2COSABLEU-418.8—Unverified
#ModelMetricClaimedVerifiedStatus
1GVTBLEU417.7—Unverified
#ModelMetricClaimedVerifiedStatus
1VNS-GRU (Cross-Lingual)BLEU-458.68—Unverified
#ModelMetricClaimedVerifiedStatus
1Shot2StoryCIDEr37.4—Unverified
#ModelMetricClaimedVerifiedStatus
1Vid2SeqCIDEr120.5—Unverified