SOTAVerified

Video Captioning

Video Captioning is a task of automatic captioning a video by understanding the action and event in the video which can help in the retrieval of the video efficiently through text.

Source: NITS-VC System for VATEX Video Captioning Challenge 2020

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 301–350 of 473 papers

TitleStatusHype
Hierarchical Boundary-Aware Neural Encoder for Video Captioning—0
Hierarchical LSTMs with Adaptive Attention for Visual Captioning—0
Hierarchical LSTM with Adjusted Temporal Attention for Video Captioning—0
Hierarchical memory decoder for visual narrating—0
Hierarchical Memory Decoding for Video Captioning—0
Hierarchical Multimodal Transformer to Summarize Videos—0
Hierarchical Recurrent Neural Encoder for Video Representation with Application to Captioning—0
Hierarchical Recurrent Neural Network for Video Summarization—0
HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training—0
HiVLP: Hierarchical Interactive Video-Language Pre-Training—0
Human Action Sequence Classification—0
Human-centric Behavior Description in Videos: New Benchmark and Model—0
HyperGLM: HyperGraph for Video Scene Graph Generation and Anticipation—0
IcoCap: Improving Video Captioning by Compounding Images—0
Image-to-Video Person Re-Identification by Reusing Cross-modal Embeddings—0
Imperial College London Submission to VATEX Video Captioning Task—0
Implicit and Explicit Commonsense for Multi-sentence Video Captioning—0
Improving Interpretability of Deep Neural Networks with Semantic Information—0
Incorporating Background Knowledge into Video Description Generation—0
Incorporating granularity bias as the margin into contrastive loss for video captioning—0
In-Home Daily-Life Captioning Using Radio Signals—0
Integrating Temporal and Spatial Attentions for VATEX Video Captioning Challenge 2019—0
Interactive-predictive neural multimodal systems—0
Interpretable Video Captioning via Trajectory Structured Localization—0
iPerceive: Applying Common-Sense Reasoning to Multi-Modal Dense Video Captioning and Video Question Answering—0
iReason: Multimodal Commonsense Reasoning using Videos and Natural Language with Interpretability—0
It's Just Another Day: Unique Video Captioning by Discriminative Prompting—0
Jointly Localizing and Describing Events for Dense Video Captioning—0
Joint Syntax Representation Learning and Visual Cue Translation for Video Captioning—0
Knowledge Distillation for Efficient Audio-Visual Video Captioning—0
Knowledge Guided Entity-aware Video Captioning and A Basketball Benchmark—0
Semi-Supervised Learning for Video Captioning—0
SEM-POS: Grammatically and Semantically Correct Video Captioning—0
Seq2Time: Sequential Knowledge Transfer for Video LLM Temporal Grounding—0
Set Prediction Guided by Semantic Concepts for Diverse Video Captioning—0
Show, Tell and Summarize: Dense Video Captioning Using Visual Cue Aided Sentence Summarization—0
SMArT: Training Shallow Memory-aware Transformers for Robotic Explainability—0
SnapCap: Efficient Snapshot Compressive Video Captioning—0
Sora as an AGI World Model? A Complete Survey on Text-to-Video Generation—0
Sparse Graph to Sequence Learning for Vision Conditioned Long Textual Sequence Generation—0
Spatio-Temporal Attention Models for Grounded Video Captioning—0
Spatio-Temporal Dynamics and Semantic Attribute Enriched Visual Encoding for Video Captioning—0
Spatio-Temporal Ranked-Attention Networks for Video Captioning—0
SPECTRUM: Semantic Processing and Emotion-informed video-Captioning Through Retrieval and Understanding Modalities—0
STOA-VLP: Spatial-Temporal Modeling of Object and Action for Video-Language Pre-training—0
Story Generation from Visual Inputs: Techniques, Related Tasks, and Challenges—0
Storytelling of Photo Stream with Bidirectional Multi-thread Recurrent Neural Network—0
Streaming Dense Video Captioning—0
Style-transfer based Speech and Audio-visual Scene Understanding for Robot Action Sequence Acquisition from Videos—0
SOVC: Subject-Oriented Video Captioning—0
Show:102550
← PrevPage 7 of 10Next →
All datasetsMSR-VTTMSVDYouCook2VATEXActivityNet CaptionsMSRVTT-CTNMSVD-CTNHindi MSR-VTTTVCChinaOpen-1kMSVD-IndonesianShot2Story20K

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1mPLUG-2CIDEr80—Unverified
2VASTCIDEr78—Unverified
3GIT2CIDEr75.9—Unverified
4VLABCIDEr74.9—Unverified
5COSACIDEr74.7—Unverified
6VALORCIDEr74—Unverified
7MaMMUT (ours)CIDEr73.6—Unverified
8VideoCoCaCIDEr73.2—Unverified
9RTQCIDEr69.3—Unverified
10HowToCaptionCIDEr65.3—Unverified
#ModelMetricClaimedVerifiedStatus
1MaMMUTCIDEr195.6—Unverified
2VLABCIDEr179.8—Unverified
3COSACIDEr178.5—Unverified
4VALORCIDEr178.5—Unverified
5mPLUG-2CIDEr165.8—Unverified
6HowToCaptionCIDEr154.2—Unverified
7HiTeACIDEr146.9—Unverified
8Vid2SeqCIDEr146.2—Unverified
9VIOLETv2CIDEr139.2—Unverified
10RTQCIDEr123.4—Unverified
#ModelMetricClaimedVerifiedStatus
1VASTBLEU-418.2—Unverified
2UniVL + MELTRBLEU-417.92—Unverified
3UniVLBLEU-417.35—Unverified
4VideoCoCaBLEU-414.2—Unverified
5VLMBLEU-412.27—Unverified
6E2vidD6-MASSvid-BiDBLEU-412.04—Unverified
7TextKGBLEU-411.7—Unverified
8COOTBLEU-411.3—Unverified
9COSABLEU-410.1—Unverified
10HowToCaptionBLEU-48.8—Unverified
#ModelMetricClaimedVerifiedStatus
1VALORBLEU-445.6—Unverified
2VASTBLEU-445—Unverified
3COSABLEU-443.7—Unverified
4VideoCoCaBLEU-439.7—Unverified
5IcoCap (ViT-B/16)BLEU-437.4—Unverified
6IcoCap (ViT-B/32)BLEU-436.9—Unverified
7VASTA (Kinetics-backbone)BLEU-436.25—Unverified
8CoCap (ViT/L14)BLEU-435.8—Unverified
9ORG-TRLBLEU-432.1—Unverified
10NITS-VCBLEU-420—Unverified
#ModelMetricClaimedVerifiedStatus
1VideoCoCaBLEU414.7—Unverified
2VLTinT (ae-test split) C3D/LingBLEU414.5—Unverified
3VLCap (ae-test split) - Appearance + LanguageBLEU413.38—Unverified
4COOT (ae-test split) - Only Appearance featuresBLEU410.85—Unverified
5MART (ae-test split) - Appearance + FlowBLEU410.33—Unverified
#ModelMetricClaimedVerifiedStatus
1CENCIDEr49.87—Unverified
2GITCIDEr32.43—Unverified
3SEM-POSCIDEr26.01—Unverified
4AKGNNCIDEr25.9—Unverified
#ModelMetricClaimedVerifiedStatus
1CENCIDEr63.51—Unverified
2GITCIDEr45.63—Unverified
3SEM-POSCIDEr37.16—Unverified
4AKGNNCIDEr35.08—Unverified
#ModelMetricClaimedVerifiedStatus
1SBD_KeyframeBLEU441.01—Unverified
2V+S-Att-basedBLEU436.2—Unverified
#ModelMetricClaimedVerifiedStatus
1VASTBLEU-419.9—Unverified
2COSABLEU-418.8—Unverified
#ModelMetricClaimedVerifiedStatus
1GVTBLEU417.7—Unverified
#ModelMetricClaimedVerifiedStatus
1VNS-GRU (Cross-Lingual)BLEU-458.68—Unverified
#ModelMetricClaimedVerifiedStatus
1Shot2StoryCIDEr37.4—Unverified
#ModelMetricClaimedVerifiedStatus
1Vid2SeqCIDEr120.5—Unverified