SOTAVerified

Video Captioning

Video Captioning is a task of automatic captioning a video by understanding the action and event in the video which can help in the retrieval of the video efficiently through text.

Source: NITS-VC System for VATEX Video Captioning Challenge 2020

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 251–300 of 473 papers

TitleStatusHype
MAViC: Multimodal Active Learning for Video Captioning—0
VideoCoCa: Video-Text Modeling with Zero-Shot Transfer from Contrastive Captioners—0
Refined Semantic Enhancement towards Frequency Diffusion for Video CaptioningCode0
Aligning Source Visual and Target Language Domains for Unpaired Video Captioning—0
Event and Entity Extraction from Generated Video CaptionsCode0
Fighting FIRe with FIRE: Assessing the Validity of Text-to-Video Retrieval Benchmarks—0
Recipe Generation from Unsegmented Cooking Videos—0
OmniVL:One Foundation Model for Image-Language and Video-Language Tasks—0
StoryDALL-E: Adapting Pretrained Text-to-Image Transformers for Story ContinuationCode0
Diverse Video Captioning by Adaptive Spatio-temporal AttentionCode0
Boosting Video-Text Retrieval with Explicit High-Level Semantics—0
SAVCHOI: Detecting Suspicious Activities using Dense Video Captioning with Human Object Interactions—0
Dual-Stream Transformer for Generic Event Boundary CaptioningCode0
PIC 4th Challenge: Semantic-Assisted Multi-Feature Encoding and Multi-Head Decoding for Dense Video Captioning—0
Modality Alignment between Deep Representations for Effective Video-and-Language Learning—0
Support-set based Multi-modal Representation Enhancement for Video CaptioningCode0
Attract me to Buy: Advertisement Copywriting Generation with Multimodal Multi-structured Information—0
Dual-Level Decoupled Transformer for Video Captioning—0
Tragedy Plus Time: Capturing Unintended Human Activities from Weakly-labeled VideosCode0
End-to-end Dense Video Captioning as Sequence Generation—0
Semantic-Aware Pretraining for Dense Video Captioning—0
Video Captioning: a comparative review of where we are and which could be the route—0
Learning Audio-Video Modalities from Image Captions—0
CREATE: A Benchmark for Chinese Short Video Retrieval and Title Generation—0
Global2Local: A Joint-Hierarchical Attention for Video Captioning—0
Exploiting long-term temporal dynamics for video captioning—0
BERTHA: Video Captioning Evaluation Via Transfer-Learned Human AssessmentCode0
Generative Adversarial Network Applications in Creating a Meta-Universe—0
An Integrated Approach for Video Captioning and Applications—0
End-to-end Generative Pretraining for Multimodal Video Captioning—0
Discourse Analysis for Evaluating Coherence in Video Paragraph Captions—0
End-to-end Dense Video Captioning as Sequence Generation—0
Boosting Video Representation Learning with Multi-Faceted Integration—0
Variational Stacked Local Attention Networks for Diverse Video Captioning—0
Dense Video Captioning Using Unsupervised Semantic InformationCode0
CoCo-BERT: Improving Video-Language Pre-training with Contrastive Cross-modal Matching and Denoising—0
Syntax Customized Video Captioning by Imitating Exemplar SentencesCode0
Multi-modal Dependency Tree for Video Captioning—0
An Efficient Keyframes Selection Based Framework for Video Captioning—0
CLIP Meets Video Captioning: Concept-Aware Representation Learning Does MatterCode0
DVCFlow: Modeling Information Flow Towards Human-like Video Captioning—0
Fill-in-the-Blank: A Challenging Video Understanding Evaluation Framework—0
CREATE: A Benchmark for Chinese Short Video Retrieval and Title Generation—0
E-MMAD: Multimodal Advertising Caption Generation Based on Structured Information—0
Visual-aware Attention Dual-stream Decoder for Video Captioning—0
CLIP4Caption: CLIP for Video Caption—0
CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representations—0
Graph Similarities and Dual Approach for Sequential Text-to-Image Retrieval—0
OSVidCap: A Framework for the Simultaneous Recognition and Description of Concurrent Actions in Videos in an Open-Set ScenarioCode0
Hierarchical Multimodal Transformer to Summarize Videos—0
Show:102550
← PrevPage 6 of 10Next →
All datasetsMSR-VTTMSVDYouCook2VATEXActivityNet CaptionsMSRVTT-CTNMSVD-CTNHindi MSR-VTTTVCChinaOpen-1kMSVD-IndonesianShot2Story20K

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1mPLUG-2CIDEr80—Unverified
2VASTCIDEr78—Unverified
3GIT2CIDEr75.9—Unverified
4VLABCIDEr74.9—Unverified
5COSACIDEr74.7—Unverified
6VALORCIDEr74—Unverified
7MaMMUT (ours)CIDEr73.6—Unverified
8VideoCoCaCIDEr73.2—Unverified
9RTQCIDEr69.3—Unverified
10HowToCaptionCIDEr65.3—Unverified
#ModelMetricClaimedVerifiedStatus
1MaMMUTCIDEr195.6—Unverified
2VLABCIDEr179.8—Unverified
3COSACIDEr178.5—Unverified
4VALORCIDEr178.5—Unverified
5mPLUG-2CIDEr165.8—Unverified
6HowToCaptionCIDEr154.2—Unverified
7HiTeACIDEr146.9—Unverified
8Vid2SeqCIDEr146.2—Unverified
9VIOLETv2CIDEr139.2—Unverified
10RTQCIDEr123.4—Unverified
#ModelMetricClaimedVerifiedStatus
1VASTBLEU-418.2—Unverified
2UniVL + MELTRBLEU-417.92—Unverified
3UniVLBLEU-417.35—Unverified
4VideoCoCaBLEU-414.2—Unverified
5VLMBLEU-412.27—Unverified
6E2vidD6-MASSvid-BiDBLEU-412.04—Unverified
7TextKGBLEU-411.7—Unverified
8COOTBLEU-411.3—Unverified
9COSABLEU-410.1—Unverified
10HowToCaptionBLEU-48.8—Unverified
#ModelMetricClaimedVerifiedStatus
1VALORBLEU-445.6—Unverified
2VASTBLEU-445—Unverified
3COSABLEU-443.7—Unverified
4VideoCoCaBLEU-439.7—Unverified
5IcoCap (ViT-B/16)BLEU-437.4—Unverified
6IcoCap (ViT-B/32)BLEU-436.9—Unverified
7VASTA (Kinetics-backbone)BLEU-436.25—Unverified
8CoCap (ViT/L14)BLEU-435.8—Unverified
9ORG-TRLBLEU-432.1—Unverified
10NITS-VCBLEU-420—Unverified
#ModelMetricClaimedVerifiedStatus
1VideoCoCaBLEU414.7—Unverified
2VLTinT (ae-test split) C3D/LingBLEU414.5—Unverified
3VLCap (ae-test split) - Appearance + LanguageBLEU413.38—Unverified
4COOT (ae-test split) - Only Appearance featuresBLEU410.85—Unverified
5MART (ae-test split) - Appearance + FlowBLEU410.33—Unverified
#ModelMetricClaimedVerifiedStatus
1CENCIDEr49.87—Unverified
2GITCIDEr32.43—Unverified
3SEM-POSCIDEr26.01—Unverified
4AKGNNCIDEr25.9—Unverified
#ModelMetricClaimedVerifiedStatus
1CENCIDEr63.51—Unverified
2GITCIDEr45.63—Unverified
3SEM-POSCIDEr37.16—Unverified
4AKGNNCIDEr35.08—Unverified
#ModelMetricClaimedVerifiedStatus
1SBD_KeyframeBLEU441.01—Unverified
2V+S-Att-basedBLEU436.2—Unverified
#ModelMetricClaimedVerifiedStatus
1VASTBLEU-419.9—Unverified
2COSABLEU-418.8—Unverified
#ModelMetricClaimedVerifiedStatus
1GVTBLEU417.7—Unverified
#ModelMetricClaimedVerifiedStatus
1VNS-GRU (Cross-Lingual)BLEU-458.68—Unverified
#ModelMetricClaimedVerifiedStatus
1Shot2StoryCIDEr37.4—Unverified
#ModelMetricClaimedVerifiedStatus
1Vid2SeqCIDEr120.5—Unverified