SOTAVerified

Dense Video Captioning

Most natural videos contain numerous events. For example, in a video of a “man playing a piano”, the video might also contain “another man dancing” or “a crowd clapping”. The task of dense video captioning involves both detecting and describing events in a video.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 26–50 of 76 papers

TitleStatusHype
VideoLLM Knows When to Speak: Enhancing Time-Sensitive Video Comprehension with Video-Text Duet Interaction FormatCode1
Zero-Shot Dense Video Captioning by Jointly Optimizing Text and Moment—0
A Closer Look at Temporal Ordering in the Segmentation of Instructional Videos—0
Activitynet 2019 Task 3: Exploring Contexts for Dense Captioning Events in Videos—0
A Review of Deep Learning for Video Captioning—0
Attention is all you need for Videos: Self-attention based Video Summarization using Universal Transformers—0
Empowering LLMs with Pseudo-Untrimmed Videos for Audio-Visual Temporal Understanding—0
Dense Video Captioning: A Survey of Techniques, Datasets and Evaluation Protocols—0
Dense Video Captioning using Graph-based Sentence Summarization—0
DIBS: Enhancing Dense Video Captioning with Unlabeled Videos via Pseudo Boundary Enrichment and Online Refinement—0
DVCFlow: Modeling Information Flow Towards Human-like Video Captioning—0
End-to-end Dense Video Captioning as Sequence Generation—0
End-to-end Dense Video Captioning as Sequence Generation—0
Event-Equalized Dense Video Captioning—0
Exo2EgoDVC: Dense Video Captioning of Egocentric Procedural Activities Using Web Instructional Videos—0
Exploring Temporal Event Cues for Dense Video Captioning in Cyclic Co-learning—0
Exploiting Auxiliary Caption for Video Grounding—0
iPerceive: Applying Common-Sense Reasoning to Multi-Modal Dense Video Captioning and Video Question Answering—0
Jointly Localizing and Describing Events for Dense Video Captioning—0
PIC 4th Challenge: Semantic-Assisted Multi-Feature Encoding and Multi-Head Decoding for Dense Video Captioning—0
Recipe Generation from Unsegmented Cooking Videos—0
RUC+CMU: System Report for Dense Captioning Events in Videos—0
SACT: Self-Aware Multi-Space Feature Composition Transformer for Multinomial Attention for Video Captioning—0
SAVCHOI: Detecting Suspicious Activities using Dense Video Captioning with Human Object Interactions—0
Semantic-Aware Pretraining for Dense Video Captioning—0
Show:102550
← PrevPage 2 of 4Next →
All datasetsActivityNet CaptionsYouCook2ViTTVidChapters-7M

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1VTimeLLMCIDEr27.6—Unverified
2Vid2SeqMETEOR17—Unverified
3ADV-INF + GlobalMETEOR16.36—Unverified
4Bi-directional+intra captioningMETEOR11.28—Unverified
5GVLMETEOR10.03—Unverified
6TSRM-CMG-HRNN+SCSTMETEOR9.71—Unverified
7PDVC (TSP features, no SCST)METEOR9.03—Unverified
8TSPMETEOR8.75—Unverified
9CM²METEOR8.55—Unverified
10BMTMETEOR8.44—Unverified
#ModelMetricClaimedVerifiedStatus
1HiCM²CIDEr71.84—Unverified
2Vid2Seq (HowTo100M+VidChapters-7M PT)CIDEr67.2—Unverified
3Vid2SeqCIDEr47.1—Unverified
4E2vidD6-MASSalign-BiDROUGE-L39.03—Unverified
5CM²CIDEr31.66—Unverified
6GVLCIDEr26.52—Unverified
7PDVC (TSN features, no SCST)CIDEr22.71—Unverified
#ModelMetricClaimedVerifiedStatus
1E2ESGCIDEr25—Unverified
2Vid2Seq (VidChapters-7M PT)SODA0.15—Unverified
3HiCM²SODA0.15—Unverified
4Vid2SeqSODA0.14—Unverified
#ModelMetricClaimedVerifiedStatus
1Vid2SeqCIDEr55.7—Unverified