SOTAVerified

Dense Video Captioning

Most natural videos contain numerous events. For example, in a video of a “man playing a piano”, the video might also contain “another man dancing” or “a crowd clapping”. The task of dense video captioning involves both detecting and describing events in a video.

Papers

Showing 2650 of 76 papers

TitleStatusHype
DIBS: Enhancing Dense Video Captioning with Unlabeled Videos via Pseudo Boundary Enrichment and Online Refinement0
Streaming Dense Video CaptioningCode0
OmniVid: A Generative Framework for Universal Video UnderstandingCode2
Empowering LLMs with Pseudo-Untrimmed Videos for Audio-Visual Temporal Understanding0
VTimeLLM: Empower LLM to Grasp Video MomentsCode2
Exo2EgoDVC: Dense Video Captioning of Egocentric Procedural Activities Using Web Instructional Videos0
Dense Video Captioning: A Survey of Techniques, Datasets and Evaluation Protocols0
VidChapters-7M: Video Chapters at ScaleCode2
Towards Surveillance Video-and-Language Understanding: New Dataset, Baselines, and Challenges0
SoccerNet 2023 Challenges ResultsCode1
Zero-Shot Dense Video Captioning by Jointly Optimizing Text and Moment0
Visual Transformation TellingCode0
A Review of Deep Learning for Video Captioning0
SoccerNet-Caption: Dense Video Captioning for Soccer Broadcasts CommentariesCode2
Learning Grounded Vision-Language Representation for Versatile Understanding in Untrimmed VideosCode1
Vid2Seq: Large-Scale Pretraining of a Visual Language Model for Dense Video CaptioningCode2
Exploiting Auxiliary Caption for Video Grounding0
Event and Entity Extraction from Generated Video CaptionsCode0
A Closer Look at Temporal Ordering in the Segmentation of Instructional Videos0
Recipe Generation from Unsegmented Cooking Videos0
SAVCHOI: Detecting Suspicious Activities using Dense Video Captioning with Human Object Interactions0
Unifying Event Detection and Captioning as Sequence Generation via Pre-TrainingCode1
PIC 4th Challenge: Semantic-Assisted Multi-Feature Encoding and Multi-Head Decoding for Dense Video Captioning0
End-to-end Dense Video Captioning as Sequence Generation0
Semantic-Aware Pretraining for Dense Video Captioning0
Show:102550
← PrevPage 2 of 4Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1VTimeLLMCIDEr27.6Unverified
2Vid2SeqMETEOR17Unverified
3ADV-INF + GlobalMETEOR16.36Unverified
4Bi-directional+intra captioningMETEOR11.28Unverified
5GVLMETEOR10.03Unverified
6TSRM-CMG-HRNN+SCSTMETEOR9.71Unverified
7PDVC (TSP features, no SCST)METEOR9.03Unverified
8TSPMETEOR8.75Unverified
9CM²METEOR8.55Unverified
10BMTMETEOR8.44Unverified
#ModelMetricClaimedVerifiedStatus
1HiCM²CIDEr71.84Unverified
2Vid2Seq (HowTo100M+VidChapters-7M PT)CIDEr67.2Unverified
3Vid2SeqCIDEr47.1Unverified
4E2vidD6-MASSalign-BiDROUGE-L39.03Unverified
5CM²CIDEr31.66Unverified
6GVLCIDEr26.52Unverified
7PDVC (TSN features, no SCST)CIDEr22.71Unverified
#ModelMetricClaimedVerifiedStatus
1E2ESGCIDEr25Unverified
2Vid2Seq (VidChapters-7M PT)SODA0.15Unverified
3HiCM²SODA0.15Unverified
4Vid2SeqSODA0.14Unverified
#ModelMetricClaimedVerifiedStatus
1Vid2SeqCIDEr55.7Unverified