SOTAVerified

Video Description

The goal of automatic Video Description is to tell a story about events happening in a video. While early Video Description methods produced captions for short clips that were manually segmented to contain a single event of interest, more recently dense video captioning has been proposed to both segment distinct events in time and describe them in a series of coherent sentences. This problem is a generalization of dense image region captioning and has many practical applications, such as generating textual summaries for the visually impaired, or detecting and describing important events in surveillance footage.

Source: Joint Event Detection and Description in Continuous Video Streams

Papers

Showing 150 of 104 papers

TitleStatusHype
Panda-70M: Captioning 70M Videos with Multiple Cross-Modality TeachersCode4
Tarsier2: Advancing Large Vision-Language Models from Detailed Video Description to Comprehensive Video UnderstandingCode4
Tarsier: Recipes for Training and Evaluating Large Video Description ModelsCode4
Hawk: Learning to Understand Open-World Video AnomaliesCode3
TrafficVLM: A Controllable Visual Language Model for Traffic Video CaptioningCode2
StoryTeller: Improving Long Video Description through Global Audio-Visual Character IdentificationCode2
Identity-Aware Multi-Sentence Video DescriptionCode1
Delving Deeper into the Decoder for Video CaptioningCode1
Using Descriptive Video Services to Create a Large Data Source for Video Annotation ResearchCode1
What's in a Caption? Dataset-Specific Linguistic Diversity and Its Effect on Visual Description Models and MetricsCode1
Fine-grained Audible Video DescriptionCode1
VATEX: A Large-Scale, High-Quality Multilingual Dataset for Video-and-Language ResearchCode1
FunQA: Towards Surprising Video ComprehensionCode1
Audio Visual Scene-Aware Dialog (AVSD) Challenge at DSTC7Code1
Thinking Hallucination for Video CaptioningCode1
Grounded Video DescriptionCode1
MSR-VTT: A Large Video Description Dataset for Bridging Video and Language0
Attention Based Encoder Decoder Model for Video Captioning in Nepali (2023)0
MSVD-Turkish: A Comprehensive Multimodal Dataset for Integrated Vision and Language Research in Turkish0
Attend and Interact: Higher-Order Object Interactions for Video Understanding0
A Thousand Frames in Just a Few Words: Lingual Description of Videos through Latent Topics and Sparse Object Stitching0
A Labelled Dataset for Sentiment Analysis of Videos on YouTube, TikTok, and Other Sources about the 2024 Outbreak of Measles0
LLAVIDAL: A Large LAnguage VIsion Model for Daily Activities of Living0
CLearViD: Curriculum Learning for Video Description0
Coherent Multi-Sentence Video Description with Variable Level of Detail0
Cross-Modal Learning for Music-to-Music-Video Description Generation0
DANTE-AD: Dual-Vision Attention Network for Long-Term Audio Description0
Multi-Layer Content Interaction Through Quaternion Product For Visual Question Answering0
Attention-Based Multimodal Fusion for Video Description0
Active Learning for Video Description With Cluster-Regularized Ensemble Ranking0
ActionHub: A Large-scale Action Video Description Dataset for Zero-shot Action Recognition0
End-to-End Video Captioning0
Interpretable Video Captioning via Trajectory Structured Localization0
Boosting Video Captioning with Dynamic Loss Network0
Bidirectional Long-Short Term Memory for Video Description0
An Efficient Keyframes Selection Based Framework for Video Captioning0
JU\_CSE\_NLP: Multi-grade Classification of Semantic Similarity between Text Pairs0
Generating Video Description using Sequence-to-sequence Model with Temporal Attention0
Better Exploiting Motion for Better Action Recognition0
Enhancing Video Understanding: Deep Neural Networks for Spatiotemporal Analysis0
HENRY-CORE: Domain Adaptation and Stacking for Text Similarity0
Hierarchical Boundary-Aware Neural Encoder for Video Captioning0
HOIGen-1M: A Large-scale Dataset for Human-Object Interaction Video Generation0
Bridge Video and Text with Cascade Syntactic Structure0
AVD2: Accident Video Diffusion for Accident Video Description0
FIOVA: A Multi-Annotator Benchmark for Human-Aligned Video Captioning0
Prediction and Description of Near-Future Activities in Video0
Incorporating Background Knowledge into Video Description Generation0
Incorporating Global Visual Features into Attention-based Neural Machine Translation.0
Analyzing Political Figures in Real-Time: Leveraging YouTube Metadata for Sentiment Analysis0
Show:102550
← PrevPage 1 of 3Next →

No leaderboard results yet.