SOTAVerified

Video Description

The goal of automatic Video Description is to tell a story about events happening in a video. While early Video Description methods produced captions for short clips that were manually segmented to contain a single event of interest, more recently dense video captioning has been proposed to both segment distinct events in time and describe them in a series of coherent sentences. This problem is a generalization of dense image region captioning and has many practical applications, such as generating textual summaries for the visually impaired, or detecting and describing important events in surveillance footage.

Source: Joint Event Detection and Description in Continuous Video Streams

Papers

Showing 2650 of 104 papers

TitleStatusHype
MSVD-Indonesian: A Benchmark for Multimodal Video-Text Tasks in IndonesianCode0
SUSTechGAN: Image Generation for Object Detection in Adverse Conditions of Autonomous DrivingCode0
Egocentric Video Description based on Temporally-Linked SequencesCode0
JMI at SemEval 2024 Task 3: Two-step approach for multimodal ECAC using in-context learning with GPT and instruction-tuned Llama modelsCode0
Describing Videos by Exploiting Temporal StructureCode0
Edit As You Wish: Video Caption Editing with Multi-grained User ControlCode0
Learn to Understand Negation in Video RetrievalCode0
Memory-augmented Attention Modelling for VideosCode0
End-to-End Audio Visual Scene-Aware Dialog using Multimodal Attention-Based Video FeaturesCode0
Improving LSTM-based Video Description with Linguistic Knowledge Mined from TextCode0
Attention-Based Multimodal Fusion for Video Description0
DANTE-AD: Dual-Vision Attention Network for Long-Term Audio Description0
Attention Based Encoder Decoder Model for Video Captioning in Nepali (2023)0
Cross-Modal Learning for Music-to-Music-Video Description Generation0
Coherent Multi-Sentence Video Description with Variable Level of Detail0
Attend and Interact: Higher-Order Object Interactions for Video Understanding0
CLearViD: Curriculum Learning for Video Description0
Prediction and Description of Near-Future Activities in Video0
A Thousand Frames in Just a Few Words: Lingual Description of Videos through Latent Topics and Sparse Object Stitching0
A Labelled Dataset for Sentiment Analysis of Videos on YouTube, TikTok, and Other Sources about the 2024 Outbreak of Measles0
Active Learning for Video Description With Cluster-Regularized Ensemble Ranking0
FIOVA: A Multi-Annotator Benchmark for Human-Aligned Video Captioning0
Incorporating Background Knowledge into Video Description Generation0
Incorporating Global Visual Features into Attention-based Neural Machine Translation.0
HOIGen-1M: A Large-scale Dataset for Human-Object Interaction Video Generation0
Show:102550
← PrevPage 2 of 5Next →

No leaderboard results yet.