SOTAVerified

Video Description

The goal of automatic Video Description is to tell a story about events happening in a video. While early Video Description methods produced captions for short clips that were manually segmented to contain a single event of interest, more recently dense video captioning has been proposed to both segment distinct events in time and describe them in a series of coherent sentences. This problem is a generalization of dense image region captioning and has many practical applications, such as generating textual summaries for the visually impaired, or detecting and describing important events in surveillance footage.

Source: Joint Event Detection and Description in Continuous Video Streams

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 104 papers

TitleStatusHype
Describing Unseen Videos via Multi-Modal Cooperative Dialog AgentsCode0
Active Learning for Video Description With Cluster-Regularized Ensemble Ranking—0
Delving Deeper into the Decoder for Video CaptioningCode1
Multi-Layer Content Interaction Through Quaternion Product For Visual Question Answering—0
VizSeq: A Visual Analysis Toolkit for Text Generation TasksCode0
Prediction and Description of Near-Future Activities in Video—0
VATEX: A Large-Scale, High-Quality Multilingual Dataset for Video-and-Language ResearchCode1
End-to-End Video Captioning—0
Grounded Video DescriptionCode1
Adversarial Inference for Multi-Sentence Video DescriptionCode0
Incorporating Background Knowledge into Video Description Generation—0
A Dataset for Telling the Stories of Social Media Videos—0
Attentive Sequence to Sequence Translation for Localizing Clips of Interest by Natural Language Descriptions—0
Bridge Video and Text with Cascade Syntactic Structure—0
Multimodal Neural Machine Translation for Low-resource Language Pairs using Synthetic Data—0
End-to-End Audio Visual Scene-Aware Dialog using Multimodal Attention-Based Video FeaturesCode0
Interpretable Video Captioning via Trajectory Structured Localization—0
Audio Visual Scene-Aware Dialog (AVSD) Challenge at DSTC7Code1
Video Description: A Survey of Methods, Datasets and Evaluation Metrics—0
Incorporating Semantic Attention in Video Description Generation—0
Integrating both Visual and Audio Cues for Enhanced Video Caption—0
Attend and Interact: Higher-Order Object Interactions for Video Understanding—0
Predicting Visual Features from Text for Image and Video Caption RetrievalCode0
Incorporating Global Visual Features into Attention-based Neural Machine Translation.—0
Task-Driven Dynamic Fusion: Reducing Ambiguity in Video Description—0
Egocentric Video Description based on Temporally-Linked SequencesCode0
Attention-Based Multimodal Fusion for Video Description—0
Generating Video Description using Sequence-to-sequence Model with Temporal Attention—0
Hierarchical Boundary-Aware Neural Encoder for Video Captioning—0
Memory-augmented Attention Modelling for VideosCode0
Neural Headline Generation on Abstract Meaning Representation—0
Natural Language Descriptions of Human Activities Scenes: Corpus Generation and Analysis—0
SHEF-Multimodal: Grounding Machine Translation on Images—0
VideoMCC: a New Benchmark for Video Comprehension—0
Bidirectional Long-Short Term Memory for Video Description—0
MSR-VTT: A Large Video Description Dataset for Bridging Video and Language—0
Noisy Parallel Approximate Decoding for Conditional Recurrent Language Model—0
A Mid-level Video Representation based on Binary Descriptors: A Case Study for Pornography DetectionCode0
Video Description using Bidirectional Recurrent Neural NetworksCode0
TGIF: A New Dataset and Benchmark on Animated GIF DescriptionCode0
Improving LSTM-based Video Description with Linguistic Knowledge Mined from TextCode0
Vectors of Locally Aggregated Centers for Compact Video Representation—0
A Multi-scale Multiple Instance Video Description Network—0
Using Descriptive Video Services to Create a Large Data Source for Video Annotation ResearchCode1
Describing Videos by Exploiting Temporal StructureCode0
Probabilistic Soft Logic for Semantic Textual Similarity—0
Coherent Multi-Sentence Video Description with Variable Level of Detail—0
Semantic Neighborhoods as Hypergraphs—0
HENRY-CORE: Domain Adaptation and Stacking for Text Similarity—0
Better Exploiting Motion for Better Action Recognition—0
Show:102550
← PrevPage 2 of 3Next →

No leaderboard results yet.