Video Description using Bidirectional Recurrent Neural Networks Apr 12, 2016 Decoder Text Generation
Code Code Available 5 Video Summarization: Towards Entity-Aware Captions Dec 1, 2023 Image Captioning Video Captioning
Code Code Available 5 Visual Transformation Telling May 3, 2023 Dense Video Captioning Video Captioning
Code Code Available 5 Watch, Listen, and Describe: Globally and Locally Aligned Cross-Modal Attentions for Video Captioning Apr 15, 2018 Video Captioning Video Understanding
Code Code Available 5 Interactive-predictive neural multimodal systems May 30, 2019 Machine Translation Translation
— Unverified 0 Interpretable Video Captioning via Trajectory Structured Localization Jun 1, 2018 Decoder Image Captioning
— Unverified 0 iPerceive: Applying Common-Sense Reasoning to Multi-Modal Dense Video Captioning and Video Question Answering Nov 16, 2020 Common Sense Reasoning Dense Video Captioning
— Unverified 0 iReason: Multimodal Commonsense Reasoning using Videos and Natural Language with Interpretability Jun 25, 2021 Bias Detection Question Answering
— Unverified 0 It's Just Another Day: Unique Video Captioning by Discriminative Prompting Oct 15, 2024 Video Captioning
— Unverified 0 A Toolchain for Comprehensive Audio/Video Analysis Using Deep Learning Based Multimodal Approach (A use case of riot or violent context detection) May 2, 2024 Acoustic Scene Classification Event Detection
— Unverified 0 Jointly Localizing and Describing Events for Dense Video Captioning Apr 23, 2018 Attribute Dense Video Captioning
— Unverified 0 Joint Syntax Representation Learning and Visual Cue Translation for Video Captioning Oct 1, 2019 POS POS Tagging
— Unverified 0 Knowledge Distillation for Efficient Audio-Visual Video Captioning Jun 16, 2023 Audio-Visual Video Captioning Caption Generation
— Unverified 0 Knowledge Guided Entity-aware Video Captioning and A Basketball Benchmark Jan 25, 2024 Decoder Video Captioning
— Unverified 0 FINECAPTION: Compositional Image Captioning Focusing on Wherever You Want at Any Granularity Nov 23, 2024 Attribute Cross-Modal Retrieval
— Unverified 0 LASER: A Neuro-Symbolic Framework for Learning Spatial-Temporal Scene Graphs with Weak Supervision Apr 15, 2023 Language Modeling Language Modelling
— Unverified 0 Fill-in-the-Blank: A Challenging Video Understanding Evaluation Framework Nov 16, 2021 Multiple-choice Question Answering
— Unverified 0 Rethinking and Improving Natural Language Generation with Layer-Wise Multi-View Decoding May 16, 2020 Abstractive Text Summarization Decoder
— Unverified 0 Learning Actions from Human Demonstration Video for Robotic Manipulation Sep 10, 2019 Video Captioning
— Unverified 0 Learning Audio-Video Modalities from Image Captions Apr 1, 2022 Image Captioning Retrieval
— Unverified 0 Fighting FIRe with FIRE: Assessing the Validity of Text-to-Video Retrieval Benchmarks Oct 10, 2022 Retrieval Text to Video Retrieval
— Unverified 0 Learning Interactive Real-World Simulators Oct 9, 2023 Video Captioning
— Unverified 0 Exploring the Role of Audio in Video Captioning Jun 21, 2023 Automatic Speech Recognition Automatic Speech Recognition (ASR)
— Unverified 0 Learning to Compose Topic-Aware Mixture of Experts for Zero-Shot Video Captioning Nov 7, 2018 Mixture-of-Experts Video Captioning
— Unverified 0 Exploring Temporal Event Cues for Dense Video Captioning in Cyclic Co-learning Dec 16, 2024 Contrastive Learning Dense Video Captioning
— Unverified 0 Exploring Group Video Captioning with Efficient Relational Approximation Jan 1, 2023 Video Captioning
— Unverified 0 Less Is More: Picking Informative Frames for Video Captioning Mar 5, 2018 Decoder Diversity
— Unverified 0 A Shared Task on Multimodal Machine Translation and Crosslingual Image Description Aug 1, 2016 Image Description Image Retrieval
— Unverified 0 Exploration of Visual Features and their weighted-additive fusion for Video Captioning Jan 14, 2021 Video Captioning
— Unverified 0 LongCaptioning: Unlocking the Power of Long Caption Generation in Large Multimodal Models Feb 21, 2025 Caption Generation Video Captioning
— Unverified 0 LongVILA: Scaling Long-Context Visual Language Models for Long Videos Aug 19, 2024 Video Captioning Video Question Answering
— Unverified 0 Low-Rank HOCA: Efficient High-Order Cross-Modal Attention for Video Captioning Nov 1, 2019 Decoder Tensor Decomposition
— Unverified 0 Exploiting long-term temporal dynamics for video captioning Feb 22, 2022 Video Captioning
— Unverified 0 Exo2EgoDVC: Dense Video Captioning of Egocentric Procedural Activities Using Web Instructional Videos Nov 28, 2023 Dense Video Captioning Transfer Learning
— Unverified 0 M3: Multimodal Memory Modelling for Video Captioning Jun 1, 2018 Sentence Video Captioning
— Unverified 0 EVLM: An Efficient Vision-Language Model for Visual Understanding Jul 19, 2024 Image Captioning Language Modeling
— Unverified 0 Video LLMs for Temporal Reasoning in Long Videos Dec 4, 2024 Action Segmentation Dense Video Captioning
— Unverified 0 MAMS: Model-Agnostic Module Selection Framework for Video Captioning Jan 30, 2025 Caption Generation Video Captioning
— Unverified 0 Event-Equalized Dense Video Captioning Jan 1, 2025 Dense Video Captioning Video Captioning
— Unverified 0 MAViC: Multimodal Active Learning for Video Captioning Dec 11, 2022 Active Learning Decoder
— Unverified 0 MCF-VC: Mitigate Catastrophic Forgetting in Class-Incremental Learning for Multimodal Video Captioning Feb 27, 2024 class-incremental learning Class Incremental Learning
— Unverified 0 ARGUS: Hallucination and Omission Evaluation in Video-LLMs Jun 9, 2025 Descriptive Form
— Unverified 0 EVC-MF: End-to-end Video Captioning Network with Multi-scale Features Oct 22, 2024 Decoder Video Captioning
— Unverified 0 VideoOFA: Two-Stage Pre-Training for Video-to-Text Generation May 4, 2023 Decoder Question Answering
— Unverified 0 Memory-Attended Recurrent Network for Video Captioning May 10, 2019 Decoder Video Captioning
— Unverified 0 Video Paragraph Captioning Using Hierarchical Recurrent Neural Networks Oct 26, 2015 Sentence Video Captioning
— Unverified 0 Middle-Out Decoding Oct 28, 2018 Decoder Diversity
— Unverified 0 MMCOMPOSITION: Revisiting the Compositionality of Pre-trained Vision-Language Models Oct 13, 2024 Cross-Modal Retrieval Question Answering
— Unverified 0 Modality Alignment between Deep Representations for Effective Video-and-Language Learning Jun 1, 2022 Question Answering Video Captioning
— Unverified 0 Models See Hallucinations: Evaluating the Factuality in Video Captioning Mar 6, 2023 Text Generation Video Captioning
— Unverified 0 