Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering Jul 25, 2017 Image Captioning Visual Question Answering
Code Code Available Improved Bilinear Pooling with CNNs Jul 21, 2017 GPU Question Answering
— Unverified Video Question Answering via Attribute-Augmented Attention Network Learning Jul 20, 2017 Attribute Information Retrieval
— Unverified Visual Question Answering with Memory-Augmented Networks Jul 17, 2017 Question Answering Visual Question Answering
— Unverified Effective Approaches to Batch Parallelization for Dynamic Neural Network Architectures Jul 8, 2017 Mixture-of-Experts Question Answering
Code Code Available Modulating early visual processing by language Jul 2, 2017 Question Answering Visual Question Answering
Code Code Available Multi-Level Attention Networks for Visual Question Answering Jul 1, 2017 Question Answering Visual Question Answering
— Unverified Are You Smarter Than a Sixth Grader? Textbook Question Answering for Multimodal Machine Comprehension Jul 1, 2017 Question Answering Reading Comprehension
— Unverified Kernel Pooling for Convolutional Neural Networks Jul 1, 2017 Face Recognition Fine-Grained Visual Categorization
— Unverified Knowledge Acquisition for Visual Question Answering via Iterative Querying Jul 1, 2017 Question Answering Visual Question Answering
— Unverified Segmentation Guided Attention Networks for Visual Question Answering Jul 1, 2017 Common Sense Reasoning Question Answering
— Unverified Multimodal Machine Learning: Integrating Language, Vision and Speech Jul 1, 2017 Audio-Visual Speech Recognition BIG-bench Machine Learning
— Unverified A Corpus of Natural Language for Visual Reasoning Jul 1, 2017 Question Answering Visual Question Answering (VQA)
— Unverified Compact Tensor Pooling for Visual Question Answering Jun 20, 2017 Question Answering Visual Question Answering
— Unverified A simple neural network module for relational reasoning Jun 5, 2017 Image Retrieval with Multi-Modal Query Question Answering
Code Code Available Deep learning evaluation using deep linguistic processing Jun 5, 2017 Deep Learning Multimodal Deep Learning
— Unverified MUTAN: Multimodal Tucker Fusion for Visual Question Answering May 18, 2017 Visual Question Answering Visual Question Answering (VQA)
Code Code Available ParlAI: A Dialog Research Software Platform May 18, 2017 reinforcement-learning Reinforcement Learning
Code Code Available Learning Convolutional Text Representations for Visual Question Answering May 18, 2017 General Classification image-classification
Code Code Available Survey of Visual Question Answering: Datasets and Techniques May 10, 2017 Deep Learning Question Answering
— Unverified Inferring and Executing Programs for Visual Reasoning May 10, 2017 Visual Question Answering (VQA) Visual Reasoning
Code Code Available The Forgettable-Watcher Model for Video Question Answering May 3, 2017 model Question Answering
— Unverified The Promise of Premise: Harnessing Question Premises in Visual Question Answering May 1, 2017 Question Answering Relevance Detection
Code Code Available Speech-Based Visual Question Answering May 1, 2017 Automatic Speech Recognition Automatic Speech Recognition (ASR)
Code Code Available C-VQA: A Compositional Split of the Visual Question Answering (VQA) v1.0 Dataset Apr 26, 2017 Question Answering Visual Question Answering
— Unverified Being Negative but Constructively: Lessons Learnt from Creating Better Visual Question Answering Datasets Apr 24, 2017 Multiple-choice Question Answering
— Unverified Learning to Reason: End-to-End Module Networks for Visual Question Answering Apr 18, 2017 Visual Dialog Visual Question Answering
Code Code Available ShapeWorld - A new test methodology for multimodal language understanding Apr 14, 2017 Multimodal Deep Learning Visual Question Answering
Code Code Available TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answering Apr 14, 2017 Question Answering Visual Question Answering
Code Code Available What's in a Question: Using Visual Questions as a Form of Supervision Apr 12, 2017 Data Augmentation Form
Code Code Available Show, Ask, Attend, and Answer: A Strong Baseline For Visual Question Answering Apr 11, 2017 Visual Question Answering Visual Question Answering (VQA)
Code Code Available An Empirical Evaluation of Visual Question Answering for Novel Objects Apr 8, 2017 Question Answering Visual Question Answering
— Unverified It Takes Two to Tango: Towards Theory of AI's Mind Apr 3, 2017 Attribute Question Answering
— Unverified Aligned Image-Word Representations Improve Inductive Transfer Across Vision-Language Tasks Apr 2, 2017 Multi-Task Learning Question Answering
— Unverified An Analysis of Visual Question Answering Algorithms Mar 28, 2017 Question Answering Visual Question Answering
— Unverified Recurrent and Contextual Models for Visual Question Answering Mar 23, 2017 Diversity Multiple-choice
— Unverified Multimodal Compact Bilinear Pooling for Multimodal Neural Machine Translation Mar 23, 2017 Decoder Machine Translation
— Unverified Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learning Mar 20, 2017 Deep Reinforcement Learning reinforcement-learning
Code Code Available VQABQ: Visual Question Answering by Basic Questions Mar 19, 2017 Question Answering Visual Question Answering
— Unverified End-to-end optimization of goal-driven and visually grounded dialogue systems Mar 15, 2017 Decoder Deep Reinforcement Learning
Code Code Available Tree Memory Networks for Modelling Long-term Temporal Dependencies Mar 12, 2017 Machine Translation Part-Of-Speech Tagging
— Unverified Task-driven Visual Saliency and Attention-based Visual Question Answering Feb 22, 2017 Question Answering Visual Question Answering
— Unverified Vision and Language Integration: Moving beyond Objects Jan 1, 2017 Action Classification Image Captioning
— Unverified CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoning Dec 20, 2016 Diagnostic Question Answering
Code Code Available The VQA-Machine: Learning How to Use Existing Vision Algorithms to Answer New Questions Dec 16, 2016 BIG-bench Machine Learning Question Answering
— Unverified Attentive Explanations: Justifying Decisions and Pointing to the Evidence Dec 14, 2016 Decision Making Question Answering
— Unverified VIBIKNet: Visual Bidirectional Kernelized Network for Visual Question Answering Dec 12, 2016 Question Answering Visual Question Answering
Code Code Available Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering Dec 2, 2016 Visual Question Answering Visual Question Answering (VQA)
Code Code Available Visual Question Answering with Question Representation Update (QRU) Dec 1, 2016 Question Answering Visual Question Answering
— Unverified The Development of Multimodal Lexical Resources Dec 1, 2016 Question Answering Visual Question Answering (VQA)
— Unverified 