A Dataset for Multimodal Question Answering in the Cultural Heritage Domain Dec 1, 2016 Question Answering Speech Recognition
— Unverified Modeling Relationships in Referential Expressions with Compositional Modular Networks Nov 30, 2016 Visual Question Answering (VQA)
Code Code Available Grad-CAM: Why did you say that? Nov 22, 2016 Image Captioning Visual Question Answering
Code Code Available Zero-Shot Visual Question Answering Nov 17, 2016 Question Answering Retrieval
— Unverified Leveraging Video Descriptions to Learn Video Question Answering Nov 12, 2016 Question Answering Video Question Answering
— Unverified Dual Attention Networks for Multimodal Reasoning and Matching Nov 2, 2016 Collaborative Inference Image-text matching
Code Code Available Proposing Plausible Answers for Open-ended Visual Question Answering Oct 20, 2016 Graph Matching Open-Ended Question Answering
— Unverified Hadamard Product for Low-rank Bilinear Pooling Oct 14, 2016 Visual Question Answering Visual Question Answering (VQA)
Code Code Available Open-Ended Visual Question-Answering Oct 9, 2016 Question Answering Sentence
Code Code Available Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization Oct 7, 2016 General Classification Image Attribution
Code Code Available Visual Question Answering: Datasets, Algorithms, and Future Challenges Oct 5, 2016 Question Answering Visual Question Answering
Code Code Available Tutorial on Answering Questions about Images with Deep Learning Oct 4, 2016 Deep Learning Natural Language Understanding
Code Code Available The Color of the Cat is Gray: 1 Million Full-Sentences Visual Question Answering (FSVQA) Sep 21, 2016 Question Answering Sentence
— Unverified Graph-Structured Representations for Visual Question Answering Sep 19, 2016 Multiple-choice Question Answering
— Unverified Measuring Machine Intelligence Through Visual Question Answering Aug 31, 2016 Image Captioning Question Answering
— Unverified Towards Transparent AI Systems: Interpreting Visual Question Answering Models Aug 31, 2016 Question Answering Visual Question Answering
— Unverified Visual Question: Predicting If a Crowd Will Agree on the Answer Aug 29, 2016 Question Answering valid
— Unverified Solving Visual Madlibs with Multiple Cues Aug 11, 2016 Activity Prediction Attribute
— Unverified ``Look, some Green Circles!'': Learning to Quantify from Images Aug 1, 2016 Question Answering Visual Question Answering (VQA)
— Unverified A Shared Task on Multimodal Machine Translation and Crosslingual Image Description Aug 1, 2016 Image Description Image Retrieval
— Unverified Focused Evaluation for Image Description with Binary Forced-Choice Tasks Aug 1, 2016 Image Captioning Image Description
— Unverified Visual Question Answering: A Survey of Methods and Datasets Jul 20, 2016 General Knowledge Survey
Code Code Available Annotation Methodologies for Vision and Language Dataset Creation Jul 10, 2016 Action Recognition Image Description
— Unverified Revisiting Visual Question Answering Baselines Jun 27, 2016 Binary Classification Multiple-choice
Code Code Available Analyzing the Behavior of Visual Question Answering Models Jun 23, 2016 Question Answering Visual Question Answering
Code Code Available Question Relevance in VQA: Identifying Non-Visual And False-Premise Questions Jun 21, 2016 Question Answering Question Similarity
— Unverified DualNet: Domain-Invariant Network for Visual Question Answering Jun 20, 2016 Question Answering Visual Question Answering
— Unverified Human Attention in Visual Question Answering: Do Humans and Deep Networks Look at the Same Regions? Jun 17, 2016 Question Answering Visual Question Answering
— Unverified FVQA: Fact-based Visual Question Answering Jun 17, 2016 Common Sense Reasoning Question Answering
— Unverified Training Recurrent Answering Units with Joint Loss Minimization for VQA Jun 12, 2016 Question Answering Visual Question Answering
— Unverified Human Attention in Visual Question Answering: Do Humans and Deep Networks Look at the Same Regions? Jun 11, 2016 Question Answering Visual Question Answering
— Unverified Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding Jun 6, 2016 Phrase Grounding Visual Grounding
Code Code Available Multimodal Residual Learning for Visual QA Jun 5, 2016 Multiple-choice Question Answering
Code Code Available Answer-Type Prediction for Visual Question Answering Jun 1, 2016 Object Recognition Prediction
— Unverified ``A Distorted Skull Lies in the Bottom Center...'' Identifying Paintings from Text Descriptions Jun 1, 2016 Question Answering Visual Question Answering (VQA)
— Unverified Hierarchical Question-Image Co-Attention for Visual Question Answering May 31, 2016 Visual Dialog Visual Question Answering
Code Code Available End-to-End Instance Segmentation with Recurrent Attention May 30, 2016 Autonomous Driving Image Captioning
Code Code Available Ask Your Neurons: A Deep Learning Approach to Visual Question Answering May 9, 2016 Question Answering Visual Question Answering
Code Code Available Leveraging Visual Question Answering for Image-Caption Ranking May 4, 2016 Image Retrieval Question Answering
— Unverified Learning Models for Actions and Person-Object Interactions with Transfer to Question Answering Apr 16, 2016 General Classification Human-Object Interaction Detection
— Unverified Counting Everyday Objects in Everyday Scenes Apr 12, 2016 Object Object Counting
Code Code Available A Focused Dynamic Attention Model for Visual Question Answering Apr 6, 2016 Question Answering Visual Question Answering
— Unverified Neural Attention Models for Sequence Classification: Analysis and Application to Key Term Extraction and Dialogue Act Detection Mar 31, 2016 Caption Generation Classification
— Unverified A Diagram Is Worth A Dozen Images Mar 24, 2016 Visual Question Answering (VQA)
Code Code Available Image Captioning and Visual Question Answering Based on Attributes and External Knowledge Mar 9, 2016 General Knowledge Image Captioning
— Unverified Dynamic Memory Networks for Visual and Textual Question Answering Mar 4, 2016 Question Answering Visual Question Answering
Code Code Available Neural Self Talk: Image Understanding via Continuous Questioning and Answering Dec 10, 2015 Question Answering Question Generation
— Unverified Simple Baseline for Visual Question Answering Dec 7, 2015 Visual Question Answering Visual Question Answering (VQA)
Code Code Available A Restricted Visual Turing Test for Deep Scene and Event Understanding Dec 6, 2015 Question Answering Video Captioning
— Unverified Are You Talking to a Machine? Dataset and Methods for Multilingual Image Question Dec 1, 2015 Question Answering Sentence
— Unverified 