VQS: Linking Segmentations to Questions and Answers for Supervised Attention in VQA and Question-Focused Semantic Segmentation Aug 15, 2017 Language Modeling Language Modelling
Code Code Available Beyond Bilinear: Generalized Multimodal Factorized High-order Pooling for Visual Question Answering Aug 10, 2017 Question Answering Visual Question Answering
Code Code Available Learning to Disambiguate by Asking Discriminative Questions Aug 9, 2017 Benchmarking Image Captioning
— Unverified Tips and Tricks for Visual Question Answering: Learnings from the 2017 Challenge Aug 9, 2017 GPU Visual Question Answering
Code Code Available Structured Attentions for Visual Question Answering Aug 7, 2017 Visual Question Answering Visual Question Answering (VQA)
Code Code Available Multi-modal Factorized Bilinear Pooling with Co-Attention Learning for Visual Question Answering Aug 4, 2017 Question Answering Visual Question Answering
Code Code Available A Simple Loss Function for Improving the Convergence and Accuracy of Visual Question Answering Models Aug 2, 2017 Question Answering Visual Question Answering
Code Code Available Spectral Graph-Based Method of Multimodal Word Embedding Aug 1, 2017 Graph Embedding Image Retrieval
— Unverified Improved Bilinear Pooling with CNNs Jul 21, 2017 GPU Question Answering
— Unverified Video Question Answering via Attribute-Augmented Attention Network Learning Jul 20, 2017 Attribute Information Retrieval
— Unverified Visual Question Answering with Memory-Augmented Networks Jul 17, 2017 Question Answering Visual Question Answering
— Unverified Effective Approaches to Batch Parallelization for Dynamic Neural Network Architectures Jul 8, 2017 Mixture-of-Experts Question Answering
Code Code Available Modulating early visual processing by language Jul 2, 2017 Question Answering Visual Question Answering
Code Code Available Multimodal Machine Learning: Integrating Language, Vision and Speech Jul 1, 2017 Audio-Visual Speech Recognition BIG-bench Machine Learning
— Unverified Are You Smarter Than a Sixth Grader? Textbook Question Answering for Multimodal Machine Comprehension Jul 1, 2017 Question Answering Reading Comprehension
— Unverified Kernel Pooling for Convolutional Neural Networks Jul 1, 2017 Face Recognition Fine-Grained Visual Categorization
— Unverified Knowledge Acquisition for Visual Question Answering via Iterative Querying Jul 1, 2017 Question Answering Visual Question Answering
— Unverified Multi-Level Attention Networks for Visual Question Answering Jul 1, 2017 Question Answering Visual Question Answering
— Unverified A Corpus of Natural Language for Visual Reasoning Jul 1, 2017 Question Answering Visual Question Answering (VQA)
— Unverified Segmentation Guided Attention Networks for Visual Question Answering Jul 1, 2017 Common Sense Reasoning Question Answering
— Unverified Compact Tensor Pooling for Visual Question Answering Jun 20, 2017 Question Answering Visual Question Answering
— Unverified Deep learning evaluation using deep linguistic processing Jun 5, 2017 Deep Learning Multimodal Deep Learning
— Unverified A simple neural network module for relational reasoning Jun 5, 2017 Image Retrieval with Multi-Modal Query Question Answering
Code Code Available Learning Convolutional Text Representations for Visual Question Answering May 18, 2017 General Classification image-classification
Code Code Available MUTAN: Multimodal Tucker Fusion for Visual Question Answering May 18, 2017 Visual Question Answering Visual Question Answering (VQA)
Code Code Available Inferring and Executing Programs for Visual Reasoning May 10, 2017 Visual Question Answering (VQA) Visual Reasoning
Code Code Available Survey of Visual Question Answering: Datasets and Techniques May 10, 2017 Deep Learning Question Answering
— Unverified The Forgettable-Watcher Model for Video Question Answering May 3, 2017 model Question Answering
— Unverified Speech-Based Visual Question Answering May 1, 2017 Automatic Speech Recognition Automatic Speech Recognition (ASR)
Code Code Available The Promise of Premise: Harnessing Question Premises in Visual Question Answering May 1, 2017 Question Answering Relevance Detection
Code Code Available C-VQA: A Compositional Split of the Visual Question Answering (VQA) v1.0 Dataset Apr 26, 2017 Question Answering Visual Question Answering
— Unverified Being Negative but Constructively: Lessons Learnt from Creating Better Visual Question Answering Datasets Apr 24, 2017 Multiple-choice Question Answering
— Unverified Learning to Reason: End-to-End Module Networks for Visual Question Answering Apr 18, 2017 Visual Dialog Visual Question Answering
Code Code Available TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answering Apr 14, 2017 Question Answering Visual Question Answering
Code Code Available ShapeWorld - A new test methodology for multimodal language understanding Apr 14, 2017 Multimodal Deep Learning Visual Question Answering
Code Code Available What's in a Question: Using Visual Questions as a Form of Supervision Apr 12, 2017 Data Augmentation Form
Code Code Available Show, Ask, Attend, and Answer: A Strong Baseline For Visual Question Answering Apr 11, 2017 Visual Question Answering Visual Question Answering (VQA)
Code Code Available An Empirical Evaluation of Visual Question Answering for Novel Objects Apr 8, 2017 Question Answering Visual Question Answering
— Unverified It Takes Two to Tango: Towards Theory of AI's Mind Apr 3, 2017 Attribute Question Answering
— Unverified Aligned Image-Word Representations Improve Inductive Transfer Across Vision-Language Tasks Apr 2, 2017 Multi-Task Learning Question Answering
— Unverified An Analysis of Visual Question Answering Algorithms Mar 28, 2017 Question Answering Visual Question Answering
— Unverified Multimodal Compact Bilinear Pooling for Multimodal Neural Machine Translation Mar 23, 2017 Decoder Machine Translation
— Unverified Recurrent and Contextual Models for Visual Question Answering Mar 23, 2017 Diversity Multiple-choice
— Unverified VQABQ: Visual Question Answering by Basic Questions Mar 19, 2017 Question Answering Visual Question Answering
— Unverified End-to-end optimization of goal-driven and visually grounded dialogue systems Mar 15, 2017 Decoder Deep Reinforcement Learning
Code Code Available Tree Memory Networks for Modelling Long-term Temporal Dependencies Mar 12, 2017 Machine Translation Part-Of-Speech Tagging
— Unverified Task-driven Visual Saliency and Attention-based Visual Question Answering Feb 22, 2017 Question Answering Visual Question Answering
— Unverified Vision and Language Integration: Moving beyond Objects Jan 1, 2017 Action Classification Image Captioning
— Unverified The VQA-Machine: Learning How to Use Existing Vision Algorithms to Answer New Questions Dec 16, 2016 BIG-bench Machine Learning Question Answering
— Unverified Attentive Explanations: Justifying Decisions and Pointing to the Evidence Dec 14, 2016 Decision Making Question Answering
— Unverified 