Multimodal Explanations: Justifying Decisions and Pointing to the Evidence Feb 15, 2018 Activity Recognition Explainable Models
Code Code Available Generating Triples with Adversarial Networks for Scene Graph Construction Feb 7, 2018 Attribute graph construction
— Unverified Dual Recurrent Attention Units for Visual Question Answering Feb 1, 2018 Question Answering Visual Question Answering
Code Code Available Object-based reasoning in VQA Jan 29, 2018 Object object-detection
— Unverified Game of Sketches: Deep Recurrent Models of Pictionary-style Word Guessing Jan 29, 2018 Question Answering Visual Question Answering
Code Code Available Tell-and-Answer: Towards Explainable Visual Question Answering using Attributes and Captions Jan 27, 2018 Attribute Image Captioning
— Unverified Structured Triplet Learning with POS-tag Guided Attention for Visual Question Answering Jan 24, 2018 Multiple-choice POS
Code Code Available DVQA: Understanding Data Visualizations via Question Answering Jan 24, 2018 Articles Chart Question Answering
Code Code Available Not-So-CLEVR: Visual Relations Strain Feedforward Neural Networks Jan 1, 2018 Memorization Question Answering
— Unverified Interpretable Counting for Visual Question Answering Dec 23, 2017 Question Answering Visual Question Answering
— Unverified Visual Explanations from Hadamard Product in Multimodal Deep Networks Dec 18, 2017 Question Answering Visual Question Answering
— Unverified AI2-THOR: An Interactive 3D Environment for Visual AI Dec 14, 2017 Deep Reinforcement Learning Imitation Learning
Code Code Available IQA: Visual Question Answering in Interactive Environments Dec 9, 2017 Navigate Reinforcement Learning
Code Code Available Learning by Asking Questions Dec 4, 2017 Question Answering Visual Question Answering
— Unverified Incorporating External Knowledge to Answer Open-Domain Visual Questions with Dynamic Memory Networks Dec 3, 2017 Question Answering Visual Question Answering
— Unverified Multimodal Learning and Reasoning for Visual Question Answering Dec 1, 2017 Question Answering Representation Learning
— Unverified Don't Just Assume; Look and Answer: Overcoming Priors for Visual Question Answering Dec 1, 2017 Question Answering Visual Question Answering
Code Code Available Hyper-dimensional computing for a visual question-answering system that is trainable end-to-end Nov 28, 2017 Question Answering Visual Question Answering
— Unverified Locally Smoothed Neural Networks Nov 22, 2017 Face Verification Question Answering
Code Code Available Visual Question Answering as a Meta Learning Task Nov 22, 2017 Meta-Learning Question Answering
— Unverified Are You Talking to Me? Reasoned Visual Dialog Generation through Adversarial Learning Nov 21, 2017 Question Answering Reinforcement Learning
— Unverified Adversarial Attacks Beyond the Image Space Nov 20, 2017 Question Answering Visual Question Answering
— Unverified Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environments Nov 20, 2017 Reinforcement Learning Translation
Code Code Available Co-attending Regions and Detections with Multi-modal Multiplicative Embedding for VQA Nov 18, 2017 Form Question Answering
Code Code Available Co-attending Free-form Regions and Detections with Multi-modal Multiplicative Feature Embedding for Visual Question Answering Nov 18, 2017 Form Visual Question Answering
Code Code Available Attentive Explanations: Justifying Decisions and Pointing to the Evidence (Extended Abstract) Nov 17, 2017 Question Answering Visual Question Answering (VQA)
— Unverified A Novel Framework for Robustness Analysis of Visual QA Models Nov 16, 2017 Question Answering Visual Question Answering
— Unverified High-Order Attention Models for Visual Question Answering Nov 12, 2017 Question Answering Visual Question Answering
Code Code Available Active Learning for Visual Question Answering: An Empirical Study Nov 6, 2017 Active Learning Visual Question Answering
Code Code Available FigureQA: An Annotated Figure Dataset for Visual Reasoning Oct 19, 2017 BIG-bench Machine Learning Chart Question Answering
Code Code Available iVQA: Inverse Visual Question Answering Oct 10, 2017 Question Answering Question Generation
— Unverified Fooling Vision and Language Models Despite Localization and Attention Mechanism Sep 25, 2017 Dense Captioning Natural Language Understanding
— Unverified Survey of Recent Advances in Visual Question Answering Sep 24, 2017 Question Answering Survey
— Unverified Visual Reference Resolution using Attention Memory for Visual Dialog Sep 23, 2017 Parameter Prediction Question Answering
— Unverified FiLM: Visual Reasoning with a General Conditioning Layer Sep 22, 2017 Image Retrieval with Multi-Modal Query Visual Question Answering (VQA)
Code Code Available Visual Question Generation as Dual Task of Visual Question Answering Sep 21, 2017 Question Answering Question Generation
— Unverified Exploring Human-like Attention Supervision in Visual Question Answering Sep 19, 2017 Question Answering Visual Question Answering
— Unverified Robustness Analysis of Visual QA Models by Basic Questions Sep 14, 2017 Question Answering Visual Question Answering
— Unverified Memory Augmented Neural Networks for Natural Language Processing Sep 1, 2017 AI Agent Language Modeling
— Unverified Spatial Language Understanding with Multimodal Graphs using Declarative Learning based Programming Sep 1, 2017 Image Captioning Image Retrieval
— Unverified Data Augmentation for Visual Question Answering Sep 1, 2017 Data Augmentation General Classification
— Unverified Sheffield MultiMT: Using Object Posterior Predictions for Multimodal Machine Translation Sep 1, 2017 Image Captioning Image Classification
— Unverified VQS: Linking Segmentations to Questions and Answers for Supervised Attention in VQA and Question-Focused Semantic Segmentation Aug 15, 2017 Language Modeling Language Modelling
Code Code Available Beyond Bilinear: Generalized Multimodal Factorized High-order Pooling for Visual Question Answering Aug 10, 2017 Question Answering Visual Question Answering
Code Code Available Learning to Disambiguate by Asking Discriminative Questions Aug 9, 2017 Benchmarking Image Captioning
— Unverified Tips and Tricks for Visual Question Answering: Learnings from the 2017 Challenge Aug 9, 2017 GPU Visual Question Answering
Code Code Available Structured Attentions for Visual Question Answering Aug 7, 2017 Visual Question Answering Visual Question Answering (VQA)
Code Code Available Multi-modal Factorized Bilinear Pooling with Co-Attention Learning for Visual Question Answering Aug 4, 2017 Question Answering Visual Question Answering
Code Code Available A Simple Loss Function for Improving the Convergence and Accuracy of Visual Question Answering Models Aug 2, 2017 Question Answering Visual Question Answering
Code Code Available Spectral Graph-Based Method of Multimodal Word Embedding Aug 1, 2017 Graph Embedding Image Retrieval
— Unverified 