Multimodal Neural Machine Translation for Low-resource Language Pairs using Synthetic Data Jul 1, 2018 Image Description Machine Translation
— Unverified Pushing the Limits of Radiology with Joint Modeling of Visual and Textual Information Jul 1, 2018 Image Classification Machine Translation
— Unverified Connecting Language and Vision to Actions Jul 1, 2018 Image Captioning Language Modeling
— Unverified Semantically Equivalent Adversarial Rules for Debugging NLP models Jul 1, 2018 Data Augmentation Question Answering
Code Code Available Bridging Languages through Images with Deep Partial Canonical Correlation Analysis Jul 1, 2018 Image Description Image Retrieval
Code Code Available End-to-End Audio Visual Scene-Aware Dialog using Multimodal Attention-Based Video Features Jun 21, 2018 Question Answering Video Description
Code Code Available Learning Conditioned Graph Structures for Interpretable Visual Question Answering Jun 19, 2018 Question Answering Visual Question Answering
Code Code Available Learning Visual Knowledge Memory Networks for Visual Question Answering Jun 13, 2018 Question Answering Visual Question Answering
— Unverified iParaphrasing: Extracting Visually Grounded Paraphrases via an Image Jun 12, 2018 Image Captioning Question Answering
Code Code Available Learning Answer Embeddings for Visual Question Answering Jun 10, 2018 Question Answering Transfer Learning
— Unverified Cross-Dataset Adaptation for Visual Question Answering Jun 10, 2018 Domain Adaptation Question Answering
— Unverified CS-VQA: Visual Question Answering with Compressively Sensed Images Jun 8, 2018 Question Answering Visual Question Answering
— Unverified Focal Visual-Text Attention for Visual Question Answering Jun 5, 2018 Memex Question Answering Question Answering
Code Code Available On the Flip Side: Identifying Counterexamples in Visual Question Answering Jun 3, 2018 Question Answering Visual Question Answering
— Unverified Categorizing Concepts With Basic Level for Vision-to-Language Jun 1, 2018 Clustering Image Captioning
— Unverified Stacked Latent Attention for Multimodal Reasoning Jun 1, 2018 Image Captioning Multimodal Reasoning
— Unverified An Evaluation of Image-Based Verb Prediction Models against Human Eye-Tracking Data Jun 1, 2018 General Classification Question Answering
— Unverified Visually Guided Spatial Relation Extraction from Text Jun 1, 2018 Activity Recognition Image Captioning
— Unverified Stacking with Auxiliary Features for Visual Question Answering Jun 1, 2018 Common Sense Reasoning Question Answering
— Unverified Hyperbolic Attention Networks May 24, 2018 Machine Translation Question Answering
— Unverified R-VQA: Learning Visual Relation Facts with Semantic Attention for Visual Question Answering May 24, 2018 Question Answering Relation
Code Code Available Joint Image Captioning and Question Answering May 22, 2018 Image Captioning Question Answering
— Unverified Bilinear Attention Networks May 21, 2018 Visual Question Answering Visual Question Answering (VQA)
Code Code Available Reproducibility Report for "Learning To Count Objects In Natural Images For Visual Question Answering" May 21, 2018 Question Answering Visual Question Answering
— Unverified Did the Model Understand the Question? May 14, 2018 model Question Answering
Code Code Available Reciprocal Attention Fusion for Visual Question Answering May 11, 2018 Object Question Answering
— Unverified Edit me: A Corpus and a Framework for Understanding Natural Language Image Editing May 1, 2018 Image Captioning Question Answering
— Unverified Augmenting Image Question Answering Dataset by Exploiting Image Captions May 1, 2018 Data Augmentation Image Captioning
— Unverified Action Verb Corpus May 1, 2018 Action Classification Language Acquisition
— Unverified Visual Choice of Plausible Alternatives: An Evaluation of Image-based Commonsense Causal Reasoning May 1, 2018 Commonsense Causal Reasoning Image Captioning
Code Code Available Enhancing the AI2 Diagrams Dataset Using Rhetorical Structure Theory May 1, 2018 Question Answering Visual Question Answering (VQA)
Code Code Available Large Scale Scene Text Verification with Guided Attention Apr 23, 2018 Question Answering Scene Text Detection
— Unverified ECG Heartbeat Classification: A Deep Transferable Representation Apr 19, 2018 Arrhythmia Detection Electrocardiography (ECG)
Code Code Available Question Type Guided Attention in Visual Question Answering Apr 6, 2018 Activity Recognition Question Answering
— Unverified Improved Fusion of Visual and Language Representations by Dense Symmetric Co-Attention for Visual Question Answering Apr 3, 2018 Visual Question Answering Visual Question Answering (VQA)
Code Code Available Differential Attention for Visual Question Answering Apr 1, 2018 Question Answering Visual Question Answering
Code Code Available Visual Question Reasoning on General Dependency Tree Mar 31, 2018 Question Answering Visual Question Answering
— Unverified DDRprog: A CLEVR Differentiable Dynamic Reasoning Programmer Mar 30, 2018 Question Answering Visual Question Answering
— Unverified Two can play this Game: Visual Dialog with Discriminative Question Generation and Answering Mar 29, 2018 Image Captioning Question Answering
— Unverified Motion-Appearance Co-Memory Networks for Video Question Answering Mar 29, 2018 Question Answering Video Question Answering
— Unverified Generalized Hadamard-Product Fusion Operators for Visual Question Answering Mar 26, 2018 Neural Architecture Search Question Answering
— Unverified Explicit Reasoning over End-to-End Neural Architectures for Visual Question Answering Mar 23, 2018 Question Answering Visual Question Answering
— Unverified Attention on Attention: Architectures for Visual Question Answering (VQA) Mar 21, 2018 GPU Question Answering
Code Code Available VQA-E: Explaining, Elaborating, and Enhancing Your Answers for Visual Questions Mar 20, 2018 Explanatory Visual Question Answering Multi-Task Learning
— Unverified Inverse Visual Question Answering: A New Benchmark and VQA Diagnosis Tool Mar 16, 2018 Question Answering Reinforcement Learning
— Unverified A Dataset and Architecture for Visual Reasoning with a Working Memory Mar 16, 2018 Diagnostic Logical Reasoning
Code Code Available Transparency by Design: Closing the Gap Between Performance and Interpretability in Visual Reasoning Mar 14, 2018 Question Answering Visual Question Answering
Code Code Available Compositional Attention Networks for Machine Reasoning Mar 8, 2018 Referring Expression Comprehension Visual Question Answering (VQA)
Code Code Available VizWiz Grand Challenge: Answering Visual Questions from Blind People Feb 22, 2018 Question Answering Visual Question Answering
Code Code Available Learning to Count Objects in Natural Images for Visual Question Answering Feb 15, 2018 Visual Question Answering Visual Question Answering (VQA)
Code Code Available 