Propagating Over Phrase Relations for One-Stage Visual Grounding Aug 1, 2020 Phrase Grounding Relational Reasoning
— Unverified Spatially Aware Multimodal Transformers for TextVQA Jul 23, 2020 Optical Character Recognition (OCR) Spatial Reasoning
Code Code Available Visual Relation Grounding in Videos Jul 17, 2020 Question Answering Relation
Code Code Available Reducing Language Biases in Visual Question Answering with Visually-Grounded Question Encoder Jul 13, 2020 Question Answering Visual Grounding
— Unverified Multi-Granularity Modularized Network for Abstract Visual Reasoning Jul 9, 2020 Visual Grounding Visual Reasoning
— Unverified Improving Weakly Supervised Visual Grounding by Contrastive Knowledge Distillation Jul 3, 2020 Contrastive Learning Knowledge Distillation
Code Code Available Knowledge Supports Visual Language Grounding: A Case Study on Colour Terms Jul 1, 2020 Diagnostic Object
— Unverified Fast visual grounding in interaction: bringing few-shot learning with neural networks to an interactive robot Jun 1, 2020 Few-Shot Learning Transfer Learning
— Unverified Visual Grounding Annotation of Recipe Flow Graph May 1, 2020 Visual Grounding
— Unverified Visual Grounding of Learned Physical Models Apr 28, 2020 Visual Grounding
Code Code Available Deep Multimodal Neural Architecture Search Apr 25, 2020 Decoder Image-text matching
Code Code Available Visual Grounding Methods for VQA are Working for the Wrong Reasons! Apr 12, 2020 Question Answering Visual Grounding
Code Code Available Spatio-Temporal Graph for Video Captioning with Knowledge Distillation Mar 31, 2020 Knowledge Distillation Object
— Unverified Giving Commands to a Self-driving Car: A Multimodal Reasoner for Visual Grounding Mar 19, 2020 Object Referring Expression Comprehension
— Unverified Visual Grounding in Video for Unsupervised Word Translation Mar 11, 2020 Translation Visual Grounding
Code Code Available Guessing State Tracking for Visual Dialogue Feb 24, 2020 Visual Grounding
Code Code Available Emergent Communication with World Models Feb 22, 2020 Visual Grounding
— Unverified Learning Cross-modal Context Graph for Visual Grounding Feb 13, 2020 Graph Matching Graph Neural Network
Code Code Available Exploring Context, Attention and Audio Features for Audio Visual Scene-Aware Dialog Dec 20, 2019 Audio Classification Visual Grounding
— Unverified Connecting Vision and Language with Localized Narratives Dec 6, 2019 Form Image Captioning
Code Code Available Compositional Temporal Visual Grounding of Natural Language Event Descriptions Dec 4, 2019 Visual Grounding
— Unverified OptiBox: Breaking the Limits of Proposals for Visual Grounding Nov 29, 2019 Image Captioning Visual Grounding
— Unverified Learning Cross-modal Context Graph for Visual Grounding Nov 20, 2019 Graph Matching Graph Neural Network
Code Code Available Leveraging Past References for Robust Language Grounding Nov 1, 2019 Object Referring Expression
— Unverified Countering Language Drift via Visual Grounding Sep 10, 2019 Language Modeling Language Modelling
— Unverified Language learning using Speech to Image retrieval Sep 9, 2019 Grounded language learning Image Retrieval
— Unverified Differentiable Disentanglement Filter: an Application Agnostic Core Concept Discovery Probe Sep 4, 2019 Disentanglement Visual Grounding
— Unverified A Fast and Accurate One-Stage Approach to Visual Grounding Aug 18, 2019 Referring Expression Referring Expression Comprehension
Code Code Available Multimodal Unified Attention Networks for Vision-and-Language Interactions Aug 12, 2019 Question Answering Visual Grounding
— Unverified ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks Aug 6, 2019 Image Retrieval Question Answering
Code Code Available Differentiable Disentanglement Filter: an Application Agnostic Core Concept Discovery Probe Jul 17, 2019 Disentanglement Visual Grounding
— Unverified Transfer Learning from Audio-Visual Grounding to Speech Recognition Jul 9, 2019 speech-recognition Speech Recognition
— Unverified Joint Visual Grounding with Language Scene Graphs Jun 9, 2019 Referring Expression Visual Grounding
— Unverified Visually Grounded Neural Syntax Acquisition Jun 7, 2019 Visual Grounding
— Unverified Learning to Compose and Reason with Language Tree Structures for Visual Grounding Jun 5, 2019 Visual Grounding Visual Reasoning
— Unverified On the Contributions of Visual and Textual Supervision in Low-Resource Semantic Speech Retrieval Apr 24, 2019 Retrieval Visual Grounding
— Unverified Semantic query-by-example speech search using visual grounding Apr 15, 2019 Retrieval Semantic Retrieval
Code Code Available Modularized Textual Grounding for Counterfactual Resilience Apr 7, 2019 Attribute counterfactual
Code Code Available VQD: Visual Query Detection in Natural Scenes Apr 4, 2019 Referring Expression Referring Expression Comprehension
— Unverified Revisiting Visual Grounding Apr 3, 2019 Image Retrieval Retrieval
— Unverified Learning semantic sentence representations from visually grounded language without lexical knowledge Mar 27, 2019 Grounded language learning Learning Semantic Representations
Code Code Available Align2Ground: Weakly Supervised Phrase Grounding Guided by Image-Caption Alignment Mar 27, 2019 Image Retrieval Phrase Grounding
— Unverified Dual Attention Networks for Visual Reference Resolution in Visual Dialog Feb 25, 2019 AI Agent Question Answering
Code Code Available You Only Look & Listen Once: Towards Fast and Accurate Visual Grounding Feb 12, 2019 object-detection Object Detection
Code Code Available Taking a HINT: Leveraging Explanations to Make Vision and Language Models More Grounded Feb 11, 2019 Image Captioning Question Answering
— Unverified Learning to Assemble Neural Module Tree Networks for Visual Grounding Dec 8, 2018 Dependency Parsing Natural Language Visual Grounding
— Unverified Multi-task Learning of Hierarchical Vision-Language Representation Dec 3, 2018 Multi-Task Learning Question Answering
— Unverified Being data-driven is not enough: Revisiting interactive instruction giving as a challenge for NLG Nov 1, 2018 Text Generation Visual Grounding
— Unverified Overcoming Language Priors in Visual Question Answering with Adversarial Regularization Oct 8, 2018 Question Answering Visual Grounding
— Unverified Beyond task success: A closer look at jointly learning to see, ask, and GuessWhat Sep 10, 2018 Multi-Task Learning Reinforcement Learning
Code Code Available 