PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models May 23, 2022 Language Modeling Language Modelling
Code Code Available Making the Most of Text Semantics to Improve Biomedical Vision--Language Processing Apr 21, 2022 Contrastive Learning Language Modeling
Code Code Available Unsupervised Vision-Language Parsing: Seamlessly Bridging Visual Scene Graphs with Language Structures via Dependency Relationships Mar 27, 2022 Contrastive Learning Phrase Grounding
Code Code Available Lite-MDETR: A Lightweight Multi-Modal Detector Jan 1, 2022 object-detection Object Detection
— Unverified Improving Pre-trained Vision-and-Language Embeddings for Phrase Grounding Nov 1, 2021 Multimodal Reasoning Phrase Grounding
— Unverified Unsupervised Vision-Language Grammar Induction with Shared Structure Modeling Sep 29, 2021 Contrastive Learning Phrase Grounding
— Unverified Grounding Plural Phrases: Countering Evaluation Biases by Individuation Jun 1, 2021 Phrase Grounding
— Unverified MDETR -- Modulated Detection for End-to-End Multi-Modal Understanding Apr 26, 2021 Generalized Referring Expression Comprehension Phrase Grounding
Code Code Available Detector-Free Weakly Supervised Grounding by Separation Apr 20, 2021 Phrase Grounding
Code Code Available Disentangled Motif-aware Graph Learning for Phrase Grounding Apr 13, 2021 Diversity Graph Learning
— Unverified MDETR - Modulated Detection for End-to-End Multi-Modal Understanding Jan 1, 2021 Phrase Grounding Question Answering
Code Code Available Utilizing Every Image Object for Semi-supervised Phrase Grounding Nov 5, 2020 Phrase Grounding Referring Expression
— Unverified Learning to ground medical text in a 3D human atlas Nov 1, 2020 Phrase Grounding Visual Grounding
Code Code Available MAF: Multimodal Alignment Framework for Weakly-Supervised Phrase Grounding Oct 12, 2020 Phrase Grounding
Code Code Available Propagating Over Phrase Relations for One-Stage Visual Grounding Aug 1, 2020 Phrase Grounding Relational Reasoning
— Unverified Improving Weakly Supervised Visual Grounding by Contrastive Knowledge Distillation Jul 3, 2020 Contrastive Learning Knowledge Distillation
Code Code Available Neural Parameter Allocation Search Jun 18, 2020 Image Classification Phrase Grounding
Code Code Available Contrastive Learning for Weakly Supervised Phrase Grounding Jun 17, 2020 Contrastive Learning Language Modeling
Code Code Available Learning Cross-modal Context Graph for Visual Grounding Feb 13, 2020 Graph Matching Graph Neural Network
Code Code Available Phrase Grounding by Soft-Label Chain Conditional Random Field Sep 1, 2019 Phrase Grounding Structured Prediction
Code Code Available Zero-Shot Grounding of Objects from Natural Language Queries Aug 20, 2019 Natural Language Queries object-detection
Code Code Available Language Features Matter: Effective Language Representations for Vision-Language Tasks Aug 17, 2019 Image Captioning Language Modelling
— Unverified Modularized Textual Grounding for Counterfactual Resilience Apr 7, 2019 Attribute counterfactual
Code Code Available Align2Ground: Weakly Supervised Phrase Grounding Guided by Image-Caption Alignment Mar 27, 2019 Image Retrieval Phrase Grounding
— Unverified Neural Sequential Phrase Grounding (SeqGROUND) Mar 18, 2019 Phrase Grounding
— Unverified PIRC Net : Using Proposal Indexing, Relationships and Context for Phrase Grounding Dec 7, 2018 Phrase Grounding Sentence
— Unverified Multi-level Multimodal Common Semantic Space for Image-Phrase Grounding Nov 28, 2018 Language Modeling Language Modelling
Code Code Available Revisiting Image-Language Networks for Open-ended Phrase Detection Nov 17, 2018 object-detection Object Detection
Code Code Available Dynamic Conditional Networks for Few-Shot Learning Sep 1, 2018 Face Generation Few-Shot Learning
— Unverified Rethinking Diversified and Discriminative Proposal Generation for Visual Grounding May 9, 2018 Diversity Phrase Grounding
Code Code Available Knowledge Aided Consistency for Weakly Supervised Phrase Grounding Mar 11, 2018 Phrase Grounding
— Unverified Conditional Image-Text Embedding Networks Nov 22, 2017 Phrase Grounding
Code Code Available Query-guided Regression Network with Context Policy for Phrase Grounding Aug 4, 2017 Phrase Grounding regression
— Unverified Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding Jun 6, 2016 Phrase Grounding Visual Grounding
Code Code Available Learning Deep Structure-Preserving Image-Text Embeddings Nov 19, 2015 Image Retrieval Image to text
— Unverified Natural Language Object Retrieval Nov 13, 2015 Image Captioning Image Retrieval
Code Code Available Grounding of Textual Phrases in Images by Reconstruction Nov 12, 2015 Language Modeling Language Modelling
Code Code Available Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Models May 19, 2015 Image Description Phrase Grounding
Code Code Available 