SOTAVerified

Image-text matching

Image-Text Matching is a subtask within Cross-Modal Retrieval (CMR) that involves establishing associations between images and corresponding textual descriptions. The goal is to retrieve an image given a textual query or, conversely, retrieve a textual description given an image query. This task is challenging due to the heterogeneity gap between image and text data representations. Image-text matching is used in applications such as content-based image search, visual question answering, and multimodal summarization.

Assessing Brittleness of Image-Text Retrieval Benchmarks from Vision-Language Models Perspective

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 188 papers

TitleStatusHype
CCMB: A Large-scale Chinese Cross-modal BenchmarkCode1
Declaration-based Prompt Tuning for Visual Question AnsweringCode1
No Token Left Behind: Explainability-Aided Image Classification and GenerationCode1
ECCV Caption: Correcting False Negatives by Collecting Machine-and-Human-verified Image-Caption Associations for MS-COCOCode1
MVPTR: Multi-Level Semantic Alignment for Vision-Language Pre-Training via Multi-Stage LearningCode1
Negative-Aware Attention Framework for Image-Text MatchingCode1
DenseCLIP: Language-Guided Dense Prediction with Context-Aware PromptingCode1
Learning with Noisy Correspondence for Cross-modal MatchingCode1
Align before Fuse: Vision and Language Representation Learning with Momentum DistillationCode1
A Deep Local and Global Scene-Graph Matching for Image-Text RetrievalCode1
Similarity Reasoning and Filtration for Image-Text MatchingCode1
Learning Dual Semantic Relations with Graph Attention for Image-Text MatchingCode1
MedICaT: A Dataset of Medical Images, Captions, and Textual ReferencesCode1
Universal Weighting Metric Learning for Cross-Modal MatchingCode1
Consensus-Aware Visual-Semantic Embedding for Image-Text MatchingCode1
Deep Multimodal Neural Architecture SearchCode1
Transformer Reasoning Network for Image-Text Matching and RetrievalCode1
Text-Guided Neural Image InpaintingCode1
Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal TransformersCode1
More Grounded Image Captioning by Distilling Image-Text Matching ModelCode1
Graph Structured Network for Image-Text MatchingCode1
Adaptive Offline Quintuplet Loss for Image-Text MatchingCode1
UNITER: UNiversal Image-TExt Representation LearningCode1
Visual Semantic Reasoning for Image-Text MatchingCode1
VL-BERT: Pre-training of Generic Visual-Linguistic RepresentationsCode1
Stacked Cross Attention for Image-Text MatchingCode1
AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial NetworksCode1
TNG-CLIP:Training-Time Negation Data Generation for Negation Awareness of CLIP—0
Descriptive Image-Text Matching with Graded Contextual Similarity—0
Compositional Image-Text Matching and Retrieval by Grounding EntitiesCode0
Instruction-augmented Multimodal Alignment for Image-Text and Element Matching—0
Dependency Structure Augmented Contextual Scoping Framework for Multimodal Aspect-Based Sentiment Analysis—0
MedUnifier: Unifying Vision-and-Language Pre-training on Medical Data with Vision Generation Task using Discrete Visual Representations—0
Object-centric Binding in Contrastive Language-Image Pretraining—0
MASS: Overcoming Language Bias in Image-Text Matching—0
Learning Textual Prompts for Open-World Semi-Supervised Learning—0
Multi-Head Attention Driven Dynamic Visual-Semantic Embedding for Enhanced Image-Text Matching—0
A Concept-Centric Approach to Multi-Modality Learning—0
ViUniT: Visual Unit Tests for More Robust Visual Programming—0
Automatic Prompt Generation and Grounding Object Detection for Zero-Shot Image Anomaly Detection—0
VLM-HOI: Vision Language Models for Interpretable Human-Object Interaction Analysis—0
EntityCLIP: Entity-Centric Image-Text Matching via Multimodal Attentive Contrastive Learning—0
Bridging the Modality Gap: Dimension Information Alignment and Sparse Spatial Constraint for Image-Text Matching—0
DARE: Diverse Visual Question Answering with Robustness Evaluation—0
NEVLP: Noise-Robust Framework for Efficient Vision-Language Pre-training—0
Evaluating Attribute Comprehension in Large Vision-Language ModelsCode0
Towards Deconfounded Image-Text Matching with Causal Inference—0
Dynamic and Compressive Adaptation of Transformers From Images to Videos—0
Efficient and Long-Tailed Generalization for Pre-trained Vision-Language ModelCode0
Generative Visual Instruction TuningCode0
Show:102550
← PrevPage 2 of 4Next →

No leaderboard results yet.