SOTAVerified

Image-text matching

Image-Text Matching is a subtask within Cross-Modal Retrieval (CMR) that involves establishing associations between images and corresponding textual descriptions. The goal is to retrieve an image given a textual query or, conversely, retrieve a textual description given an image query. This task is challenging due to the heterogeneity gap between image and text data representations. Image-text matching is used in applications such as content-based image search, visual question answering, and multimodal summarization.

Assessing Brittleness of Image-Text Retrieval Benchmarks from Vision-Language Models Perspective

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 188 papers

TitleStatusHype
Learning Semantic Relationship Among Instances for Image-Text MatchingCode1
Are Diffusion Models Vision-And-Language Reasoners?Code1
Learning with Noisy Correspondence for Cross-modal MatchingCode1
LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis EvaluationCode1
Adaptive Offline Quintuplet Loss for Image-Text MatchingCode1
MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training ModelCode1
BiCro: Noisy Correspondence Rectification for Multi-modality Data via Bi-directional Cross-modal Similarity ConsistencyCode1
Prototype-based Aleatoric Uncertainty Quantification for Cross-modal RetrievalCode1
RadCLIP: Enhancing Radiologic Image Analysis through Contrastive Language-Image Pre-trainingCode1
ReCon: Enhancing True Correspondence Discrimination through Relation Consistency for Robust Noisy Correspondence LearningCode1
BrainCLIP: Bridging Brain and Visual-Linguistic Representation Via CLIP for Generic Natural Visual Stimulus DecodingCode1
ECCV Caption: Correcting False Negatives by Collecting Machine-and-Human-verified Image-Caption Associations for MS-COCOCode1
Self-supervised vision-language pretraining for Medical visual question answeringCode1
Similarity Reasoning and Filtration for Image-Text MatchingCode1
Stacked Cross Attention for Image-Text MatchingCode1
Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured RepresentationsCode1
Efficient Medical Vision-Language Alignment Through Adapting Masked Vision ModelsCode1
Synthesize, Diagnose, and Optimize: Towards Fine-Grained Vision-Language UnderstandingCode1
Advancing Visual Grounding with Scene Knowledge: Benchmark and MethodCode1
Towards Unified Text-based Person Retrieval: A Large-scale Multi-Attribute and Language Search BenchmarkCode1
Transformer Reasoning Network for Image-Text Matching and RetrievalCode1
CLIP is Strong Enough to Fight Back: Test-time Counterattacks towards Zero-shot Adversarial Robustness of CLIPCode1
Align before Fuse: Vision and Language Representation Learning with Momentum DistillationCode1
UGNCL: Uncertainty-Guided Noisy Correspondence Learning for Efficient Cross-Modal MatchingCode1
Fine-Grained Image-Text Matching by Cross-Modal Hard Aligning NetworkCode1
CLIP Under the Microscope: A Fine-Grained Analysis of Multi-Object RepresentationCode1
Graph Structured Network for Image-Text MatchingCode1
Do Vision-and-Language Transformers Learn Grounded Predicate-Noun Dependencies?Code0
Beyond Image-Text Matching: Verb Understanding in Multimodal Transformers Using Guided MaskingCode0
Learning Two-Branch Neural Networks for Image-Text Matching TasksCode0
Integrating Language Guidance Into Image-Text Matching for Correcting False NegativesCode0
Learning fragment self-attention embeddings for image-text matchingCode0
Dual Attention Networks for Multimodal Reasoning and MatchingCode0
Position Focused Attention Network for Image-Text MatchingCode0
RoCOCO: Robustness Benchmark of MS-COCO to Stress-test Image-Text Matching ModelsCode0
Generative Visual Instruction TuningCode0
Backdoor Attack on Unpaired Medical Image-Text Foundation Models: A Pilot Study on MedCLIPCode0
MALM: Mask Augmentation based Local Matching for Food-Recipe RetrievalCode0
GR-GAN: Gradual Refinement Text-to-image GenerationCode0
Deep Cross-Modal Projection Learning for Image-Text MatchingCode0
Efficient and Long-Tailed Generalization for Pre-trained Vision-Language ModelCode0
Improving Multimodal Classification of Social Media Posts by Leveraging Image-Text Auxiliary TasksCode0
Increasing Textual Context Size Boosts Medical Image-Text MatchingCode0
Align before Search: Aligning Ads Image to Text for Accurate Cross-Modal Sponsored SearchCode0
Matching Images and Text with Multi-modal Tensor Fusion and Re-rankingCode0
Towards Better Multi-modal Keyphrase Generation via Visual Entity Enhancement and Multi-granularity Image Noise FilteringCode0
Enhancing Image-Text Matching with Adaptive Feature AggregationCode0
ALADIN: Distilling Fine-grained Alignment Scores for Efficient Image-Text Matching and RetrievalCode0
Evaluating Attribute Comprehension in Large Vision-Language ModelsCode0
MAGID: An Automated Pipeline for Generating Synthetic Multi-modal DatasetsCode0
Show:102550
← PrevPage 2 of 4Next →

No leaderboard results yet.