SOTAVerified

Image-text matching

Image-Text Matching is a subtask within Cross-Modal Retrieval (CMR) that involves establishing associations between images and corresponding textual descriptions. The goal is to retrieve an image given a textual query or, conversely, retrieve a textual description given an image query. This task is challenging due to the heterogeneity gap between image and text data representations. Image-text matching is used in applications such as content-based image search, visual question answering, and multimodal summarization.

Assessing Brittleness of Image-Text Retrieval Benchmarks from Vision-Language Models Perspective

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 188 papers

TitleStatusHype
Backdoor Attack on Unpaired Medical Image-Text Foundation Models: A Pilot Study on MedCLIPCode0
Negative Pre-aware for Noisy Cross-modal MatchingCode1
OT-Attack: Enhancing Adversarial Transferability of Vision-Language Models via Optimal Transport Optimization—0
CILF-CIAE: CLIP-driven Image-Language Fusion for Correcting Inverse Age Estimation—0
Synthesize, Diagnose, and Optimize: Towards Fine-Grained Vision-Language UnderstandingCode1
Emergent Open-Vocabulary Semantic Segmentation from Off-the-shelf Vision-Language ModelsCode1
MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction ExpertsCode1
Active Mining Sample Pair Semantics for Image-text Matching—0
A New Fine-grained Alignment Method for Image-text Matching—0
Cross-modal Active Complementary Learning with Self-refining CorrespondenceCode1
Learning Comprehensive Representations with Richer Self for Text-to-Image Person Re-Identification—0
Prototype-based Aleatoric Uncertainty Quantification for Cross-modal RetrievalCode1
Align before Search: Aligning Ads Image to Text for Accurate Cross-Modal Sponsored SearchCode0
Dynamic Visual Semantic Sub-Embeddings and Fast Re-Ranking—0
Improving Multimodal Classification of Social Media Posts by Leveraging Image-Text Auxiliary TasksCode0
Towards Better Multi-modal Keyphrase Generation via Visual Entity Enhancement and Multi-granularity Image Noise FilteringCode0
ViLTA: Enhancing Vision-Language Pre-training through Textual Augmentation—0
Parameter-Efficient Transfer Learning for Remote Sensing Image-Text RetrievalCode1
Uniformly Distributed Category Prototype-Guided Vision-Language Framework for Long-Tail Recognition—0
EVE: Efficient Vision-Language Pre-training with Masked Prediction and Modality-Aware MoE—0
Towards Grounded Visual Spatial Reasoning in Multi-Modal Vision Language Models—0
Your Negative May not Be True Negative: Boosting Image-Text Matching with False Negative EliminationCode1
Grounded Image Text Matching with Mismatched Relation Reasoning—0
A Systematic Survey of Prompt Engineering on Vision-Language Foundation ModelsCode2
Advancing Visual Grounding with Scene Knowledge: Benchmark and MethodCode1
UniFine: A Unified and Fine-grained Approach for Zero-shot Vision-Language UnderstandingCode1
Towards Unified Text-based Person Retrieval: A Large-scale Multi-Attribute and Language Search BenchmarkCode1
Revisiting the Role of Language Priors in Vision-Language ModelsCode1
Improved Probabilistic Image-Text RepresentationsCode1
Are Diffusion Models Vision-And-Language Reasoners?Code1
LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis EvaluationCode1
MALM: Mask Augmentation based Local Matching for Food-Recipe RetrievalCode0
Discffusion: Discriminative Diffusion Models as Few-shot Vision and Language LearnersCode1
Probing the Role of Positional Information in Vision-Language Models—0
Scene Text Recognition with Image-Text Matching-guided Dictionary—0
Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured RepresentationsCode1
Vision Meets Definitions: Unsupervised Visual Word Sense Disambiguation Incorporating Gloss InformationCode0
RoCOCO: Robustness Benchmark of MS-COCO to Stress-test Image-Text Matching ModelsCode0
Multi-Modal Representation Learning with Text-Driven Soft Masks—0
Multimodal Image-Text Matching Improves Retrieval-based Chest X-Ray Report GenerationCode1
Integrating Language Guidance Into Image-Text Matching for Correcting False NegativesCode0
Plug-and-Play Regulators for Image-Text MatchingCode1
Increasing Textual Context Size Boosts Medical Image-Text MatchingCode0
BiCro: Noisy Correspondence Rectification for Multi-modality Data via Bi-directional Cross-modal Similarity ConsistencyCode1
Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person RetrievalCode2
Refined Vision-Language Modeling for Fine-grained Multi-modal Pre-training—0
Selectively Hard Negative Mining for Alleviating Gradient Vanishing in Image-Text Matching—0
BrainCLIP: Bridging Brain and Visual-Linguistic Representation Via CLIP for Generic Natural Visual Stimulus DecodingCode1
VL-Match: Enhancing Vision-Language Pretraining with Token-Level and Instance-Level Matching—0
Weakly Supervised Referring Image Segmentation with Intra-Chunk and Inter-Chunk Consistency—0
Show:102550
← PrevPage 2 of 4Next →

No leaderboard results yet.