SOTAVerified

Image-text matching

Image-Text Matching is a subtask within Cross-Modal Retrieval (CMR) that involves establishing associations between images and corresponding textual descriptions. The goal is to retrieve an image given a textual query or, conversely, retrieve a textual description given an image query. This task is challenging due to the heterogeneity gap between image and text data representations. Image-text matching is used in applications such as content-based image search, visual question answering, and multimodal summarization.

Assessing Brittleness of Image-Text Retrieval Benchmarks from Vision-Language Models Perspective

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 76–100 of 188 papers

TitleStatusHype
CLIP Under the Microscope: A Fine-Grained Analysis of Multi-Object RepresentationCode1
Graph Structured Network for Image-Text MatchingCode1
Do Vision-and-Language Transformers Learn Grounded Predicate-Noun Dependencies?Code0
Beyond Image-Text Matching: Verb Understanding in Multimodal Transformers Using Guided MaskingCode0
Learning Two-Branch Neural Networks for Image-Text Matching TasksCode0
Integrating Language Guidance Into Image-Text Matching for Correcting False NegativesCode0
Learning fragment self-attention embeddings for image-text matchingCode0
Dual Attention Networks for Multimodal Reasoning and MatchingCode0
Position Focused Attention Network for Image-Text MatchingCode0
RoCOCO: Robustness Benchmark of MS-COCO to Stress-test Image-Text Matching ModelsCode0
Generative Visual Instruction TuningCode0
Backdoor Attack on Unpaired Medical Image-Text Foundation Models: A Pilot Study on MedCLIPCode0
MALM: Mask Augmentation based Local Matching for Food-Recipe RetrievalCode0
GR-GAN: Gradual Refinement Text-to-image GenerationCode0
Deep Cross-Modal Projection Learning for Image-Text MatchingCode0
Efficient and Long-Tailed Generalization for Pre-trained Vision-Language ModelCode0
Improving Multimodal Classification of Social Media Posts by Leveraging Image-Text Auxiliary TasksCode0
Increasing Textual Context Size Boosts Medical Image-Text MatchingCode0
Align before Search: Aligning Ads Image to Text for Accurate Cross-Modal Sponsored SearchCode0
Matching Images and Text with Multi-modal Tensor Fusion and Re-rankingCode0
Towards Better Multi-modal Keyphrase Generation via Visual Entity Enhancement and Multi-granularity Image Noise FilteringCode0
Enhancing Image-Text Matching with Adaptive Feature AggregationCode0
ALADIN: Distilling Fine-grained Alignment Scores for Efficient Image-Text Matching and RetrievalCode0
Evaluating Attribute Comprehension in Large Vision-Language ModelsCode0
MAGID: An Automated Pipeline for Generating Synthetic Multi-modal DatasetsCode0
Show:102550
← PrevPage 4 of 8Next →

No leaderboard results yet.