SOTAVerified

Image-text matching

Image-Text Matching is a subtask within Cross-Modal Retrieval (CMR) that involves establishing associations between images and corresponding textual descriptions. The goal is to retrieve an image given a textual query or, conversely, retrieve a textual description given an image query. This task is challenging due to the heterogeneity gap between image and text data representations. Image-text matching is used in applications such as content-based image search, visual question answering, and multimodal summarization.

Assessing Brittleness of Image-Text Retrieval Benchmarks from Vision-Language Models Perspective

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–188 of 188 papers

TitleStatusHype
ViLTA: Enhancing Vision-Language Pre-training through Textual Augmentation—0
ViUniT: Visual Unit Tests for More Robust Visual Programming—0
VL-Match: Enhancing Vision-Language Pretraining with Token-Level and Instance-Level Matching—0
VLM-HOI: Vision Language Models for Interpretable Human-Object Interaction Analysis—0
VL-NMS: Breaking Proposal Bottlenecks in Two-Stage Visual-Language Matching—0
Contrastive Cross-Modal Pre-Training: A General Strategy for Small Sample Medical Imaging—0
Weakly Supervised Referring Image Segmentation with Intra-Chunk and Inter-Chunk Consistency—0
Probing the Role of Positional Information in Vision-Language Models—0
Probing the Role of Positional Information in Vision-Language Models—0
Refined Vision-Language Modeling for Fine-grained Multi-modal Pre-training—0
RETTA: Retrieval-Enhanced Test-Time Adaptation for Zero-Shot Video Captioning—0
Scene Text Recognition with Image-Text Matching-guided Dictionary—0
Matching Images and Text with Multi-modal Tensor Fusion and Re-rankingCode0
Position Focused Attention Network for Image-Text MatchingCode0
Dual Attention Networks for Multimodal Reasoning and MatchingCode0
Do Vision-and-Language Transformers Learn Grounded Predicate-Noun Dependencies?Code0
MALM: Mask Augmentation based Local Matching for Food-Recipe RetrievalCode0
MAGID: An Automated Pipeline for Generating Synthetic Multi-modal DatasetsCode0
Learning Two-Branch Neural Networks for Image-Text Matching TasksCode0
Beyond Image-Text Matching: Verb Understanding in Multimodal Transformers Using Guided MaskingCode0
Enhancing Image-Text Matching with Adaptive Feature AggregationCode0
RoCOCO: Robustness Benchmark of MS-COCO to Stress-test Image-Text Matching ModelsCode0
Align before Search: Aligning Ads Image to Text for Accurate Cross-Modal Sponsored SearchCode0
ALADIN: Distilling Fine-grained Alignment Scores for Efficient Image-Text Matching and RetrievalCode0
Learning fragment self-attention embeddings for image-text matchingCode0
Integrating Language Guidance Into Image-Text Matching for Correcting False NegativesCode0
Increasing Textual Context Size Boosts Medical Image-Text MatchingCode0
Dissecting Deep Metric Learning Losses for Image-Text RetrievalCode0
Improving Multimodal Classification of Social Media Posts by Leveraging Image-Text Auxiliary TasksCode0
Vision Meets Definitions: Unsupervised Visual Word Sense Disambiguation Incorporating Gloss InformationCode0
GR-GAN: Gradual Refinement Text-to-image GenerationCode0
Efficient and Long-Tailed Generalization for Pre-trained Vision-Language ModelCode0
Towards Better Multi-modal Keyphrase Generation via Visual Entity Enhancement and Multi-granularity Image Noise FilteringCode0
Deep Cross-Modal Projection Learning for Image-Text MatchingCode0
Compositional Image-Text Matching and Retrieval by Grounding EntitiesCode0
Backdoor Attack on Unpaired Medical Image-Text Foundation Models: A Pilot Study on MedCLIPCode0
Generative Visual Instruction TuningCode0
Evaluating Attribute Comprehension in Large Vision-Language ModelsCode0
Show:102550
← PrevPage 4 of 4Next →

No leaderboard results yet.