SOTAVerified

Image-text matching

Image-Text Matching is a subtask within Cross-Modal Retrieval (CMR) that involves establishing associations between images and corresponding textual descriptions. The goal is to retrieve an image given a textual query or, conversely, retrieve a textual description given an image query. This task is challenging due to the heterogeneity gap between image and text data representations. Image-text matching is used in applications such as content-based image search, visual question answering, and multimodal summarization.

Assessing Brittleness of Image-Text Retrieval Benchmarks from Vision-Language Models Perspective

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–175 of 188 papers

TitleStatusHype
ViLTA: Enhancing Vision-Language Pre-training through Textual Augmentation—0
ViUniT: Visual Unit Tests for More Robust Visual Programming—0
VL-Match: Enhancing Vision-Language Pretraining with Token-Level and Instance-Level Matching—0
VLM-HOI: Vision Language Models for Interpretable Human-Object Interaction Analysis—0
VL-NMS: Breaking Proposal Bottlenecks in Two-Stage Visual-Language Matching—0
Contrastive Cross-Modal Pre-Training: A General Strategy for Small Sample Medical Imaging—0
Weakly Supervised Referring Image Segmentation with Intra-Chunk and Inter-Chunk Consistency—0
Probing the Role of Positional Information in Vision-Language Models—0
Probing the Role of Positional Information in Vision-Language Models—0
Refined Vision-Language Modeling for Fine-grained Multi-modal Pre-training—0
RETTA: Retrieval-Enhanced Test-Time Adaptation for Zero-Shot Video Captioning—0
Scene Text Recognition with Image-Text Matching-guided Dictionary—0
Matching Images and Text with Multi-modal Tensor Fusion and Re-rankingCode0
Position Focused Attention Network for Image-Text MatchingCode0
Dual Attention Networks for Multimodal Reasoning and MatchingCode0
Do Vision-and-Language Transformers Learn Grounded Predicate-Noun Dependencies?Code0
MALM: Mask Augmentation based Local Matching for Food-Recipe RetrievalCode0
MAGID: An Automated Pipeline for Generating Synthetic Multi-modal DatasetsCode0
Learning Two-Branch Neural Networks for Image-Text Matching TasksCode0
Beyond Image-Text Matching: Verb Understanding in Multimodal Transformers Using Guided MaskingCode0
Enhancing Image-Text Matching with Adaptive Feature AggregationCode0
RoCOCO: Robustness Benchmark of MS-COCO to Stress-test Image-Text Matching ModelsCode0
Align before Search: Aligning Ads Image to Text for Accurate Cross-Modal Sponsored SearchCode0
ALADIN: Distilling Fine-grained Alignment Scores for Efficient Image-Text Matching and RetrievalCode0
Learning fragment self-attention embeddings for image-text matchingCode0
Show:102550
← PrevPage 7 of 8Next →

No leaderboard results yet.