SOTAVerified

Image-text matching

Image-Text Matching is a subtask within Cross-Modal Retrieval (CMR) that involves establishing associations between images and corresponding textual descriptions. The goal is to retrieve an image given a textual query or, conversely, retrieve a textual description given an image query. This task is challenging due to the heterogeneity gap between image and text data representations. Image-text matching is used in applications such as content-based image search, visual question answering, and multimodal summarization.

Assessing Brittleness of Image-Text Retrieval Benchmarks from Vision-Language Models Perspective

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 188 papers

TitleStatusHype
Fine-Grained Image-Text Matching by Cross-Modal Hard Aligning NetworkCode1
Learning Semantic Relationship Among Instances for Image-Text MatchingCode1
Multimodal Matching-aware Co-attention Networks with Mutual Knowledge Distillation for Fake News Detection—0
Uniform Masking Prevails in Vision-Language Pretraining—0
A Differentiable Semantic Metric Approximation in Probabilistic Embedding for Cross-Modal RetrievalCode1
ComCLIP: Training-Free Compositional Image and Text MatchingCode1
Self-supervised vision-language pretraining for Medical visual question answeringCode1
UPainting: Unified Text-to-Image Diffusion Generation with Cross-modal Guidance—0
Dissecting Deep Metric Learning Losses for Image-Text RetrievalCode0
Do Vision-and-Language Transformers Learn Grounded Predicate-Noun Dependencies?Code0
MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training ModelCode1
AdsCVLR: Commercial Visual-Linguistic Representation Modeling in Sponsored Search—0
GRIT-VLP: Grouped Mini-batch Sampling for Efficient Vision and Language Pre-trainingCode1
ALADIN: Distilling Fine-grained Alignment Scores for Efficient Image-Text Matching and RetrievalCode0
Zero-Shot Video Captioning with Evolving Pseudo-TokensCode1
Don't Stop Learning: Towards Continual Learning for the CLIP Model—0
Open-Vocabulary Multi-Label Classification via Multi-Modal Knowledge TransferCode1
GR-GAN: Gradual Refinement Text-to-image GenerationCode0
CCMB: A Large-scale Chinese Cross-modal BenchmarkCode1
Language Models Can See: Plugging Visual Controls in Text GenerationCode2
Declaration-based Prompt Tuning for Visual Question AnsweringCode1
Uncertainty-based Cross-Modal Retrieval with Probabilistic Representations—0
No Token Left Behind: Explainability-Aided Image Classification and GenerationCode1
ECCV Caption: Correcting False Negatives by Collecting Machine-and-Human-verified Image-Caption Associations for MS-COCOCode1
DT2I: Dense Text-to-Image Generation from Region Descriptions—0
Two-stream Hierarchical Similarity Reasoning for Image-text Matching—0
Dual Embodied-Symbolic Concept Representations for Deep Learning—0
MVPTR: Multi-Level Semantic Alignment for Vision-Language Pre-Training via Multi-Stage LearningCode1
BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationCode5
Unpaired Referring Expression Grounding via Bidirectional Cross-Modal Matching—0
Probing the Role of Positional Information in Vision-Language Models—0
Negative-Aware Attention Framework for Image-Text MatchingCode1
Unified Multimodal Pre-training and Prompt-based Tuning for Vision-Language Understanding and Generation—0
Embedding Arithmetic of Multimodal Queries for Image Retrieval—0
DenseCLIP: Language-Guided Dense Prediction with Context-Aware PromptingCode1
Learning with Noisy Correspondence for Cross-modal MatchingCode1
UFO: A UniFied TransfOrmer for Vision-Language Representation Learning—0
More Than Just Attention: Improving Cross-Modal Attentions with Contrastive Constraints for Image-Text Matching—0
MURAL: Multimodal, Multitask Representations Across Languages—0
Is An Image Worth Five Sentences? A New Look into Semantics for Image-Text Matching—0
MURAL: Multimodal, Multitask Retrieval Across Languages—0
Hashing based Efficient Inference for Image-Text Matching—0
Align before Fuse: Vision and Language Representation Learning with Momentum DistillationCode1
A Self-Boosting Framework for Automated Radiographic Report Generation—0
Step-Wise Hierarchical Alignment Network for Image-Text Matching—0
A Deep Local and Global Scene-Graph Matching for Image-Text RetrievalCode1
Towards Efficient Cross-Modal Visual Textual Retrieval using Transformer-Encoder Deep Features—0
More Than Just Attention: Improving Cross-Modal Attentions with Contrastive Constraints for Image-Text Matching—0
VL-NMS: Breaking Proposal Bottlenecks in Two-Stage Visual-Language Matching—0
Discrete-continuous Action Space Policy Gradient-based Attention for Image-Text Matching—0
Show:102550
← PrevPage 3 of 4Next →

No leaderboard results yet.