SOTAVerified

Image-text matching

Image-Text Matching is a subtask within Cross-Modal Retrieval (CMR) that involves establishing associations between images and corresponding textual descriptions. The goal is to retrieve an image given a textual query or, conversely, retrieve a textual description given an image query. This task is challenging due to the heterogeneity gap between image and text data representations. Image-text matching is used in applications such as content-based image search, visual question answering, and multimodal summarization.

Assessing Brittleness of Image-Text Retrieval Benchmarks from Vision-Language Models Perspective

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 188 papers

TitleStatusHype
BrainCLIP: Bridging Brain and Visual-Linguistic Representation Via CLIP for Generic Natural Visual Stimulus DecodingCode1
ECCV Caption: Correcting False Negatives by Collecting Machine-and-Human-verified Image-Caption Associations for MS-COCOCode1
UniFine: A Unified and Fine-grained Approach for Zero-shot Vision-Language UnderstandingCode1
Efficient Medical Vision-Language Alignment Through Adapting Masked Vision ModelsCode1
Advancing Visual Grounding with Scene Knowledge: Benchmark and MethodCode1
UGNCL: Uncertainty-Guided Noisy Correspondence Learning for Efficient Cross-Modal MatchingCode1
Zero-Shot Video Captioning with Evolving Pseudo-TokensCode1
Transformer Reasoning Network for Image-Text Matching and RetrievalCode1
CLIP is Strong Enough to Fight Back: Test-time Counterattacks towards Zero-shot Adversarial Robustness of CLIPCode1
Align before Fuse: Vision and Language Representation Learning with Momentum DistillationCode1
Fine-Grained Image-Text Matching by Cross-Modal Hard Aligning NetworkCode1
CLIP Under the Microscope: A Fine-Grained Analysis of Multi-Object RepresentationCode1
Towards Unified Text-based Person Retrieval: A Large-scale Multi-Attribute and Language Search BenchmarkCode1
Graph Structured Network for Image-Text MatchingCode1
Synthesize, Diagnose, and Optimize: Towards Fine-Grained Vision-Language UnderstandingCode1
GRIT-VLP: Grouped Mini-batch Sampling for Efficient Vision and Language Pre-trainingCode1
ColorSwap: A Color and Word Order Dataset for Multimodal EvaluationCode1
Composing Object Relations and Attributes for Image-Text MatchingCode1
ComCLIP: Training-Free Compositional Image and Text MatchingCode1
Visual Semantic Reasoning for Image-Text MatchingCode1
Image-text matching for large-scale book collectionsCode1
Consensus-Aware Visual-Semantic Embedding for Image-Text MatchingCode1
Improved Probabilistic Image-Text RepresentationsCode1
Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured RepresentationsCode1
Stacked Cross Attention for Image-Text MatchingCode1
CCMB: A Large-scale Chinese Cross-modal BenchmarkCode1
Similarity Reasoning and Filtration for Image-Text MatchingCode1
Unified Multimodal Pre-training and Prompt-based Tuning for Vision-Language Understanding and Generation—0
MedUnifier: Unifying Vision-and-Language Pre-training on Medical Data with Vision Generation Task using Discrete Visual Representations—0
A Concept-Centric Approach to Multi-Modality Learning—0
Active Mining Sample Pair Semantics for Image-text Matching—0
AdsCVLR: Commercial Visual-Linguistic Representation Modeling in Sponsored Search—0
Advanced Multimodal Deep Learning Architecture for Image-Text Matching—0
A Novel Attention-based Aggregation Function to Combine Vision and Language—0
A Self-Boosting Framework for Automated Radiographic Report Generation—0
Automatic Prompt Generation and Grounding Object Detection for Zero-Shot Image Anomaly Detection—0
Breaking Through the Noisy Correspondence: A Robust Model for Image-Text Matching—0
Bridging the Modality Gap: Dimension Information Alignment and Sparse Spatial Constraint for Image-Text Matching—0
CLIP-Powered TASS: Target-Aware Single-Stream Network for Audio-Visual Question Answering—0
Constructing Multilingual Visual-Text Datasets Revealing Visual Multilingual Ability of Vision Language Models—0
A New Fine-grained Alignment Method for Image-text Matching—0
Cross-modal Subspace Learning for Fine-grained Sketch-based Image Retrieval—0
CILF-CIAE: CLIP-driven Image-Language Fusion for Correcting Inverse Age Estimation—0
DARE: Diverse Visual Question Answering with Robustness Evaluation—0
DEMO: A Statistical Perspective for Efficient Image-Text Matching—0
Dependency Structure Augmented Contextual Scoping Framework for Multimodal Aspect-Based Sentiment Analysis—0
Descriptive Image-Text Matching with Graded Contextual Similarity—0
Discrete-continuous Action Space Policy Gradient-based Attention for Image-Text Matching—0
Don't Stop Learning: Towards Continual Learning for the CLIP Model—0
DT2I: Dense Text-to-Image Generation from Region Descriptions—0
Show:102550
← PrevPage 2 of 4Next →

No leaderboard results yet.