SOTAVerified

Image-text matching

Image-Text Matching is a subtask within Cross-Modal Retrieval (CMR) that involves establishing associations between images and corresponding textual descriptions. The goal is to retrieve an image given a textual query or, conversely, retrieve a textual description given an image query. This task is challenging due to the heterogeneity gap between image and text data representations. Image-text matching is used in applications such as content-based image search, visual question answering, and multimodal summarization.

Assessing Brittleness of Image-Text Retrieval Benchmarks from Vision-Language Models Perspective

Papers

Showing 76100 of 188 papers

TitleStatusHype
CCMB: A Large-scale Chinese Cross-modal BenchmarkCode1
Similarity Reasoning and Filtration for Image-Text MatchingCode1
Unified Multimodal Pre-training and Prompt-based Tuning for Vision-Language Understanding and Generation0
MedUnifier: Unifying Vision-and-Language Pre-training on Medical Data with Vision Generation Task using Discrete Visual Representations0
A Concept-Centric Approach to Multi-Modality Learning0
Active Mining Sample Pair Semantics for Image-text Matching0
AdsCVLR: Commercial Visual-Linguistic Representation Modeling in Sponsored Search0
Advanced Multimodal Deep Learning Architecture for Image-Text Matching0
A Novel Attention-based Aggregation Function to Combine Vision and Language0
A Self-Boosting Framework for Automated Radiographic Report Generation0
Automatic Prompt Generation and Grounding Object Detection for Zero-Shot Image Anomaly Detection0
Breaking Through the Noisy Correspondence: A Robust Model for Image-Text Matching0
Bridging the Modality Gap: Dimension Information Alignment and Sparse Spatial Constraint for Image-Text Matching0
CLIP-Powered TASS: Target-Aware Single-Stream Network for Audio-Visual Question Answering0
Constructing Multilingual Visual-Text Datasets Revealing Visual Multilingual Ability of Vision Language Models0
A New Fine-grained Alignment Method for Image-text Matching0
Cross-modal Subspace Learning for Fine-grained Sketch-based Image Retrieval0
CILF-CIAE: CLIP-driven Image-Language Fusion for Correcting Inverse Age Estimation0
DARE: Diverse Visual Question Answering with Robustness Evaluation0
DEMO: A Statistical Perspective for Efficient Image-Text Matching0
Dependency Structure Augmented Contextual Scoping Framework for Multimodal Aspect-Based Sentiment Analysis0
Descriptive Image-Text Matching with Graded Contextual Similarity0
Discrete-continuous Action Space Policy Gradient-based Attention for Image-Text Matching0
Don't Stop Learning: Towards Continual Learning for the CLIP Model0
DT2I: Dense Text-to-Image Generation from Region Descriptions0
Show:102550
← PrevPage 4 of 8Next →

No leaderboard results yet.