SOTAVerified

Image-text matching

Image-Text Matching is a subtask within Cross-Modal Retrieval (CMR) that involves establishing associations between images and corresponding textual descriptions. The goal is to retrieve an image given a textual query or, conversely, retrieve a textual description given an image query. This task is challenging due to the heterogeneity gap between image and text data representations. Image-text matching is used in applications such as content-based image search, visual question answering, and multimodal summarization.

Assessing Brittleness of Image-Text Retrieval Benchmarks from Vision-Language Models Perspective

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 188 papers

TitleStatusHype
Compositional Image-Text Matching and Retrieval by Grounding EntitiesCode0
Dissecting Deep Metric Learning Losses for Image-Text RetrievalCode0
Vision Meets Definitions: Unsupervised Visual Word Sense Disambiguation Incorporating Gloss InformationCode0
Unified Multimodal Pre-training and Prompt-based Tuning for Vision-Language Understanding and Generation—0
MedUnifier: Unifying Vision-and-Language Pre-training on Medical Data with Vision Generation Task using Discrete Visual Representations—0
A Concept-Centric Approach to Multi-Modality Learning—0
Active Mining Sample Pair Semantics for Image-text Matching—0
AdsCVLR: Commercial Visual-Linguistic Representation Modeling in Sponsored Search—0
Advanced Multimodal Deep Learning Architecture for Image-Text Matching—0
A Novel Attention-based Aggregation Function to Combine Vision and Language—0
A Self-Boosting Framework for Automated Radiographic Report Generation—0
Automatic Prompt Generation and Grounding Object Detection for Zero-Shot Image Anomaly Detection—0
Breaking Through the Noisy Correspondence: A Robust Model for Image-Text Matching—0
Bridging the Modality Gap: Dimension Information Alignment and Sparse Spatial Constraint for Image-Text Matching—0
CLIP-Powered TASS: Target-Aware Single-Stream Network for Audio-Visual Question Answering—0
Constructing Multilingual Visual-Text Datasets Revealing Visual Multilingual Ability of Vision Language Models—0
A New Fine-grained Alignment Method for Image-text Matching—0
Cross-modal Subspace Learning for Fine-grained Sketch-based Image Retrieval—0
CILF-CIAE: CLIP-driven Image-Language Fusion for Correcting Inverse Age Estimation—0
DARE: Diverse Visual Question Answering with Robustness Evaluation—0
DEMO: A Statistical Perspective for Efficient Image-Text Matching—0
Dependency Structure Augmented Contextual Scoping Framework for Multimodal Aspect-Based Sentiment Analysis—0
Descriptive Image-Text Matching with Graded Contextual Similarity—0
Discrete-continuous Action Space Policy Gradient-based Attention for Image-Text Matching—0
Don't Stop Learning: Towards Continual Learning for the CLIP Model—0
DT2I: Dense Text-to-Image Generation from Region Descriptions—0
Dual Embodied-Symbolic Concept Representations for Deep Learning—0
Dynamic and Compressive Adaptation of Transformers From Images to Videos—0
Embedding Arithmetic of Multimodal Queries for Image Retrieval—0
EntityCLIP: Entity-Centric Image-Text Matching via Multimodal Attentive Contrastive Learning—0
EVE: Efficient Vision-Language Pre-training with Masked Prediction and Modality-Aware MoE—0
Expressing Objects just like Words: Recurrent Visual Embedding for Image-Text Matching—0
FSMR: A Feature Swapping Multi-modal Reasoning Approach with Joint Textual and Visual Clues—0
Grounded Image Text Matching with Mismatched Relation Reasoning—0
Hashing based Efficient Inference for Image-Text Matching—0
Hire: Hybrid-modal Interaction with Multiple Relational Enhancements for Image-Text Matching—0
ImageBERT: Cross-modal Pre-training with Large-scale Weak-supervised Image-Text Data—0
Image-Text Matching with Multi-View Attention—0
Instruction-augmented Multimodal Alignment for Image-Text and Element Matching—0
InterBERT: Vision-and-Language Interaction for Multi-modal Pretraining—0
Is An Image Worth Five Sentences? A New Look into Semantics for Image-Text Matching—0
Knowledge Aware Semantic Concept Expansion for Image-Text Matching—0
Learning Comprehensive Representations with Richer Self for Text-to-Image Person Re-Identification—0
Learning Textual Prompts for Open-World Semi-Supervised Learning—0
Macroscopic Control of Text Generation for Image Captioning—0
MASS: Overcoming Language Bias in Image-Text Matching—0
Multimodal Matching-aware Co-attention Networks with Mutual Knowledge Distillation for Fake News Detection—0
More Than Just Attention: Improving Cross-Modal Attentions with Contrastive Constraints for Image-Text Matching—0
More Than Just Attention: Improving Cross-Modal Attentions with Contrastive Constraints for Image-Text Matching—0
Multi-Head Attention Driven Dynamic Visual-Semantic Embedding for Enhanced Image-Text Matching—0
Show:102550
← PrevPage 3 of 4Next →

No leaderboard results yet.