SOTAVerified

Image-text matching

Image-Text Matching is a subtask within Cross-Modal Retrieval (CMR) that involves establishing associations between images and corresponding textual descriptions. The goal is to retrieve an image given a textual query or, conversely, retrieve a textual description given an image query. This task is challenging due to the heterogeneity gap between image and text data representations. Image-text matching is used in applications such as content-based image search, visual question answering, and multimodal summarization.

Assessing Brittleness of Image-Text Retrieval Benchmarks from Vision-Language Models Perspective

Papers

Showing 101150 of 188 papers

TitleStatusHype
Dual Embodied-Symbolic Concept Representations for Deep Learning0
Dynamic and Compressive Adaptation of Transformers From Images to Videos0
Embedding Arithmetic of Multimodal Queries for Image Retrieval0
EntityCLIP: Entity-Centric Image-Text Matching via Multimodal Attentive Contrastive Learning0
EVE: Efficient Vision-Language Pre-training with Masked Prediction and Modality-Aware MoE0
Expressing Objects just like Words: Recurrent Visual Embedding for Image-Text Matching0
FSMR: A Feature Swapping Multi-modal Reasoning Approach with Joint Textual and Visual Clues0
Grounded Image Text Matching with Mismatched Relation Reasoning0
Hashing based Efficient Inference for Image-Text Matching0
Hire: Hybrid-modal Interaction with Multiple Relational Enhancements for Image-Text Matching0
ImageBERT: Cross-modal Pre-training with Large-scale Weak-supervised Image-Text Data0
Image-Text Matching with Multi-View Attention0
Instruction-augmented Multimodal Alignment for Image-Text and Element Matching0
InterBERT: Vision-and-Language Interaction for Multi-modal Pretraining0
Is An Image Worth Five Sentences? A New Look into Semantics for Image-Text Matching0
Knowledge Aware Semantic Concept Expansion for Image-Text Matching0
Learning Comprehensive Representations with Richer Self for Text-to-Image Person Re-Identification0
Learning Textual Prompts for Open-World Semi-Supervised Learning0
Macroscopic Control of Text Generation for Image Captioning0
MASS: Overcoming Language Bias in Image-Text Matching0
Multimodal Matching-aware Co-attention Networks with Mutual Knowledge Distillation for Fake News Detection0
More Than Just Attention: Improving Cross-Modal Attentions with Contrastive Constraints for Image-Text Matching0
More Than Just Attention: Improving Cross-Modal Attentions with Contrastive Constraints for Image-Text Matching0
Multi-Head Attention Driven Dynamic Visual-Semantic Embedding for Enhanced Image-Text Matching0
Multi-Modal Representation Learning with Text-Driven Soft Masks0
MURAL: Multimodal, Multitask Representations Across Languages0
MURAL: Multimodal, Multitask Retrieval Across Languages0
NEVLP: Noise-Robust Framework for Efficient Vision-Language Pre-training0
Object-centric Binding in Contrastive Language-Image Pretraining0
OT-Attack: Enhancing Adversarial Transferability of Vision-Language Models via Optimal Transport Optimization0
ParNet: Position-aware Aggregated Relation Network for Image-Text matching0
Selectively Hard Negative Mining for Alleviating Gradient Vanishing in Image-Text Matching0
Step-Wise Hierarchical Alignment Network for Image-Text Matching0
SyncMask: Synchronized Attentional Masking for Fashion-centric Vision-Language Pretraining0
TNG-CLIP:Training-Time Negation Data Generation for Negation Awareness of CLIP0
Towards Deconfounded Image-Text Matching with Causal Inference0
Towards Efficient Cross-Modal Visual Textual Retrieval using Transformer-Encoder Deep Features0
Towards Grounded Visual Spatial Reasoning in Multi-Modal Vision Language Models0
Two-stream Hierarchical Similarity Reasoning for Image-text Matching0
UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training0
UFO: A UniFied TransfOrmer for Vision-Language Representation Learning0
Dynamic Visual Semantic Sub-Embeddings and Fast Re-Ranking0
Uncertainty-based Cross-Modal Retrieval with Probabilistic Representations0
Unicoder-VL: A Universal Encoder for Vision and Language by Cross-modal Pre-training0
Learning Visual Relation Priors for Image-Text Matching and Image Captioning with Neural Scene Graph Generators0
Uniformly Distributed Category Prototype-Guided Vision-Language Framework for Long-Tail Recognition0
Uniform Masking Prevails in Vision-Language Pretraining0
UNITER: Learning UNiversal Image-TExt Representations0
Unpaired Referring Expression Grounding via Bidirectional Cross-Modal Matching0
UPainting: Unified Text-to-Image Diffusion Generation with Cross-modal Guidance0
Show:102550
← PrevPage 3 of 4Next →

No leaderboard results yet.