SOTAVerified

Image-text matching

Image-Text Matching is a subtask within Cross-Modal Retrieval (CMR) that involves establishing associations between images and corresponding textual descriptions. The goal is to retrieve an image given a textual query or, conversely, retrieve a textual description given an image query. This task is challenging due to the heterogeneity gap between image and text data representations. Image-text matching is used in applications such as content-based image search, visual question answering, and multimodal summarization.

Assessing Brittleness of Image-Text Retrieval Benchmarks from Vision-Language Models Perspective

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–188 of 188 papers

TitleStatusHype
DT2I: Dense Text-to-Image Generation from Region Descriptions—0
Two-stream Hierarchical Similarity Reasoning for Image-text Matching—0
Dual Embodied-Symbolic Concept Representations for Deep Learning—0
Unpaired Referring Expression Grounding via Bidirectional Cross-Modal Matching—0
Probing the Role of Positional Information in Vision-Language Models—0
Unified Multimodal Pre-training and Prompt-based Tuning for Vision-Language Understanding and Generation—0
Embedding Arithmetic of Multimodal Queries for Image Retrieval—0
UFO: A UniFied TransfOrmer for Vision-Language Representation Learning—0
More Than Just Attention: Improving Cross-Modal Attentions with Contrastive Constraints for Image-Text Matching—0
MURAL: Multimodal, Multitask Representations Across Languages—0
Is An Image Worth Five Sentences? A New Look into Semantics for Image-Text Matching—0
MURAL: Multimodal, Multitask Retrieval Across Languages—0
Hashing based Efficient Inference for Image-Text Matching—0
A Self-Boosting Framework for Automated Radiographic Report Generation—0
Step-Wise Hierarchical Alignment Network for Image-Text Matching—0
Towards Efficient Cross-Modal Visual Textual Retrieval using Transformer-Encoder Deep Features—0
More Than Just Attention: Improving Cross-Modal Attentions with Contrastive Constraints for Image-Text Matching—0
VL-NMS: Breaking Proposal Bottlenecks in Two-Stage Visual-Language Matching—0
Discrete-continuous Action Space Policy Gradient-based Attention for Image-Text Matching—0
UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training—0
Macroscopic Control of Text Generation for Image Captioning—0
Contrastive Cross-Modal Pre-Training: A General Strategy for Small Sample Medical Imaging—0
A Novel Attention-based Aggregation Function to Combine Vision and Language—0
InterBERT: Vision-and-Language Interaction for Multi-modal Pretraining—0
Expressing Objects just like Words: Recurrent Visual Embedding for Image-Text Matching—0
ImageBERT: Cross-modal Pre-training with Large-scale Weak-supervised Image-Text Data—0
Learning fragment self-attention embeddings for image-text matchingCode0
UNITER: Learning UNiversal Image-TExt Representations—0
Learning Visual Relation Priors for Image-Text Matching and Image Captioning with Neural Scene Graph Generators—0
Unicoder-VL: A Universal Encoder for Vision and Language by Cross-modal Pre-training—0
Matching Images and Text with Multi-modal Tensor Fusion and Re-rankingCode0
Knowledge Aware Semantic Concept Expansion for Image-Text Matching—0
Position Focused Attention Network for Image-Text MatchingCode0
ParNet: Position-aware Aggregated Relation Network for Image-Text matching—0
Deep Cross-Modal Projection Learning for Image-Text MatchingCode0
Cross-modal Subspace Learning for Fine-grained Sketch-based Image Retrieval—0
Learning Two-Branch Neural Networks for Image-Text Matching TasksCode0
Dual Attention Networks for Multimodal Reasoning and MatchingCode0
Show:102550
← PrevPage 4 of 4Next →

No leaderboard results yet.