SOTAVerified

Phrase Grounding

Given an image and a corresponding caption, the Phrase Grounding task aims to ground each entity mentioned by a noun phrase in the caption to a region in the image.

Source: Phrase Grounding by Soft-Label Chain Conditional Random Field

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 88 papers

TitleStatusHype
GLIPv2: Unifying Localization and Vision-Language UnderstandingCode4
Towards Visual Grounding: A SurveyCode3
OmDet: Large-scale vision-language multi-dataset pre-training with multimodal detection networkCode3
PG-Video-LLaVA: Pixel Grounding Large Video-Language ModelsCode2
MDETR - Modulated Detection for End-to-End Multi-Modal UnderstandingCode2
An Open and Comprehensive Pipeline for Unified Object Grounding and DetectionCode1
Enhancing Representation in Radiography-Reports Foundation Model: A Granular Alignment Algorithm Using Masked Contrastive LearningCode1
A Survey on Interpretable Cross-modal ReasoningCode1
Kosmos-2: Grounding Multimodal Large Language Models to the WorldCode1
DQ-DETR: Dual Query Detection Transformer for Phrase Extraction and GroundingCode1
What is Where by Looking: Weakly-Supervised Open-World Phrase-Grounding without Text InputsCode1
Coarse-to-Fine Vision-Language Pre-training with Fusion in the BackboneCode1
PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language ModelsCode1
Unsupervised Vision-Language Parsing: Seamlessly Bridging Visual Scene Graphs with Language Structures via Dependency RelationshipsCode1
MDETR -- Modulated Detection for End-to-End Multi-Modal UnderstandingCode1
MAF: Multimodal Alignment Framework for Weakly-Supervised Phrase GroundingCode1
Improving Weakly Supervised Visual Grounding by Contrastive Knowledge DistillationCode1
Contrastive Learning for Weakly Supervised Phrase GroundingCode1
Learning Cross-modal Context Graph for Visual GroundingCode1
Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence ModelsCode1
Anatomy-Grounded Weakly Supervised Prompt Tuning for Chest X-ray Latent Diffusion Models—0
Disambiguating Reference in Visually Grounded Dialogues through Joint Modeling of Textual and Multimodal Semantic StructuresCode0
A Comparison of Object Detection and Phrase Grounding Models in Chest X-ray Abnormality Localization using Eye-tracking Data—0
Progressive Local Alignment for Medical Multimodal Pre-training—0
Anatomical grounding pre-training for medical phrase groundingCode0
VICCA: Visual Interpretation and Comprehension of Chest X-ray Anomalies in Generated Report Without Human FeedbackCode0
Contextual Self-paced Learning for Weakly Supervised Spatio-Temporal Video Grounding—0
Hierarchical Alignment-enhanced Adaptive Grounding Network for Generalized Referring Expression Comprehension—0
ViCaS: A Dataset for Combining Holistic and Pixel-level Video Understanding using Captions with Grounded Segmentation—0
Context-Infused Visual Grounding for ArtCode0
Transformer with Controlled Attention for Synchronous Motion CaptioningCode0
Pre-Training Multimodal Hallucination Detectors with Corrupted Grounding Data—0
A Lightweight Modular Framework for Low-Cost Open-Vocabulary Object Detection TrainingCode0
CXR-Agent: Vision-language models for chest X-ray interpretation with uncertainty aware radiology reporting—0
Empathic Grounding: Explorations using Multimodal Interaction and Large Language Models with Conversational AgentsCode0
Q-GroundCAM: Quantifying Grounding in Vision Language Models via GradCAM—0
Zero-Shot Medical Phrase Grounding with Off-the-shelf Diffusion ModelsCode0
MedRG: Medical Report Grounding with Multi-modal Large Language Model—0
Griffon v2: Advancing Multimodal Perception with High-Resolution Scaling and Visual-Language Co-ReferringCode0
Contrastive Region Guidance: Improving Grounding in Vision-Language Models without Training—0
How to Understand "Support"? An Implicit-enhanced Causal Inference Approach for Weakly-supervised Phrase Grounding—0
Phrase Grounding-based Style Transfer for Single-Domain Generalized Object Detection—0
Enhancing the vision-language foundation model with key semantic knowledge-emphasized report refinement—0
Augment the Pairs: Semantics-Preserving Image-Caption Pair Augmentation for Grounding-Based Vision and Language ModelsCode0
Localizing Active Objects from Egocentric Vision with Symbolic World KnowledgeCode0
Box-based Refinement for Weakly Supervised and Unsupervised Localization TasksCode0
A Joint Study of Phrase Grounding and Task Performance in Vision and Language ModelsCode0
Catalog Phrase Grounding (CPG): Grounding of Product Textual Attributes in Product Images for e-commerce Vision-Language Applications—0
Read, look and detect: Bounding box annotation from image-caption pairs—0
ELVIS: Empowering Locality of Vision Language Pre-training with Intra-modal Similarity—0
Show:102550
← PrevPage 1 of 2Next →
All datasetsFlickr30k Entities TestFlickr30kFlickr30k Entities DevReferItVisual Genome

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GLIPv2R@187.7—Unverified
2FIBER-BR@187.4—Unverified
3GLIPR@187.1—Unverified
4PEVLR@184.4—Unverified
5MDETR-ENB5R@184.3—Unverified
6DIGNR@178.73—Unverified
7LCMCGR@176.74—Unverified
8Soft-Label Chain CRF (SL-CCRF)R@174.69—Unverified
9DDPN (ResNet-101)R@173.3—Unverified
10VisualBERTR@171.33—Unverified
#ModelMetricClaimedVerifiedStatus
1GBS Ensemble + 12-in-1Pointing Game Accuracy85.9—Unverified
2GbS Ensemble MS-COCOPointing Game Accuracy75.6—Unverified
3COCO_ELMo_PNASNetPointing Game Accuracy69.19—Unverified
#ModelMetricClaimedVerifiedStatus
1Fiber-BR@187.1—Unverified
2PEVLR@184.1—Unverified
3VisualBERTR@170.4—Unverified
#ModelMetricClaimedVerifiedStatus
1VG_BiLSTM_VGGPointing Game Accuracy62.76—Unverified
2GbS Ensemble MS-COCOPointing Game Accuracy58.21—Unverified
3MCBAccuracy28.91—Unverified
#ModelMetricClaimedVerifiedStatus
1GbS VGPointing Game Accuracy55.91—Unverified
2VG_ELMo_PNASNetPointing Game Accuracy55.16—Unverified
3GbS Ensemble MS-COCOPointing Game Accuracy54.55—Unverified