SOTAVerified

Visual Grounding

Visual Grounding (VG) aims to locate the most relevant object or region in an image, based on a natural language query. The query can be a phrase, a sentence, or even a multi-round dialogue. There are three main challenges in VG:

  • What is the main focus in a query?
  • How to understand an image?
  • How to locate an object?

Papers

Showing 2650 of 571 papers

TitleStatusHype
RefMask3D: Language-Guided Transformer for 3D Referring SegmentationCode2
Aligning and Prompting Everything All at Once for Universal Visual PerceptionCode2
SegAgent: Exploring Pixel Understanding Capabilities in MLLMs by Imitating Human Annotator TrajectoriesCode2
Reasoning to Attend: Try to Understand How <SEG> Token WorksCode2
Referring Image MattingCode2
DeepPerception: Advancing R1-like Cognitive Visual Perception in MLLMs for Knowledge-Intensive Visual GroundingCode2
One Model to Rule them All: Towards Universal Segmentation for Medical Images with Text PromptsCode2
AGLA: Mitigating Object Hallucinations in Large Vision-Language Models with Assembly of Global and Local AttentionCode2
DenseWorld-1M: Towards Detailed Dense Grounded Caption in the Real WorldCode2
NExT-Chat: An LMM for Chat, Detection and SegmentationCode2
SegAgent: Exploring Pixel Understanding Capabilities in MLLMs by Imitating Human Annotator TrajectoriesCode2
LLM-Grounder: Open-Vocabulary 3D Visual Grounding with Large Language Model as an AgentCode2
List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMsCode2
Mitigating Object Hallucinations in Large Vision-Language Models with Assembly of Global and Local AttentionCode2
In Defense of Lazy Visual Grounding for Open-Vocabulary Semantic SegmentationCode2
HiVG: Hierarchical Multimodal Fine-grained Modulation for Visual GroundingCode2
InstructSAM: A Training-Free Framework for Instruction-Oriented Remote Sensing Object RecognitionCode2
3D-VisTA: Pre-trained Transformer for 3D Vision and Text AlignmentCode2
Lexicon3D: Probing Visual Foundation Models for Complex 3D Scene UnderstandingCode2
High-Resolution Visual Reasoning via Multi-Turn Grounding-Based Reinforcement LearningCode2
MedPromptX: Grounded Multimodal Prompting for Chest X-ray DiagnosisCode2
HiMTok: Learning Hierarchical Mask Tokens for Image Segmentation with Large Multimodal ModelCode2
Interpreting Object-level Foundation Models via Visual Precision SearchCode2
GeoGround: A Unified Large Vision-Language Model for Remote Sensing Visual GroundingCode2
A Simple Aerial Detection Baseline of Multimodal Language ModelsCode2
Show:102550
← PrevPage 2 of 23Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Florence-2-large-ftAccuracy (%)95.3Unverified
2mPLUG-2Accuracy (%)92.8Unverified
3X2-VLM (large)Accuracy (%)92.1Unverified
4XFM (base)Accuracy (%)90.4Unverified
5X2-VLM (base)Accuracy (%)90.3Unverified
6X-VLM (base)Accuracy (%)89Unverified
7HYDRAIoU61.7Unverified
8HYDRAIoU61.1Unverified
#ModelMetricClaimedVerifiedStatus
1Florence-2-large-ftAccuracy (%)92Unverified
2mPLUG-2Accuracy (%)86.05Unverified
3X2-VLM (large)Accuracy (%)81.8Unverified
4XFM (base)Accuracy (%)79.8Unverified
5X2-VLM (base)Accuracy (%)78.4Unverified
6X-VLM (base)Accuracy (%)76.91Unverified
#ModelMetricClaimedVerifiedStatus
1Florence-2-large-ftAccuracy (%)93.4Unverified
2mPLUG-2Accuracy (%)90.33Unverified
3X2-VLM (large)Accuracy (%)87.6Unverified
4XFM (base)Accuracy (%)86.1Unverified
5X2-VLM (base)Accuracy (%)85.2Unverified
6X-VLM (base)Accuracy (%)84.51Unverified