Visual Relationship Detection

Visual relationship detection (VRD) is one newly developed computer vision task aiming to recognize relations or interactions between objects in an image. It is a further learning task after object recognition and is essential for fully understanding images, even the visual world.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 26–50 of 82 papers

Title	Date	Tasks	Status	Score
Improving Visual Relation Detection using Depth Maps	May 2, 2019	ObjectRelation	CodeCode Available	5
AVR: Attention based Salient Visual Relationship Detection	Mar 16, 2020	Relationship DetectionVisual Relationship Detection	CodeCode Available	5
Factorizable Net: An Efficient Subgraph-based Framework for Scene Graph Generation	Jun 29, 2018	ClusteringGraph Generation	CodeCode Available	5
BLOCK: Bilinear Superdiagonal Fusion for Visual Question Answering and Visual Relationship Detection	Jan 31, 2019	Question AnsweringRelationship Detection	CodeCode Available	5
Deep Variation-structured Reinforcement Learning for Visual Relationship and Attribute Detection	Mar 8, 2017	Attributeimage-classification	CodeCode Available	5
METOR: A Unified Framework for Mutual Enhancement of Objects and Relationships in Open-vocabulary Video Visual Relationship Detection	May 10, 2025	Objectobject-detection	CodeCode Available	5
Unified Visual Relationship Detection with Vision and Language Models	Mar 16, 2023	Human-Object Interaction DetectionRelationship Detection	CodeCode Available	5
Constructing a Visual Relationship Authenticity Dataset	Oct 11, 2020	Relationship DetectionScene Understanding	CodeCode Available	5
Image Scene Graph Generation (SGG) Benchmark	Jul 27, 2021	AttributeGraph Generation	CodeCode Available	5
Visual Relationship Detection with Language prior and Softmax	Apr 16, 2019	Knowledge DistillationRelationship Detection	CodeCode Available	5
Self-Supervised Learning for Visual Relationship Detection through Masked Bounding Box Reconstruction	Nov 8, 2023	Predicate DetectionRelationship Detection	CodeCode Available	5
Phrase Localization and Visual Relationship Detection with Comprehensive Image-Language Cues	Nov 21, 2016	AttributePosition	CodeCode Available	5
Deeply Supervised Multimodal Attentional Translation Embeddings for Visual Relationship Detection	Feb 15, 2019	Relationship DetectionScene Understanding	CodeCode Available	5
On Exploring Undetermined Relationships for Visual Relationship Detection	May 5, 2019	ObjectRelationship Detection	—Unverified	0
Optimising the Input Image to Improve Visual Relationship Detection	Mar 26, 2019	Objectobject-detection	—Unverified	0
Visual Relationship Detection with Low Rank Non-Negative Tensor Decomposition	Nov 22, 2019	FormRelationship Detection	—Unverified	0
ReLaText: Exploiting Visual Relationships for Arbitrary-Shaped Scene Text Detection with Graph Convolutional Networks	Mar 16, 2020	Link PredictionRegion Proposal	—Unverified	0
RelVAE: Generative Pretraining for few-shot Visual Relationship Detection	Nov 27, 2023	Predicate ClassificationRelationship Detection	—Unverified	0
Visual Semantic Information Pursuit: A Survey	Mar 13, 2019	Graph Generationobject-detection	—Unverified	0
Scene Graph Generation: A Comprehensive Survey	Jan 3, 2022	Graph Generationobject-detection	—Unverified	0
Scene Graph Generation with External Knowledge and Image Reconstruction	Apr 1, 2019	Graph GenerationImage Reconstruction	—Unverified	0
A Comprehensive Survey of Scene Graphs: Generation and Application	Mar 17, 2021	Image CaptioningQuestion Answering	—Unverified	0
Scene-Graph ViT: End-to-End Open-Vocabulary Visual Relationship Detection	Mar 21, 2024	DecoderObject	—Unverified	0
VReBERT: A Simple and Flexible Transformer for Visual Relationship Detection	Jun 18, 2022	ObjectRelationship Detection	—Unverified	0
Tensorize, Factorize and Regularize: Robust Visual Relationship Learning	Jun 1, 2018	Relational ReasoningRelationship Detection	—Unverified	0

Show:10 25 50

← PrevPage 2 of 4Next →

All datasets VRD Relationship Detection VRD Phrase Detection VRD Predicate Detection Visual Genome VRD

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Yu et. al [[Yu et al.2017a]]	R@100	31.89	—	Unverified
2	vrd-dsr	R@100	23.29	—	Unverified
3	BLOCK	R@100	20.96	—	Unverified
4	Dai et. al [[Dai, Zhang, and Lin2017]]	R@100	20.88	—	Unverified
5	Liang et. al [[Liang, Lee, and Xing2017]]	R@100	20.79	—	Unverified
6	Peyre et. al [[Peyre et al.2017]]	R@100	17.1	—	Unverified
7	Zhang et. al [[Hanwang Zhang2017]]	R@100	15.2	—	Unverified
8	Lu et. al [[Lu et al.2016]]	R@100	14.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Yu et. al [[Yu et al.2017a]]	R@100	29.43	—	Unverified
2	BLOCK	R@100	28.96	—	Unverified
3	Dai et. al [[Dai, Zhang, and Lin2017]]	R@100	23.45	—	Unverified
4	Liang et. al [[Liang, Lee, and Xing2017]]	R@100	22.6	—	Unverified
5	Zhang et. al [[Hanwang Zhang2017]]	R@100	22.42	—	Unverified
6	Peyre et. al [[Peyre et al.2017]]	R@100	19.5	—	Unverified
7	Lu et. al [[Lu et al.2016]]	R@100	17.03	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Yu et. al [[Yu et al.2017a]]	R@100	94.65	—	Unverified
2	vrd-dsr	R@100	93.18	—	Unverified
3	BLOCK	R@100	92.58	—	Unverified
4	Dai et. al [[Dai, Zhang, and Lin2017]]	R@100	81.9	—	Unverified
5	Peyre et. al [[Peyre et al.2017]]	R@100	52.6	—	Unverified
6	Lu et. al [[Lu et al.2016]]	R@100	47.87	—	Unverified
7	Zhang et. al [[Hanwang Zhang2017]]	R@100	44.76	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PEVL	R@100	66.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Ours - v	R@50 k=1	15	—	Unverified