Visual Relationship Detection

Visual relationship detection (VRD) is one newly developed computer vision task aiming to recognize relations or interactions between objects in an image. It is a further learning task after object recognition and is essential for fully understanding images, even the visual world.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 51–75 of 82 papers

Title	Date	Tasks	Status	Hype
Contextual Translation Embedding for Visual Relationship Detection and Scene Graph Generation	May 28, 2019	Graph GenerationObject	—Unverified	0
On Exploring Undetermined Relationships for Visual Relationship Detection	May 5, 2019	ObjectRelationship Detection	—Unverified	0
Improving Visual Relation Detection using Depth Maps	May 2, 2019	ObjectRelation	CodeCode Available	0
Visual Relationship Detection with Language prior and Softmax	Apr 16, 2019	Knowledge DistillationRelationship Detection	CodeCode Available	0
Target-Tailored Source-Transformation for Scene Graph Generation	Apr 3, 2019	graph constructionGraph Generation	—Unverified	0
Scene Graph Generation with External Knowledge and Image Reconstruction	Apr 1, 2019	Graph GenerationImage Reconstruction	—Unverified	0
Optimising the Input Image to Improve Visual Relationship Detection	Mar 26, 2019	Objectobject-detection	—Unverified	0
On Class Imbalance and Background Filtering in Visual Relationship Detection	Mar 20, 2019	Relationship DetectionVisual Relationship Detection	—Unverified	0
Visual Semantic Information Pursuit: A Survey	Mar 13, 2019	Graph Generationobject-detection	—Unverified	0
Graphical Contrastive Losses for Scene Graph Parsing	Mar 7, 2019	Relationship DetectionScene Graph Generation	CodeCode Available	1
Deeply Supervised Multimodal Attentional Translation Embeddings for Visual Relationship Detection	Feb 15, 2019	Relationship DetectionScene Understanding	CodeCode Available	0
BLOCK: Bilinear Superdiagonal Fusion for Visual Question Answering and Visual Relationship Detection	Jan 31, 2019	Question AnsweringRelationship Detection	CodeCode Available	0
An Interpretable Model for Scene Graph Generation	Nov 21, 2018	Graph GenerationImage Captioning	—Unverified	0
The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scale	Nov 2, 2018	General Classificationimage-classification	CodeCode Available	0
Introduction to the 1st Place Winning Model of OpenImages Relationship Detection Challenge	Nov 1, 2018	Relationship DetectionVisual Relationship Detection	—Unverified	0
A Problem Reduction Approach for Visual Relationships Detection	Sep 26, 2018	object-detectionObject Detection	—Unverified	0
Context-Dependent Diffusion Network for Visual Relationship Detection	Sep 11, 2018	DiversityObject	—Unverified	0
Improving Visual Relationship Detection using Semantic Modeling of Scene Descriptions	Sep 1, 2018	Link Predictionobject-detection	—Unverified	0
Improving Information Extraction from Images with Learned Semantic Models	Aug 27, 2018	General ClassificationRelationship Detection	—Unverified	0
Factorizable Net: An Efficient Subgraph-based Framework for Scene Graph Generation	Jun 29, 2018	ClusteringGraph Generation	CodeCode Available	0
Tensorize, Factorize and Regularize: Robust Visual Relationship Learning	Jun 1, 2018	Relational ReasoningRelationship Detection	—Unverified	0
Visual Relationship Detection Based on Guided Proposals and Semantic Knowledge Distillation	May 28, 2018	Common Sense ReasoningKnowledge Distillation	—Unverified	0
Visual relationship detection with deep structural ranking	Apr 27, 2018	Relationship DetectionVisual Relationship Detection	CodeCode Available	0
Natural Language Guided Visual Relationship Detection	Nov 16, 2017	Relationship DetectionScene Understanding	—Unverified	0
Attend and Interact: Higher-Order Object Interactions for Video Understanding	Nov 16, 2017	Action ClassificationAction Recognition	—Unverified	0

Show:10 25 50

← PrevPage 3 of 4Next →

All datasets VRD Relationship Detection VRD Phrase Detection VRD Predicate Detection Visual Genome VRD

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Yu et. al [[Yu et al.2017a]]	R@100	31.89	—	Unverified
2	vrd-dsr	R@100	23.29	—	Unverified
3	BLOCK	R@100	20.96	—	Unverified
4	Dai et. al [[Dai, Zhang, and Lin2017]]	R@100	20.88	—	Unverified
5	Liang et. al [[Liang, Lee, and Xing2017]]	R@100	20.79	—	Unverified
6	Peyre et. al [[Peyre et al.2017]]	R@100	17.1	—	Unverified
7	Zhang et. al [[Hanwang Zhang2017]]	R@100	15.2	—	Unverified
8	Lu et. al [[Lu et al.2016]]	R@100	14.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Yu et. al [[Yu et al.2017a]]	R@100	29.43	—	Unverified
2	BLOCK	R@100	28.96	—	Unverified
3	Dai et. al [[Dai, Zhang, and Lin2017]]	R@100	23.45	—	Unverified
4	Liang et. al [[Liang, Lee, and Xing2017]]	R@100	22.6	—	Unverified
5	Zhang et. al [[Hanwang Zhang2017]]	R@100	22.42	—	Unverified
6	Peyre et. al [[Peyre et al.2017]]	R@100	19.5	—	Unverified
7	Lu et. al [[Lu et al.2016]]	R@100	17.03	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Yu et. al [[Yu et al.2017a]]	R@100	94.65	—	Unverified
2	vrd-dsr	R@100	93.18	—	Unverified
3	BLOCK	R@100	92.58	—	Unverified
4	Dai et. al [[Dai, Zhang, and Lin2017]]	R@100	81.9	—	Unverified
5	Peyre et. al [[Peyre et al.2017]]	R@100	52.6	—	Unverified
6	Lu et. al [[Lu et al.2016]]	R@100	47.87	—	Unverified
7	Zhang et. al [[Hanwang Zhang2017]]	R@100	44.76	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PEVL	R@100	66.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Ours - v	R@50 k=1	15	—	Unverified