Visual Relationship Detection

Visual relationship detection (VRD) is one newly developed computer vision task aiming to recognize relations or interactions between objects in an image. It is a further learning task after object recognition and is essential for fully understanding images, even the visual world.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1–25 of 82 papers

Title	Date	Tasks	Status	Hype	Score
Compensating Supervision Incompleteness with Prior Knowledge in Semantic Image Interpretation	Oct 1, 2019	ObjectRelation	CodeCode Available	1	5
Distance-Aware Occlusion Detection with Focused Attention	Aug 23, 2022	DecoderHuman-Object Interaction Detection	CodeCode Available	1	5
Spatial-Temporal Transformer for Dynamic Scene Graph Generation	Jul 26, 2021	DecoderScene Graph Generation	CodeCode Available	1	5
LIGHTEN: Learning Interactions with Graph and Hierarchical TEmporal Networks for HOI in videos	Dec 17, 2020	Human-Object Interaction DetectionRelationship Detection	CodeCode Available	1	5
Explanation-based Weakly-supervised Learning of Visual Relations with Graph Networks	Jun 16, 2020	Graph Neural NetworkHuman-Object Interaction Detection	CodeCode Available	1	5
Exploring Long Tail Visual Relationship Recognition with Large Vocabulary	Mar 25, 2020	Visual Relationship Detection	CodeCode Available	1	5
Groupwise Query Specialization and Quality-Aware Multi-Assignment for Transformer-based Visual Relationship Detection	Mar 26, 2024	RelationRelationship Detection	CodeCode Available	1	5
Visual Relationship Detection with Visual-Linguistic Knowledge from Multimodal Representations	Sep 10, 2020	Objectobject-detection	CodeCode Available	1	5
Graphical Contrastive Losses for Scene Graph Parsing	Mar 7, 2019	Relationship DetectionScene Graph Generation	CodeCode Available	1	5
Neural Message Passing for Visual Relationship Detection	Aug 8, 2022	Relationship DetectionVisual Relationship Detection	CodeCode Available	1	5
NODIS: Neural Ordinary Differential Scene Understanding	Jan 14, 2020	AllGraph Generation	CodeCode Available	1	5
Recovering the Unbiased Scene Graphs from the Biased Ones	Jul 5, 2021	Missing LabelsScene Graph Classification	CodeCode Available	1	5
One Metric to Measure them All: Localisation Recall Precision (LRP) for Evaluating Visual Detection Tasks	Nov 21, 2020	AllInstance Segmentation	CodeCode Available	1	5
PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models	May 23, 2022	Language ModelingLanguage Modelling	CodeCode Available	1	5
2.5D Visual Relationship Detection	Apr 26, 2021	BenchmarkingDepth Estimation	CodeCode Available	1	5
Grounding Consistency: Distilling Spatial Common Sense for Precise Visual Relationship Detection	Jan 1, 2021	Common Sense ReasoningGraph Generation	CodeCode Available	1	5
RelTransformer: A Transformer-Based Long-Tail Visual Relationship Recognition	Apr 24, 2021	Image CaptioningObject Recognition	CodeCode Available	1	5
Phrase Localization and Visual Relationship Detection with Comprehensive Image-Language Cues	Nov 21, 2016	AttributePosition	CodeCode Available	0	5
AVR: Attention based Salient Visual Relationship Detection	Mar 16, 2020	Relationship DetectionVisual Relationship Detection	CodeCode Available	0	5
Constructing a Visual Relationship Authenticity Dataset	Oct 11, 2020	Relationship DetectionScene Understanding	CodeCode Available	0	5
Factorizable Net: An Efficient Subgraph-based Framework for Scene Graph Generation	Jun 29, 2018	ClusteringGraph Generation	CodeCode Available	0	5
Image Scene Graph Generation (SGG) Benchmark	Jul 27, 2021	AttributeGraph Generation	CodeCode Available	0	5
Improving Visual Relation Detection using Depth Maps	May 2, 2019	ObjectRelation	CodeCode Available	0	5
Deep Variation-structured Reinforcement Learning for Visual Relationship and Attribute Detection	Mar 8, 2017	Attributeimage-classification	CodeCode Available	0	5
BLOCK: Bilinear Superdiagonal Fusion for Visual Question Answering and Visual Relationship Detection	Jan 31, 2019	Question AnsweringRelationship Detection	CodeCode Available	0	5

Show:10 25 50

← PrevPage 1 of 4Next →

All datasets VRD Relationship Detection VRD Phrase Detection VRD Predicate Detection Visual Genome VRD

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Yu et. al [[Yu et al.2017a]]	R@100	31.89	—	Unverified
2	vrd-dsr	R@100	23.29	—	Unverified
3	BLOCK	R@100	20.96	—	Unverified
4	Dai et. al [[Dai, Zhang, and Lin2017]]	R@100	20.88	—	Unverified
5	Liang et. al [[Liang, Lee, and Xing2017]]	R@100	20.79	—	Unverified
6	Peyre et. al [[Peyre et al.2017]]	R@100	17.1	—	Unverified
7	Zhang et. al [[Hanwang Zhang2017]]	R@100	15.2	—	Unverified
8	Lu et. al [[Lu et al.2016]]	R@100	14.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Yu et. al [[Yu et al.2017a]]	R@100	29.43	—	Unverified
2	BLOCK	R@100	28.96	—	Unverified
3	Dai et. al [[Dai, Zhang, and Lin2017]]	R@100	23.45	—	Unverified
4	Liang et. al [[Liang, Lee, and Xing2017]]	R@100	22.6	—	Unverified
5	Zhang et. al [[Hanwang Zhang2017]]	R@100	22.42	—	Unverified
6	Peyre et. al [[Peyre et al.2017]]	R@100	19.5	—	Unverified
7	Lu et. al [[Lu et al.2016]]	R@100	17.03	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Yu et. al [[Yu et al.2017a]]	R@100	94.65	—	Unverified
2	vrd-dsr	R@100	93.18	—	Unverified
3	BLOCK	R@100	92.58	—	Unverified
4	Dai et. al [[Dai, Zhang, and Lin2017]]	R@100	81.9	—	Unverified
5	Peyre et. al [[Peyre et al.2017]]	R@100	52.6	—	Unverified
6	Lu et. al [[Lu et al.2016]]	R@100	47.87	—	Unverified
7	Zhang et. al [[Hanwang Zhang2017]]	R@100	44.76	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PEVL	R@100	66.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Ours - v	R@50 k=1	15	—	Unverified