Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 351–375 of 449 papers

Title	Date	Tasks	Status	Hype
Detecting Human-Object Interaction with Mixed Supervision	Nov 10, 2020	Human-Object Interaction DetectionObject	—Unverified	0
Kinematics-Guided Reinforcement Learning for Object-Aware 3D Ego-Pose Estimation	Nov 10, 2020	Human-Object Interaction DetectionObject	—Unverified	0
HOI Analysis: Integrating and Decomposing Human-Object Interaction	Oct 30, 2020	Human-Object Interaction DetectionObject	CodeCode Available	1
Contextual Heterogeneous Graph Network for Human-Object Interaction Detection	Oct 20, 2020	Graph AttentionHuman-Object Interaction Detection	—Unverified	0
Self-Selective Context for Interaction Recognition	Oct 17, 2020	Human-Object Interaction DetectionObject	—Unverified	0
The MECCANO Dataset: Understanding Human-Object Interactions from Egocentric Videos in an Industrial-like Domain	Oct 12, 2020	Action RecognitionActive Object Detection	CodeCode Available	1
DecAug: Augmenting HOI Detection via Decomposition	Oct 2, 2020	Data AugmentationDomain Generalization	—Unverified	0
DIRV: Dense Interaction Region Voting for End-to-End Human-Object Interaction Detection	Oct 2, 2020	Human-Object Interaction Detection	CodeCode Available	1
Human-Object Interaction Detection:A Quick Survey and Examination of Methods	Sep 27, 2020	Human-Object Interaction DetectionObject	CodeCode Available	1
Zero-Shot Human-Object Interaction Recognition via Affordance Graphs	Sep 2, 2020	Human-Object Interaction Detection	—Unverified	0
DRG: Dual Relation Graph for Human-Object Interaction Detection	Aug 26, 2020	Human-Object Interaction DetectionObject	CodeCode Available	1
ConsNet: Learning Consistency Graph for Zero-Shot Human-Object Interaction Detection	Aug 14, 2020	Human-Object Interaction DetectionObject	CodeCode Available	1
Rb-PaStaNet: A Few-Shot Human-Object Interaction Detection Based on Rules and Part States	Aug 14, 2020	Human-Object Interaction Detection	CodeCode Available	0
Polysemy Deciphering Network for Robust Human-Object Interaction Detection	Aug 7, 2020	Human-Object Interaction DetectionObject	CodeCode Available	1
Pose-based Modular Network for Human-Object Interaction Detection	Aug 5, 2020	Human-Object Interaction DetectionObject	CodeCode Available	1
Detecting Human-Object Interactions with Action Co-occurrence Priors	Aug 1, 2020	Human-Object Interaction Detection	CodeCode Available	1
Amplifying Key Cues for Human-Object-Interaction Detection	Aug 1, 2020	Human-Object Interaction DetectionObject	—Unverified	0
Polysemy Deciphering Network for Human-Object Interaction Detection	Aug 1, 2020	Human-Object Interaction DetectionObject	CodeCode Available	1
LEMMA: A Multi-view Dataset for Learning Multi-agent Multi-task Activities	Jul 31, 2020	Action RecognitionAction Understanding	CodeCode Available	1
Perceiving 3D Human-Object Spatial Arrangements from a Single Image in the Wild	Jul 30, 2020	3D Human Pose Estimation3D Human Reconstruction	CodeCode Available	1
Visual Compositional Learning for Human-Object Interaction Detection	Jul 24, 2020	Affordance RecognitionHuman-Object Interaction Detection	CodeCode Available	1
Detecting Human-Object Interactions with Action Co-occurrence Priors	Jul 17, 2020	Human-Object Interaction Detection	CodeCode Available	1
COBE: Contextualized Object Embeddings from Narrated Instructional Video	Jul 14, 2020	Human-Object Interaction DetectionObject	—Unverified	0
A Graph-based Interactive Reasoning for Human-Object Interaction Detection	Jul 14, 2020	Human-Object Interaction Detection	—Unverified	0
VPN: Learning Video-Pose Embedding for Activities of Daily Living	Jul 6, 2020	Action ClassificationAction Recognition	CodeCode Available	1

Show:10 25 50

← PrevPage 15 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified