Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 51–75 of 449 papers

Title	Date	Tasks	Status	Hype
HOI Analysis: Integrating and Decomposing Human-Object Interaction	Oct 30, 2020	Human-Object Interaction DetectionObject	CodeCode Available	1
HOICLIP: Efficient Knowledge Transfer for HOI Detection with Vision-Language Models	Mar 28, 2023	DecoderHuman-Object Interaction Detection	CodeCode Available	1
BEHAVE: Dataset and Method for Tracking Human Object Interactions	Apr 14, 2022	3D Human Reconstruction3D Object Reconstruction	CodeCode Available	1
DRG: Dual Relation Graph for Human-Object Interaction Detection	Aug 26, 2020	Human-Object Interaction DetectionObject	CodeCode Available	1
Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise Transformer	Dec 3, 2021	GPUHuman-Object Interaction Detection	CodeCode Available	1
IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactions	Dec 14, 2022	Human-Object Interaction DetectionMotion Synthesis	CodeCode Available	1
ConsNet: Learning Consistency Graph for Zero-Shot Human-Object Interaction Detection	Aug 14, 2020	Human-Object Interaction DetectionObject	CodeCode Available	1
Ins-HOI: Instance Aware Human-Object Interactions Recovery	Dec 15, 2023	DescriptiveDisentanglement	CodeCode Available	1
End-to-End Human Object Interaction Detection with HOI Transformer	Mar 8, 2021	Human-Object Interaction Detectionobject-detection	CodeCode Available	1
Interaction Compass: Multi-Label Zero-Shot Learning of Human-Object Interactions via Spatial Relations	Jan 1, 2021	Human-Object Interaction DetectionMulti-label zero-shot learning	CodeCode Available	1
Discovering Human-Object Interaction Concepts via Self-Compositional Learning	Mar 27, 2022	Affordance RecognitionHuman-Object Interaction Concept Discovery	CodeCode Available	1
DIRV: Dense Interaction Region Voting for End-to-End Human-Object Interaction Detection	Oct 2, 2020	Human-Object Interaction Detection	CodeCode Available	1
Disentangled Pre-training for Human-Object Interaction Detection	Apr 2, 2024	Action RecognitionDecoder	CodeCode Available	1
Detailed 2D-3D Joint Representation for Human-Object Interaction	Apr 17, 2020	Action UnderstandingHuman-Object Interaction Detection	CodeCode Available	1
Boosting Human-Object Interaction Detection with Text-to-Image Diffusion Model	May 20, 2023	DiversityHuman-Object Interaction Detection	CodeCode Available	1
Detecting Human-Object Interactions with Action Co-occurrence Priors	Jul 17, 2020	Human-Object Interaction Detection	CodeCode Available	1
Diagnosing Human-object Interaction Detectors	Aug 16, 2023	ClassificationHuman-Object Interaction Detection	CodeCode Available	1
D3D-HOI: Dynamic 3D Human-Object Interactions from Videos	Aug 19, 2021	Human-Object Interaction DetectionObject	CodeCode Available	1
Discovering A Variety of Objects in Spatio-Temporal Human-Object Interactions	Nov 14, 2022	Human-Object Interaction DetectionObject	CodeCode Available	1
Discovering Human Interactions With Novel Objects via Zero-Shot Learning	Jun 1, 2020	Human-Object Interaction DetectionObject	CodeCode Available	1
DECO: Dense Estimation of 3D Human-Scene Contact In The Wild	Sep 26, 2023	Contact DetectionDense contact estimation	CodeCode Available	1
Affordance Transfer Learning for Human-Object Interaction Detection	Apr 7, 2021	Affordance DetectionAffordance Recognition	CodeCode Available	1
Cascaded Human-Object Interaction Recognition	Mar 9, 2020	Human-Object Interaction DetectionObject	CodeCode Available	1
Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimation	Jun 10, 2021	Egocentric Pose EstimationHuman-Object Interaction Detection	CodeCode Available	1
Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object Interactions	May 27, 2022	BenchmarkingFew-Shot Image Classification	CodeCode Available	1

Show:10 25 50

← PrevPage 3 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified