Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 251–275 of 449 papers

Title	Date	Tasks	Status
Learning from Observer Gaze:Zero-Shot Attention Prediction Oriented by Human-Object Interaction Recognition	May 16, 2024	Human-Object Interaction Detection	—Unverified
Learning from Observer Gaze: Zero-Shot Attention Prediction Oriented by Human-Object Interaction Recognition	Jan 1, 2024	Human-Object Interaction Detection	—Unverified
Towards Zero-shot Human-Object Interaction Detection via Vision-Language Integration	Mar 12, 2024	DecoderHuman-Object Interaction Detection	—Unverified
TPPO: A Novel Trajectory Predictor with Pseudo Oracle	Feb 4, 2020	Autonomous DrivingHuman-Object Interaction Detection	—Unverified
Learning Models for Actions and Person-Object Interactions with Transfer to Question Answering	Apr 16, 2016	General ClassificationHuman-Object Interaction Detection	—Unverified
Learning Structured Representations of Visual Scenes	Jul 9, 2022	Human-Object Interaction DetectionRepresentation Learning	—Unverified
Learning to Detect Human-Object Interactions	Feb 17, 2017	General ClassificationHuman-Object Interaction Detection	—Unverified
Learning to Detect Human-Object Interactions With Knowledge	Jun 1, 2019	Human-Object Interaction DetectionObject	—Unverified
Zero-Shot Human-Object Interaction Recognition via Affordance Graphs	Sep 2, 2020	Human-Object Interaction Detection	—Unverified
Learn to Predict How Humans Manipulate Large-sized Objects from Interactive Motions	Jun 25, 2022	Graph Neural NetworkHuman-Object Interaction Detection	—Unverified
Weakly-Supervised HOI Detection from Interaction Labels Only and Language/Vision-Language Priors	Mar 9, 2023	Human-Object Interaction DetectionLanguage Modeling	—Unverified
LEMON: Learning 3D Human-Object Interaction Relation from 2D Images	Dec 14, 2023	Human-Object Interaction DetectionObject	—Unverified
Leveraging Next-Active Objects for Context-Aware Anticipation in Egocentric Videos	Aug 16, 2023	Action AnticipationActive Object Localization	—Unverified
Lifting Motion to the 3D World via 2D Diffusion	Nov 27, 2024	Human-Object Interaction Detection	—Unverified
TriDi: Trilateral Diffusion of 3D Humans, Objects, and Interactions	Dec 9, 2024	Human-Object Interaction DetectionMixed Reality	—Unverified
LLAVIDAL: A Large LAnguage VIsion Model for Daily Activities of Living	Jun 13, 2024	BenchmarkingHuman-Object Interaction Detection	—Unverified
TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wild	Apr 8, 2021	Autonomous DrivingHuman-Object Interaction Detection	—Unverified
Localizing Firearm Carriers by Identifying Human-Object Pairs	May 19, 2020	Human-Object Interaction DetectionObject	—Unverified
Low-Cost Scene Modeling using a Density Function Improves Segmentation Performance	May 26, 2016	Human-Object Interaction DetectionObject	—Unverified
MaskedManipulator: Versatile Whole-Body Control for Loco-Manipulation	May 25, 2025	Human-Object Interaction DetectionObject	—Unverified
MECCANO: A Multimodal Egocentric Dataset for Humans Behavior Understanding in the Industrial-like Domain	Sep 19, 2022	Action AnticipationAction Recognition	—Unverified
Mining Conditional Part Semantics with Occluded Extrapolation for Human-Object Interaction Detection	Jul 19, 2023	Human-Object Interaction DetectionObject	—Unverified
TUHOI: Trento Universal Human Object Interaction Dataset	Aug 1, 2014	Human-Object Interaction DetectionObject	—Unverified
Turbo Learning Framework for Human-Object Interactions Recognition and Human Pose Estimation	Mar 15, 2019	Human-Object Interaction DetectionPose Estimation	—Unverified
Modelling Spatio-Temporal Interactions for Compositional Action Recognition	May 4, 2023	Action RecognitionHuman-Object Interaction Detection	—Unverified

Show:10 25 50

← PrevPage 11 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified