Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 351–375 of 449 papers

Title	Date	Tasks	Status
COUCH: Towards Controllable Human-Chair Interactions	May 1, 2022	Human-Object Interaction DetectionObject	—Unverified
Crossing the Human-Robot Embodiment Gap with Sim-to-Real RL using One Human Demonstration	Apr 17, 2025	Data AugmentationHuman-Object Interaction Detection	—Unverified
CycleHOI: Improving Human-Object Interaction Detection with Cycle Consistency of Detection and Generation	Jul 16, 2024	Human-Object Interaction Detection	—Unverified
DAViD: Modeling Dynamic Affordance of 3D Objects using Pre-trained Video Diffusion Models	Jan 14, 2025	Human-Object Interaction DetectionObject	—Unverified
DecAug: Augmenting HOI Detection via Decomposition	Oct 2, 2020	Data AugmentationDomain Generalization	—Unverified
VirtualModel: Generating Object-ID-retentive Human-object Interaction Image by Diffusion Model for E-commerce Marketing	May 16, 2024	Human-Object Interaction DetectionImage Generation	—Unverified
The Overlooked Classifier in Human-Object Interaction Recognition	Dec 13, 2021	ClassificationHuman-Object Interaction Detection	—Unverified
Deep Contextual Attention for Human-Object Interaction Detection	Oct 17, 2019	Human-Object Interaction DetectionObject	—Unverified
Deep Semantic Abstractions of Everyday Human Activities: On Commonsense Representations of Human Interactions	Oct 10, 2017	Human-Object Interaction DetectionObject	—Unverified
DemoGrasp: Few-Shot Learning for Robotic Grasping with Human Demonstration	Dec 6, 2021	Few-Shot LearningHuman-Object Interaction Detection	—Unverified
Re-HOLD: Video Hand Object Interaction Reenactment via adaptive Layout-instructed Diffusion Model	Mar 21, 2025	DisentanglementHuman-Object Interaction Detection	—Unverified
Detecting and Recognizing Human-Object Interactions	Apr 24, 2017	Human-Object Interaction DetectionObject	—Unverified
Webly Supervised Concept Expansion for General Purpose Vision Models	Feb 4, 2022	Human-Object Interaction DetectionImage Retrieval	—Unverified
Detecting Human-Object Interactions via Functional Generalization	Apr 5, 2019	Human-Object Interaction DetectionObject	—Unverified
Relation Parsing Neural Network for Human-Object Interaction Detection	Oct 1, 2019	Human-Object Interaction DetectionObject	—Unverified
ViSA-Flow: Accelerating Robot Skill Learning via Large-Scale Video Semantic Action Flow	May 2, 2025	Human-Object Interaction Detection	—Unverified
Re-mine, Learn and Reason: Exploring the Cross-modal Semantic Correlations for Language-guided HOI detection	Jul 25, 2023	Human-Object Interaction DetectionSentence	—Unverified
RHINO: Learning Real-Time Humanoid-Human-Object Interaction from Human Demonstrations	Feb 18, 2025	Human-Object Interaction DetectionObject	—Unverified
Detecting Human-Object Interaction with Mixed Supervision	Nov 10, 2020	Human-Object Interaction DetectionObject	—Unverified
Detection and Localization of Firearm Carriers in Complex Scenes for Improved Safety Measures	Sep 17, 2023	Human-Object Interaction Detection	—Unverified
AnchorCrafter: Animate CyberAnchors Saling Your Products via Human-Object Interacting Video Generation	Nov 26, 2024	Human-Object Interaction DetectionObject	—Unverified
DexVIP: Learning Dexterous Grasping with Human Hand Pose Priors from Video	Feb 1, 2022	Deep Reinforcement LearningHuman-Object Interaction Detection	—Unverified
RHOBIN Challenge: Reconstruction of Human Object Interaction	Jan 7, 2024	3D ReconstructionHuman-Object Interaction Detection	—Unverified
Diagnosing Rarity in Human-Object Interaction Detection	Jun 10, 2020	Human-Object Interaction DetectionObject	—Unverified
Diffgrasp: Whole-Body Grasping Synthesis Guided by Object Motion Using a Diffusion Model	Dec 30, 2024	Human-Object Interaction Detection	—Unverified

Show:10 25 50

← PrevPage 15 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified