Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 176–200 of 449 papers

Title	Date	Tasks	Status
Discovering Human Interactions in Videos with Limited Data Labeling	Feb 12, 2015	ClusteringHuman-Object Interaction Detection	—Unverified
CHORUS : Learning Canonicalized 3D Human-Object Spatial Relations from Unbounded Synthesized Images	Jan 1, 2023	Common Sense ReasoningDiversity	—Unverified
A Graph-based Interactive Reasoning for Human-Object Interaction Detection	Jul 14, 2020	Human-Object Interaction Detection	—Unverified
HandyPriors: Physically Consistent Perception of Hand-Object Interactions with Differentiable Priors	Nov 28, 2023	Human-Object Interaction DetectionObject	—Unverified
Diffgrasp: Whole-Body Grasping Synthesis Guided by Object Motion Using a Diffusion Model	Dec 30, 2024	Human-Object Interaction Detection	—Unverified
CHORUS: Learning Canonicalized 3D Human-Object Spatial Relations from Unbounded Synthesized Images	Aug 23, 2023	Common Sense ReasoningDiversity	—Unverified
Human-Aware 3D Scene Generation with Spatially-constrained Diffusion Models	Jun 26, 2024	Collision AvoidanceHuman-Object Interaction Detection	—Unverified
Guiding Human-Object Interactions with Rich Geometry and Relations	Mar 26, 2025	Human-Object Interaction DetectionMotion Generation	—Unverified
Diagnosing Rarity in Human-Object Interaction Detection	Jun 10, 2020	Human-Object Interaction DetectionObject	—Unverified
Group Activity Recognition via Dynamic Composition and Interaction	May 9, 2023	Activity RecognitionGroup Activity Recognition	—Unverified
HICO: A Benchmark for Recognizing Human-Object Interactions in Images	Dec 1, 2015	Human-Object Interaction DetectionObject	—Unverified
Grounded Human-Object Interaction Hotspots from Video (Extended Abstract)	Jun 3, 2019	Human-Object Interaction DetectionObject	—Unverified
Hi-Dyna Graph: Hierarchical Dynamic Scene Graph for Robotic Autonomy in Human-Centric Environments	May 30, 2025	Graph GenerationHuman-Object Interaction Detection	—Unverified
Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Models	Oct 3, 2023	DiversityHuman-Object Interaction Detection	—Unverified
Hierarchical Video Prediction Using Relational Layouts for Human-Object Interactions	Jun 19, 2021	Human-Object Interaction DetectionObject	—Unverified
ChatHuman: Language-driven 3D Human Understanding with Retrieval-Augmented Tool Reasoning	May 7, 2024	Human-Object Interaction DetectionIn-Context Learning	—Unverified
DexVIP: Learning Dexterous Grasping with Human Hand Pose Priors from Video	Feb 1, 2022	Deep Reinforcement LearningHuman-Object Interaction Detection	—Unverified
ChatHuman: Chatting about 3D Humans with Tools	Jan 1, 2025	Human-Object Interaction DetectionIn-Context Learning	—Unverified
Hoi2Anomaly: An Explainable Anomaly Detection Approach Guided by Human-Object Interaction	Mar 13, 2025	Anomaly DetectionHuman-Object Interaction Detection	—Unverified
Gravity-Aware Monocular 3D Human-Object Reconstruction	Aug 19, 2021	Human-Object Interaction DetectionObject	—Unverified
GraspDiffusion: Synthesizing Realistic Whole-body Hand-Object Interaction	Oct 17, 2024	Human-Object Interaction DetectionImage Generation	—Unverified
whu-nercms at trecvid2021:instance search task	Oct 30, 2021	Action DetectionFace Detection	—Unverified
HOIAnimator: Generating Text-prompt Human-object Animations using Novel Perceptive Diffusion Models	Jan 1, 2024	DenoisingHuman-Object Interaction Detection	—Unverified
3D-AffordanceLLM: Harnessing Large Language Models for Open-Vocabulary Affordance Detection in 3D Worlds	Feb 27, 2025	Affordance DetectionHuman-Object Interaction Detection	—Unverified
Human Centred Object Co-Segmentation	Jun 12, 2016	Human-Object Interaction DetectionObject	—Unverified

Show:10 25 50

← PrevPage 8 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified