Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 326–350 of 449 papers

Title	Date	Tasks	Status
Reasoning Mamba: Hypergraph-Guided Region Relation Calculating for Weakly Supervised Affordance Grounding	Jan 1, 2025	Human-Object Interaction DetectionMamba	—Unverified
Category-Aware Transformer Network for Better Human-Object Interaction Detection	Apr 11, 2022	Human-Object Interaction DetectionObject	—Unverified
Reconstructing Action-Conditioned Human-Object Interactions Using Commonsense Knowledge Priors	Sep 6, 2022	Human-Object Interaction DetectionObject	—Unverified
CG-HOI: Contact-Guided 3D Human-Object Interaction Generation	Nov 27, 2023	Human-Object Interaction DetectionHuman-Object Interaction Generation	—Unverified
ChainHOI: Joint-based Kinematic Chain Modeling for Human-Object Interaction Generation	Jan 1, 2025	Human-Object Interaction DetectionHuman-Object Interaction Generation	—Unverified
Reconstructing In-the-Wild Open-Vocabulary Human-Object Interactions	Mar 20, 2025	3D ReconstructionHuman-Object Interaction Detection	—Unverified
ChatHuman: Chatting about 3D Humans with Tools	Jan 1, 2025	Human-Object Interaction DetectionIn-Context Learning	—Unverified
ChatHuman: Language-driven 3D Human Understanding with Retrieval-Augmented Tool Reasoning	May 7, 2024	Human-Object Interaction DetectionIn-Context Learning	—Unverified
CHORUS: Learning Canonicalized 3D Human-Object Spatial Relations from Unbounded Synthesized Images	Aug 23, 2023	Common Sense ReasoningDiversity	—Unverified
CHORUS : Learning Canonicalized 3D Human-Object Spatial Relations from Unbounded Synthesized Images	Jan 1, 2023	Common Sense ReasoningDiversity	—Unverified
CinePile: A Long Video Question Answering Dataset and Benchmark	May 14, 2024	FormHuman-Object Interaction Detection	—Unverified
Classifying All Interacting Pairs in a Single Shot	Jan 13, 2020	AllHuman-Object Interaction Detection	—Unverified
CL-HOI: Cross-Level Human-Object Interaction Distillation from Vision Large Language Models	Oct 21, 2024	Human-Object Interaction Detection	—Unverified
COBE: Contextualized Object Embeddings from Narrated Instructional Video	Jul 14, 2020	Human-Object Interaction DetectionObject	—Unverified
Complex Video Action Reasoning via Learnable Markov Logic Network	Jan 1, 2022	Action RecognitionHuman-Object Interaction Detection	—Unverified
Compositional 3D Human-Object Neural Animation	Apr 27, 2023	Human-Object Interaction DetectionNeRF	—Unverified
Compositional Learning for Human Object Interaction	Sep 1, 2018	Human-Object Interaction DetectionObject	—Unverified
Compositional Learning in Transformer-Based Human-Object Interaction Detection	Aug 11, 2023	Human-Object Interaction DetectionObject	—Unverified
Recurrent Models for Situation Recognition	Mar 18, 2017	Grounded Situation RecognitionHuman-Object Interaction Detection	—Unverified
ContextHOI: Spatial Context Learning for Human-Object Interaction Detection	Dec 12, 2024	Human-Object Interaction DetectionObject	—Unverified
Contextual Guided Segmentation Framework for Semi-supervised Video Instance Segmentation	Jun 7, 2021	Human-Object Interaction DetectionInstance Segmentation	—Unverified
Contextual Heterogeneous Graph Network for Human-Object Interaction Detection	Oct 20, 2020	Graph AttentionHuman-Object Interaction Detection	—Unverified
Controllable Human-Object Interaction Synthesis	Dec 6, 2023	Human-Object Interaction DetectionObject	—Unverified
CooHOI: Learning Cooperative Human-Object Interaction with Manipulated Object Dynamics	Jun 20, 2024	Human-Object Interaction DetectionHumanoid Control	—Unverified
An Image-like Diffusion Method for Human-Object Interaction Detection	Mar 23, 2025	Human-Object Interaction DetectionImage Generation	—Unverified

Show:10 25 50

← PrevPage 14 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified