Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 426–449 of 449 papers

Title	Date	Tasks	Status
Highlighting Object Category Immunity for the Generalization of Human-Object Interaction Detection	Feb 19, 2022	Human-Object Interaction DetectionObject	CodeCode Available
Boosting Zero-Shot Human-Object Interaction Detection with Vision-Language Transfer	Mar 18, 2024	Human-Object Interaction DetectionLanguage Modeling	CodeCode Available
Focusing on what to decode and what to train: SOV Decoding with Specific Target Guided DeNoising and Vision Language Advisor	Jul 5, 2023	DecoderDenoising	CodeCode Available
B-RIGHT: Benchmark Re-evaluation for Integrity in Generalized Human-Object Interaction Testing	Jan 28, 2025	Human-Object Interaction Detection	CodeCode Available
A Plug-and-Play Method for Rare Human-Object Interactions Detection by Bridging Domain Gap	Jul 31, 2024	Human-Object Interaction DetectionImage Reconstruction	CodeCode Available
Forecasting Human-Object Interaction: Joint Prediction of Motor Attention and Actions in First Person Video	Nov 25, 2019	Action AnticipationHuman-Object Interaction Detection	CodeCode Available
Pairwise Body-Part Attention for Recognizing Human-Object Interactions	Jul 28, 2018	feature selectionHuman-Object Interaction Detection	CodeCode Available
TED-Net: Dispersal Attention for Perceiving Interaction Region in Indirectly-Contact HOI Detection	Jan 26, 2024	Human-Object Interaction Detectionobject-detection	CodeCode Available
Consistency Learning via Decoding Path Augmentation for Transformers in Human Object Interaction Detection	Apr 11, 2022	Human-Object Interaction Detectionobject-detection	CodeCode Available
VioPose: Violin Performance 4D Pose Estimation by Hierarchical Audiovisual Inference	Nov 19, 2024	Human-Object Interaction DetectionPose Estimation	CodeCode Available
Distance Matters in Human-Object Interaction Detection	Jul 5, 2022	Human-Object Interaction DetectionObject	CodeCode Available
A Skeleton-aware Graph Convolutional Network for Human-Object Interaction Detection	Jul 11, 2022	Human-Object Interaction DetectionObject	CodeCode Available
Efficient Explicit Joint-level Interaction Modeling with Mamba for Text-guided HOI Generation	Mar 29, 2025	Human-Object Interaction DetectionMamba	CodeCode Available
Toward Open-Set Human Object Interaction Detection	Mar 24, 2024	Contrastive LearningHuman-Object Interaction Detection	CodeCode Available
Attentional Pooling for Action Recognition	Nov 4, 2017	Action RecognitionHuman-Object Interaction Detection	CodeCode Available
Multiverse Through Deepfakes: The MultiFakeVerse Dataset of Person-Centric Visual and Conceptual Manipulations	Jun 1, 2025	DeepFake DetectionFace Swapping	CodeCode Available
Geometric Features Enhanced Human-Object Interaction Detection	Jun 26, 2024	Human-Object Interaction DetectionObject	CodeCode Available
PersonaHOI: Effortlessly Improving Personalized Face with Human-Object Interaction Generation	Jan 10, 2025	Human-Object Interaction DetectionHuman-Object Interaction Generation	CodeCode Available
PersonaHOI: Effortlessly Improving Face Personalization in Human-Object Interaction Generation	Jan 1, 2025	Human-Object Interaction DetectionHuman-Object Interaction Generation	CodeCode Available
Learning Human-Object Interactions by Graph Parsing Neural Networks	Aug 23, 2018	Human-Object Interaction DetectionObject	CodeCode Available
Contextual Action Recognition with R*CNN	May 5, 2015	Action RecognitionAttribute	CodeCode Available
Egocentric Human-Object Interaction Detection Exploiting Synthetic Data	Apr 14, 2022	Human-Object Interaction DetectionObject	CodeCode Available
Comparative Analysis of CNN-based Spatiotemporal Reasoning in Videos	Sep 11, 2019	Action RecognitionHuman-Object Interaction Detection	CodeCode Available
Temporal Relational Reasoning in Videos	Nov 22, 2017	Action ClassificationAction Recognition	CodeCode Available

Show:10 25 50

← PrevPage 18 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified