Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 151–175 of 449 papers

Title	Date	Tasks	Status	Score
Multiverse Through Deepfakes: The MultiFakeVerse Dataset of Person-Centric Visual and Conceptual Manipulations	Jun 1, 2025	DeepFake DetectionFace Swapping	CodeCode Available	5
No-Frills Human-Object Interaction Detection: Factorization, Layout Encodings, and Training Techniques	Nov 14, 2018	Human-Object Interaction DetectionObject	CodeCode Available	5
Leverage Interactive Affinity for Affordance Learning	Jan 1, 2023	Human-Object Interaction DetectionObject	CodeCode Available	5
Object-centric Video Representation for Long-term Action Anticipation	Oct 31, 2023	Action AnticipationHuman-Object Interaction Detection	CodeCode Available	5
Forecasting Human-Object Interaction: Joint Prediction of Motor Attention and Actions in First Person Video	Nov 25, 2019	Action AnticipationHuman-Object Interaction Detection	CodeCode Available	5
Descriptive Caption Enhancement with Visual Specialists for Multimodal Perception	Dec 18, 2024	DescriptiveHuman-Object Interaction Detection	CodeCode Available	5
Focusing on what to decode and what to train: SOV Decoding with Specific Target Guided DeNoising and Vision Language Advisor	Jul 5, 2023	DecoderDenoising	CodeCode Available	5
Learning Human-Object Interactions by Graph Parsing Neural Networks	Aug 23, 2018	Human-Object Interaction DetectionObject	CodeCode Available	5
Fine-Grained Multi-View Hand Reconstruction Using Inverse Rendering	Jul 8, 2024	Human-Object Interaction DetectionInverse Rendering	CodeCode Available	5
Fine-grained Affordance Annotation for Egocentric Hand-Object Interaction Videos	Feb 7, 2023	Action AnticipationAction Recognition	CodeCode Available	5
Interaction Region Visual Transformer for Egocentric Action Anticipation	Nov 25, 2022	Action AnticipationHuman-Object Interaction Detection	CodeCode Available	5
Interactiveness Field in Human-Object Interactions	Apr 16, 2022	Human-Object Interaction DetectionObject	CodeCode Available	5
B-RIGHT: Benchmark Re-evaluation for Integrity in Generalized Human-Object Interaction Testing	Jan 28, 2025	Human-Object Interaction Detection	CodeCode Available	5
Boosting Zero-Shot Human-Object Interaction Detection with Vision-Language Transfer	Mar 18, 2024	Human-Object Interaction DetectionLanguage Modeling	CodeCode Available	5
A Plug-and-Play Method for Rare Human-Object Interactions Detection by Bridging Domain Gap	Jul 31, 2024	Human-Object Interaction DetectionImage Reconstruction	CodeCode Available	5
Exploiting Multimodal Synthetic Data for Egocentric Human-Object Interaction Detection in an Industrial Scenario	Jun 21, 2023	Human-Object Interaction Detection	CodeCode Available	5
Exploiting CLIP for Zero-shot HOI Detection Requires Knowledge Distillation at Multiple Levels	Sep 10, 2023	Human-Object Interaction DetectionKnowledge Distillation	CodeCode Available	5
HICO-DET-SG and V-COCO-SG: New Data Splits for Evaluating the Systematic Generalization Performance of Human-Object Interaction Detection Models	May 17, 2023	Human-Object Interaction DetectionSystematic Generalization	CodeCode Available	5
ERNet: Efficient and Reliable Human-Object Interaction Detection	Jan 26, 2023	Human-Object Interaction DetectionObject	CodeCode Available	5
Grounded Human-Object Interaction Hotspots from Video	Dec 11, 2018	Human-Object Interaction DetectionObject	CodeCode Available	5
Highlighting Object Category Immunity for the Generalization of Human-Object Interaction Detection	Feb 19, 2022	Human-Object Interaction DetectionObject	CodeCode Available	5
Controllable Human-Object Interaction Synthesis	Dec 6, 2023	Human-Object Interaction DetectionObject	—Unverified	0
End-to-End HOI Reconstruction Transformer with Graph-based Encoding	Mar 8, 2025	Human-Object Interaction Detection	—Unverified	0
EigenActor: Variant Body-Object Interaction Generation Evolved from Invariant Action Basis Reasoning	Mar 1, 2025	Human-Object Interaction DetectionObject	—Unverified	0
Contextual Heterogeneous Graph Network for Human-Object Interaction Detection	Oct 20, 2020	Graph AttentionHuman-Object Interaction Detection	—Unverified	0

Show:10 25 50

← PrevPage 7 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified