Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 101–125 of 449 papers

Title	Date	Tasks	Status	Hype
Distance-Aware Occlusion Detection with Focused Attention	Aug 23, 2022	DecoderHuman-Object Interaction Detection	CodeCode Available	1
Perceiving 3D Human-Object Spatial Arrangements from a Single Image in the Wild	Jul 30, 2020	3D Human Pose Estimation3D Human Reconstruction	CodeCode Available	1
EZ-HOI: VLM Adaptation via Guided Prompt Learning for Zero-Shot HOI Detection	Oct 31, 2024	Human-Object Interaction DetectionLarge Language Model	CodeCode Available	1
PoseGPT: Quantization-based 3D Human Motion Generation and Forecasting	Oct 19, 2022	Human-Object Interaction DetectionMotion Generation	CodeCode Available	1
QPIC: Query-Based Pairwise Human-Object Interaction Detection with Image-Wide Contextual Information	Mar 9, 2021	Human-Object Interaction Concept DiscoveryHuman-Object Interaction Detection	CodeCode Available	1
Glance and Gaze: Inferring Action-aware Points for One-Stage Human-Object Interaction Detection	Apr 12, 2021	Human-Object Interaction Detection	CodeCode Available	1
BEHAVE: Dataset and Method for Tracking Human Object Interactions	Apr 14, 2022	3D Human Reconstruction3D Object Reconstruction	CodeCode Available	1
DRG: Dual Relation Graph for Human-Object Interaction Detection	Aug 26, 2020	Human-Object Interaction DetectionObject	CodeCode Available	1
RLIP: Relational Language-Image Pre-training for Human-Object Interaction Detection	Sep 5, 2022	Human-Object Interaction DetectionRelation	CodeCode Available	1
RLIPv2: Fast Scaling of Relational Language-Image Pre-training	Aug 18, 2023	Graph GenerationHuman-Object Interaction Detection	CodeCode Available	1
Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction Detection	Jun 13, 2022	Human-Object Interaction DetectionObject	CodeCode Available	1
Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimation	Jun 10, 2021	Egocentric Pose EstimationHuman-Object Interaction Detection	CodeCode Available	1
Spot What Matters: Learning Context Using Graph Convolutional Networks for Weakly-Supervised Action Detection	Jul 28, 2021	Action DetectionHuman-Object Interaction Detection	CodeCode Available	1
Efficient Adaptive Human-Object Interaction Detection with Concept-guided Memory	Sep 7, 2023	Human-Object Interaction DetectionRetrieval	CodeCode Available	1
ConsNet: Learning Consistency Graph for Zero-Shot Human-Object Interaction Detection	Aug 14, 2020	Human-Object Interaction DetectionObject	CodeCode Available	1
Exploring Predicate Visual Context in Detecting Human-Object Interactions	Aug 11, 2023	Human-Object Interaction DetectionObject	CodeCode Available	1
Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise Transformer	Dec 3, 2021	GPUHuman-Object Interaction Detection	CodeCode Available	1
StillFast: An End-to-End Approach for Short-Term Object Interaction Anticipation	Apr 8, 2023	Human-Object Interaction DetectionObject	CodeCode Available	1
Transferable Interactiveness Knowledge for Human-Object Interaction Detection	Nov 20, 2018	Human-Object Interaction DetectionObject	CodeCode Available	1
Unseen No More: Unlocking the Potential of CLIP for Generative Zero-shot HOI Detection	Aug 12, 2024	Human-Object Interaction DetectionZero-Shot Human-Object Interaction Detection	CodeCode Available	1
ViPLO: Vision Transformer based Pose-Conditioned Self-Loop Graph for Human-Object Interaction Detection	Apr 17, 2023	Human-Object Interaction DetectionQuantization	CodeCode Available	1
EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planning	Dec 11, 2023	BenchmarkingHuman-Object Interaction Detection	CodeCode Available	1
Visual-Semantic Graph Attention Networks for Human-Object Interaction Detection	Jan 7, 2020	Graph AttentionHuman-Object Interaction Detection	CodeCode Available	1
Mining Cross-Person Cues for Body-Part Interactiveness Learning in HOI Detection	Jul 28, 2022	Human-Object Interaction Detection	CodeCode Available	1
Zero-Shot Temporal Interaction Localization for Egocentric Videos	Jun 4, 2025	Action LocalizationHuman-Object Interaction Detection	CodeCode Available	1

Show:10 25 50

← PrevPage 5 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified