Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 351–375 of 449 papers

Title	Date	Tasks	Status
PICO: Reconstructing 3D People In Contact with Objects	Jan 1, 2025	Human-Object Interaction DetectionObject	—Unverified
Weakly-supervised HOI Detection via Prior-guided Bi-level Representation Learning	Mar 2, 2023	Human-Object Interaction DetectionKnowledge Distillation	—Unverified
Zero-Shot Human-Object Interaction Synthesis with Multimodal Priors	Mar 25, 2025	DiversityHuman-Object Interaction Detection	—Unverified
Pose2Gaze: Eye-body Coordination during Daily Activities for Gaze Prediction from Full-body Poses	Dec 19, 2023	Activity RecognitionGaze Prediction	—Unverified
Video-based Contrastive Learning on Decision Trees: from Action Recognition to Autism Diagnosis	Apr 20, 2023	Action RecognitionBinary Classification	—Unverified
Pose-Based Two-Stream Relational Networks for Action Recognition in Videos	May 22, 2018	Action RecognitionAction Recognition In Videos	—Unverified
Video-based Human-Object Interaction Detection from Tubelet Tokens	Jun 4, 2022	Human-Object Interaction Detection	—Unverified
Precise Affordance Annotation for Egocentric Action Video Datasets	Jun 11, 2022	Action AnticipationAffordance Recognition	—Unverified
Primitive-based 3D Human-Object Interaction Modelling and Programming	Dec 17, 2023	3D ReconstructionHuman-Object Interaction Detection	—Unverified
A Review of Human-Object Interaction Detection	Aug 20, 2024	Human-Object Interaction DetectionObject	—Unverified
A self-organizing neural network architecture for learning human-object interactions	Oct 5, 2017	Human-Object Interaction DetectionObject	—Unverified
whu-nercms at trecvid2021:instance search task	Oct 30, 2021	Action DetectionFace Detection	—Unverified
Autonomous Character-Scene Interaction Synthesis from Text Instruction	Oct 4, 2024	Human-Object Interaction Detection	—Unverified
Weakly Supervised Learning of Affordances	May 10, 2016	Human-Object Interaction DetectionImage Segmentation	—Unverified
AvatarGO: Zero-shot 4D Human-Object Interaction Generation and Animation	Oct 9, 2024	Human-Object Interaction DetectionHuman-Object Interaction Generation	—Unverified
A Deep Learning Approach to Object Affordance Segmentation	Apr 18, 2020	Deep LearningHuman-Object Interaction Detection	—Unverified
Beyond Holistic Object Recognition: Enriching Image Understanding with Part States	Dec 15, 2016	Human-Object Interaction DetectionImage Captioning	—Unverified
Bi-Causal: Group Activity Recognition via Bidirectional Causality	Jan 1, 2024	Activity RecognitionGroup Activity Recognition	—Unverified
Bilateral Adaptation for Human-Object Interaction Detection with Occlusion-Robustness	Jan 1, 2024	Human-Object Interaction Detectionobject-detection	—Unverified
Reasoning About Human-Object Interactions Through Dual Attention Networks	Sep 10, 2019	Human-Object Interaction DetectionObject	—Unverified
Care about you: towards large-scale human-centric visual relationship detection	May 28, 2017	Human-Object Interaction DetectionRelationship Detection	—Unverified
Reasoning Mamba: Hypergraph-Guided Region Relation Calculating for Weakly Supervised Affordance Grounding	Jan 1, 2025	Human-Object Interaction DetectionMamba	—Unverified
Category-Aware Transformer Network for Better Human-Object Interaction Detection	Apr 11, 2022	Human-Object Interaction DetectionObject	—Unverified
Reconstructing Action-Conditioned Human-Object Interactions Using Commonsense Knowledge Priors	Sep 6, 2022	Human-Object Interaction DetectionObject	—Unverified
CG-HOI: Contact-Guided 3D Human-Object Interaction Generation	Nov 27, 2023	Human-Object Interaction DetectionHuman-Object Interaction Generation	—Unverified

Show:10 25 50

← PrevPage 15 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified