Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 376–400 of 449 papers

Title	Date	Tasks	Status
Visibility Aware Human-Object Interaction Tracking from Single RGB Camera	Mar 29, 2023	3D Human Reconstruction3D Object Reconstruction	—Unverified
Vision-Guided Action: Enhancing 3D Human Motion Prediction with Gaze-informed Affordance in 3D Scenes	Jan 1, 2025	Human motion predictionHuman-Object Interaction Detection	—Unverified
Discovering Human Interactions in Videos with Limited Data Labeling	Feb 12, 2015	ClusteringHuman-Object Interaction Detection	—Unverified
Discovering Human Interactions With Large-Vocabulary Objects via Query and Multi-Scale Detection	Jan 1, 2021	Human-Object Interaction DetectionObject	—Unverified
RobustFusion: Robust Volumetric Performance Reconstruction under Human-object Interactions from Monocular RGBD Stream	Apr 30, 2021	4D reconstructionDisentanglement	—Unverified
Discovering Syntactic Interaction Clues for Human-Object Interaction Detection	Jan 1, 2024	DecoderHuman-Object Interaction Detection	—Unverified
Disentangled Interaction Representation for One-Stage Human-Object Interaction Detection	Dec 4, 2023	DecoderHuman-Object Interaction Detection	—Unverified
RR-Net: Injecting Interactive Semantics in Human-Object Interaction Detection	Apr 30, 2021	Human-Object Interaction DetectionRelation	—Unverified
SAVCHOI: Detecting Suspicious Activities using Dense Video Captioning with Human Object Interactions	Jul 24, 2022	Dense CaptioningDense Video Captioning	—Unverified
Distillation of Human-Object Interaction Contexts for Action Recognition	Dec 17, 2021	Action RecognitionGraph Attention	—Unverified
Distillation Using Oracle Queries for Transformer-Based Human-Object Interaction Detection	Jan 1, 2022	Data AugmentationDecoder	—Unverified
Do Deep Neural Networks Model Nonlinear Compositionality in the Neural Representation of Human-Object Interactions?	Mar 31, 2019	Human-Object Interaction DetectionObject	—Unverified
DPMix: Mixture of Depth and Point Cloud Video Experts for 4D Action Segmentation	Jul 31, 2023	Action SegmentationHuman-Object Interaction Detection	—Unverified
DreamHOI: Subject-Driven Generation of 3D Human-Object Interactions with Diffusion Priors	Sep 12, 2024	Human-Object Interaction DetectionNeRF	—Unverified
Self-Selective Context for Interaction Recognition	Oct 17, 2020	Human-Object Interaction DetectionObject	—Unverified
DropKey	Aug 4, 2022	Human-Object Interaction Detectionimage-classification	—Unverified
DropKey for Vision Transformer	Jan 1, 2023	Human-Object Interaction Detectionimage-classification	—Unverified
Dynamic Scene Understanding from Vision-Language Representations	Jan 20, 2025	Grounded Situation RecognitionHuman-Human Interaction Recognition	—Unverified
Semantics to Space(S2S): Embedding semantics into spatial space for zero-shot verb-object query inferencing	Jun 13, 2019	Human-Object Interaction DetectionZero-Shot Learning	—Unverified
Effective Actor-centric Human-object Interaction Detection	Feb 24, 2022	Human-Object Interaction DetectionObject	—Unverified
Visual Relationship Detection Using Part-and-Sum Transformers with Composite Queries	May 5, 2021	Human-Object Interaction DetectionObject	—Unverified
Efficient Human-Object-Interaction (EHOI) Detection via Interaction Label Coding and Conditional Decision	Aug 13, 2024	Decision MakingHuman-Object Interaction Detection	—Unverified
3D-AffordanceLLM: Harnessing Large Language Models for Open-Vocabulary Affordance Detection in 3D Worlds	Feb 27, 2025	Affordance DetectionHuman-Object Interaction Detection	—Unverified
Egocentric Human-Object Interaction Detection: A New Benchmark and Method	Jun 17, 2025	BenchmarkingHuman-Object Interaction Detection	—Unverified
EgoChoir: Capturing 3D Human-Object Interaction Regions from Egocentric Views	May 22, 2024	Human-Object Interaction DetectionObject	—Unverified

Show:10 25 50

← PrevPage 16 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified