Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 326–350 of 449 papers

Title	Date	Tasks	Status	Hype
Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimation	Jun 10, 2021	Egocentric Pose EstimationHuman-Object Interaction Detection	CodeCode Available	1
Contextual Guided Segmentation Framework for Semi-supervised Video Instance Segmentation	Jun 7, 2021	Human-Object Interaction DetectionInstance Segmentation	—Unverified	0
ST-HOI: A Spatial-Temporal Baseline for Human-Object Interaction Detection in Videos	May 25, 2021	Action DetectionHuman-Object Interaction Anticipation	CodeCode Available	1
SHD360: A Benchmark Dataset for Salient Human Detection in 360° Videos	May 24, 2021	Human DetectionHuman-Object Interaction Detection	CodeCode Available	0
Human Object Interaction Detection using Two-Direction Spatial Enhancement and Exclusive Object Prior	May 7, 2021	Human-Object Interaction DetectionObject	—Unverified	0
Visual Relationship Detection Using Part-and-Sum Transformers with Composite Queries	May 5, 2021	Human-Object Interaction DetectionObject	—Unverified	0
RobustFusion: Robust Volumetric Performance Reconstruction under Human-object Interactions from Monocular RGBD Stream	Apr 30, 2021	4D reconstructionDisentanglement	—Unverified	0
RR-Net: Injecting Interactive Semantics in Human-Object Interaction Detection	Apr 30, 2021	Human-Object Interaction DetectionRelation	—Unverified	0
HOTR: End-to-End Human-Object Interaction Detection with Transformers	Apr 28, 2021	DecoderHuman-Object Interaction Detection	CodeCode Available	1
Glance and Gaze: Inferring Action-aware Points for One-Stage Human-Object Interaction Detection	Apr 12, 2021	Human-Object Interaction Detection	CodeCode Available	1
TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wild	Apr 8, 2021	Autonomous DrivingHuman-Object Interaction Detection	—Unverified	0
Affordance Transfer Learning for Human-Object Interaction Detection	Apr 7, 2021	Affordance DetectionAffordance Recognition	CodeCode Available	1
Detecting Human-Object Interaction via Fabricated Compositional Learning	Mar 15, 2021	Affordance RecognitionHuman-Object Interaction Detection	CodeCode Available	1
Reformulating HOI Detection as Adaptive Set Prediction	Mar 10, 2021	Human-Object Interaction DetectionPrediction	CodeCode Available	1
QPIC: Query-Based Pairwise Human-Object Interaction Detection with Image-Wide Contextual Information	Mar 9, 2021	Human-Object Interaction Concept DiscoveryHuman-Object Interaction Detection	CodeCode Available	1
End-to-End Human Object Interaction Detection with HOI Transformer	Mar 8, 2021	Human-Object Interaction Detectionobject-detection	CodeCode Available	1
Learning Asynchronous and Sparse Human-Object Interaction in Videos	Mar 3, 2021	Human-Object Interaction DetectionObject	—Unverified	0
In Defense of Scene Graphs for Image Captioning	Feb 9, 2021	Human-Object Interaction DetectionImage Captioning	CodeCode Available	1
Transferable Interactiveness Knowledge for Human-Object Interaction Detection	Jan 25, 2021	Human-Object Interaction DetectionObject	CodeCode Available	1
Interaction Compass: Multi-Label Zero-Shot Learning of Human-Object Interactions via Spatial Relations	Jan 1, 2021	Human-Object Interaction DetectionMulti-label zero-shot learning	CodeCode Available	1
Discovering Human Interactions With Large-Vocabulary Objects via Query and Multi-Scale Detection	Jan 1, 2021	Human-Object Interaction DetectionObject	—Unverified	0
Towards Overcoming False Positives in Visual Relationship Detection	Dec 23, 2020	DecoderGraph Attention	—Unverified	0
LIGHTEN: Learning Interactions with Graph and Hierarchical TEmporal Networks for HOI in videos	Dec 17, 2020	Human-Object Interaction DetectionRelationship Detection	CodeCode Available	1
Spatially Conditioned Graphs for Detecting Human-Object Interactions	Dec 11, 2020	Human-Object Interaction DetectionObject	CodeCode Available	1
Is First Person Vision Challenging for Object Tracking?	Nov 24, 2020	Human-Object Interaction DetectionObject	—Unverified	0

Show:10 25 50

← PrevPage 14 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified