Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 351–375 of 449 papers

Title	Date	Tasks	Status
Distillation Using Oracle Queries for Transformer-Based Human-Object Interaction Detection	Jan 1, 2022	Data AugmentationDecoder	—Unverified
Complex Video Action Reasoning via Learnable Markov Logic Network	Jan 1, 2022	Action RecognitionHuman-Object Interaction Detection	—Unverified
Expansion-Squeeze-Excitation Fusion Network for Elderly Activity Recognition	Dec 21, 2021	Action RecognitionActivity Recognition	—Unverified
Distillation of Human-Object Interaction Contexts for Action Recognition	Dec 17, 2021	Action RecognitionGraph Attention	—Unverified
Improving Human-Object Interaction Detection via Phrase Learning and Label Composition	Dec 14, 2021	Human-Object Interaction DetectionScene Understanding	—Unverified
The Overlooked Classifier in Human-Object Interaction Recognition	Dec 13, 2021	ClassificationHuman-Object Interaction Detection	—Unverified
DemoGrasp: Few-Shot Learning for Robotic Grasping with Human Demonstration	Dec 6, 2021	Few-Shot LearningHuman-Object Interaction Detection	—Unverified
Human-Object Interaction Detection via Weak Supervision	Dec 1, 2021	Human-Object Interaction DetectionObject	—Unverified
Estimating 3D Motion and Forces of Human-Object Interactions from Internet Videos	Nov 2, 2021	Human-Object Interaction DetectionObject	—Unverified
whu-nercms at trecvid2021:instance search task	Oct 30, 2021	Action DetectionFace Detection	—Unverified
Is First Person Vision Challenging for Object Tracking?	Aug 31, 2021	Human-Object Interaction DetectionObject	—Unverified
Spatio-Temporal Interaction Graph Parsing Networks for Human-Object Interaction Recognition	Aug 19, 2021	Human-Object Interaction DetectionObject	—Unverified
Gravity-Aware Monocular 3D Human-Object Reconstruction	Aug 19, 2021	Human-Object Interaction DetectionObject	—Unverified
Neural Free-Viewpoint Performance Rendering under Complex Human-object Interactions	Aug 1, 2021	4D reconstructionDynamic Reconstruction	—Unverified
Is Object Detection Necessary for Human-Object Interaction Recognition?	Jul 27, 2021	Human-Object Interaction DetectionObject	—Unverified
Hierarchical Video Prediction Using Relational Layouts for Human-Object Interactions	Jun 19, 2021	Human-Object Interaction DetectionObject	—Unverified
Contextual Guided Segmentation Framework for Semi-supervised Video Instance Segmentation	Jun 7, 2021	Human-Object Interaction DetectionInstance Segmentation	—Unverified
SHD360: A Benchmark Dataset for Salient Human Detection in 360° Videos	May 24, 2021	Human DetectionHuman-Object Interaction Detection	CodeCode Available
Human Object Interaction Detection using Two-Direction Spatial Enhancement and Exclusive Object Prior	May 7, 2021	Human-Object Interaction DetectionObject	—Unverified
Visual Relationship Detection Using Part-and-Sum Transformers with Composite Queries	May 5, 2021	Human-Object Interaction DetectionObject	—Unverified
RobustFusion: Robust Volumetric Performance Reconstruction under Human-object Interactions from Monocular RGBD Stream	Apr 30, 2021	4D reconstructionDisentanglement	—Unverified
RR-Net: Injecting Interactive Semantics in Human-Object Interaction Detection	Apr 30, 2021	Human-Object Interaction DetectionRelation	—Unverified
TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wild	Apr 8, 2021	Autonomous DrivingHuman-Object Interaction Detection	—Unverified
Learning Asynchronous and Sparse Human-Object Interaction in Videos	Mar 3, 2021	Human-Object Interaction DetectionObject	—Unverified
Discovering Human Interactions With Large-Vocabulary Objects via Query and Multi-Scale Detection	Jan 1, 2021	Human-Object Interaction DetectionObject	—Unverified

Show:10 25 50

← PrevPage 15 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified