Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 301–325 of 449 papers

Title	Date	Tasks	Status	Hype
Distillation Using Oracle Queries for Transformer-Based Human-Object Interaction Detection	Jan 1, 2022	Data AugmentationDecoder	—Unverified	0
Expansion-Squeeze-Excitation Fusion Network for Elderly Activity Recognition	Dec 21, 2021	Action RecognitionActivity Recognition	—Unverified	0
Distillation of Human-Object Interaction Contexts for Action Recognition	Dec 17, 2021	Action RecognitionGraph Attention	—Unverified	0
QAHOI: Query-Based Anchors for Human-Object Interaction Detection	Dec 16, 2021	Human-Object Interaction DetectionObject	CodeCode Available	1
Improving Human-Object Interaction Detection via Phrase Learning and Label Composition	Dec 14, 2021	Human-Object Interaction DetectionScene Understanding	—Unverified	0
The Overlooked Classifier in Human-Object Interaction Recognition	Dec 13, 2021	ClassificationHuman-Object Interaction Detection	—Unverified	0
DemoGrasp: Few-Shot Learning for Robotic Grasping with Human Demonstration	Dec 6, 2021	Few-Shot LearningHuman-Object Interaction Detection	—Unverified	0
Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise Transformer	Dec 3, 2021	GPUHuman-Object Interaction Detection	CodeCode Available	1
Human-Object Interaction Detection via Weak Supervision	Dec 1, 2021	Human-Object Interaction DetectionObject	—Unverified	0
Estimating 3D Motion and Forces of Human-Object Interactions from Internet Videos	Nov 2, 2021	Human-Object Interaction DetectionObject	—Unverified	0
whu-nercms at trecvid2021:instance search task	Oct 30, 2021	Action DetectionFace Detection	—Unverified	0
Weakly Supervised Human-Object Interaction Detection in Video via Contrastive Spatiotemporal Regions	Oct 7, 2021	Human-Object Interaction DetectionObject	CodeCode Available	1
Virtual Multi-Modality Self-Supervised Foreground Matting for Human-Object Interaction	Oct 7, 2021	DecoderHuman-Object Interaction Detection	CodeCode Available	1
ACP++: Action Co-occurrence Priors for Human-Object Interaction Detection	Sep 9, 2021	Human-Object Interaction Detection	CodeCode Available	1
Is First Person Vision Challenging for Object Tracking?	Aug 31, 2021	Human-Object Interaction DetectionObject	—Unverified	0
Spatio-Temporal Interaction Graph Parsing Networks for Human-Object Interaction Recognition	Aug 19, 2021	Human-Object Interaction DetectionObject	—Unverified	0
Gravity-Aware Monocular 3D Human-Object Reconstruction	Aug 19, 2021	Human-Object Interaction DetectionObject	—Unverified	0
D3D-HOI: Dynamic 3D Human-Object Interactions from Videos	Aug 19, 2021	Human-Object Interaction DetectionObject	CodeCode Available	1
Exploiting Scene Graphs for Human-Object Interaction Detection	Aug 19, 2021	Human-Object Interaction DetectionObject	CodeCode Available	1
Mining the Benefits of Two-stage and One-stage HOI Detection	Aug 11, 2021	ClassificationHuman-Object Interaction Detection	CodeCode Available	1
GTNet:Guided Transformer Network for Detecting Human-Object Interactions	Aug 2, 2021	Human-Object Interaction DetectionObject	CodeCode Available	1
Neural Free-Viewpoint Performance Rendering under Complex Human-object Interactions	Aug 1, 2021	4D reconstructionDynamic Reconstruction	—Unverified	0
Spot What Matters: Learning Context Using Graph Convolutional Networks for Weakly-Supervised Action Detection	Jul 28, 2021	Action DetectionHuman-Object Interaction Detection	CodeCode Available	1
Is Object Detection Necessary for Human-Object Interaction Recognition?	Jul 27, 2021	Human-Object Interaction DetectionObject	—Unverified	0
Hierarchical Video Prediction Using Relational Layouts for Human-Object Interactions	Jun 19, 2021	Human-Object Interaction DetectionObject	—Unverified	0

Show:10 25 50

← PrevPage 13 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified