Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 426–449 of 449 papers

Title	Date	Tasks	Status
Simultaneous Joint and Object Trajectory Templates for Human Activity Recognition from 3-D Data	Nov 5, 2017	Activity RecognitionHuman Activity Recognition	—Unverified
Attentional Pooling for Action Recognition	Nov 4, 2017	Action RecognitionHuman-Object Interaction Detection	CodeCode Available
Deep Semantic Abstractions of Everyday Human Activities: On Commonsense Representations of Human Interactions	Oct 10, 2017	Human-Object Interaction DetectionObject	—Unverified
A self-organizing neural network architecture for learning human-object interactions	Oct 5, 2017	Human-Object Interaction DetectionObject	—Unverified
Learning event representation: As sparse as possible, but not sparser	Oct 2, 2017	ClassificationGeneral Classification	—Unverified
Learning Action Recognition Model From Depth and Skeleton Videos	Oct 1, 2017	Action RecognitionHuman-Object Interaction Detection	—Unverified
Fine-grained Event Learning of Human-Object Interaction with LSTM-CRF	Sep 30, 2017	General ClassificationHuman-Object Interaction Detection	—Unverified
Care about you: towards large-scale human-centric visual relationship detection	May 28, 2017	Human-Object Interaction DetectionRelationship Detection	—Unverified
Detecting and Recognizing Human-Object Interactions	Apr 24, 2017	Human-Object Interaction DetectionObject	—Unverified
Recurrent Models for Situation Recognition	Mar 18, 2017	Grounded Situation RecognitionHuman-Object Interaction Detection	—Unverified
Learning to Detect Human-Object Interactions	Feb 17, 2017	General ClassificationHuman-Object Interaction Detection	—Unverified
Jointly learning heterogeneous features for rgb-d activity recognition	Dec 15, 2016	Activity RecognitionBenchmarking	—Unverified
Beyond Holistic Object Recognition: Enriching Image Understanding with Part States	Dec 15, 2016	Human-Object Interaction DetectionImage Captioning	—Unverified
Human Centred Object Co-Segmentation	Jun 12, 2016	Human-Object Interaction DetectionObject	—Unverified
Low-Cost Scene Modeling using a Density Function Improves Segmentation Performance	May 26, 2016	Human-Object Interaction DetectionObject	—Unverified
Weakly Supervised Learning of Affordances	May 10, 2016	Human-Object Interaction DetectionImage Segmentation	—Unverified
Learning Models for Actions and Person-Object Interactions with Transfer to Question Answering	Apr 16, 2016	General ClassificationHuman-Object Interaction Detection	—Unverified
First Person Action-Object Detection with EgoNet	Mar 15, 2016	Human-Object Interaction DetectionObject	—Unverified
HICO: A Benchmark for Recognizing Human-Object Interactions in Images	Dec 1, 2015	Human-Object Interaction DetectionObject	—Unverified
Interaction Part Mining: A Mid-Level Approach for Fine-Grained Action Recognition	Jun 1, 2015	Action RecognitionFine-grained Action Recognition	—Unverified
Object Modelling with a Handheld RGB-D Camera	May 21, 2015	Human-Object Interaction DetectionObject	—Unverified
Contextual Action Recognition with R*CNN	May 5, 2015	Action RecognitionAttribute	CodeCode Available
Discovering Human Interactions in Videos with Limited Data Labeling	Feb 12, 2015	ClusteringHuman-Object Interaction Detection	—Unverified
TUHOI: Trento Universal Human Object Interaction Dataset	Aug 1, 2014	Human-Object Interaction DetectionObject	—Unverified

Show:10 25 50

← PrevPage 18 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified