Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 376–400 of 449 papers

Title	Date	Tasks	Status
Towards Overcoming False Positives in Visual Relationship Detection	Dec 23, 2020	DecoderGraph Attention	—Unverified
Is First Person Vision Challenging for Object Tracking?	Nov 24, 2020	Human-Object Interaction DetectionObject	—Unverified
Detecting Human-Object Interaction with Mixed Supervision	Nov 10, 2020	Human-Object Interaction DetectionObject	—Unverified
Kinematics-Guided Reinforcement Learning for Object-Aware 3D Ego-Pose Estimation	Nov 10, 2020	Human-Object Interaction DetectionObject	—Unverified
Contextual Heterogeneous Graph Network for Human-Object Interaction Detection	Oct 20, 2020	Graph AttentionHuman-Object Interaction Detection	—Unverified
Self-Selective Context for Interaction Recognition	Oct 17, 2020	Human-Object Interaction DetectionObject	—Unverified
DecAug: Augmenting HOI Detection via Decomposition	Oct 2, 2020	Data AugmentationDomain Generalization	—Unverified
Zero-Shot Human-Object Interaction Recognition via Affordance Graphs	Sep 2, 2020	Human-Object Interaction Detection	—Unverified
Rb-PaStaNet: A Few-Shot Human-Object Interaction Detection Based on Rules and Part States	Aug 14, 2020	Human-Object Interaction Detection	CodeCode Available
Amplifying Key Cues for Human-Object-Interaction Detection	Aug 1, 2020	Human-Object Interaction DetectionObject	—Unverified
COBE: Contextualized Object Embeddings from Narrated Instructional Video	Jul 14, 2020	Human-Object Interaction DetectionObject	—Unverified
A Graph-based Interactive Reasoning for Human-Object Interaction Detection	Jul 14, 2020	Human-Object Interaction Detection	—Unverified
Joint Hand-object 3D Reconstruction from a Single Image with Cross-branch Feature Fusion	Jun 28, 2020	3D ReconstructionDepth Estimation	—Unverified
Diagnosing Rarity in Human-Object Interaction Detection	Jun 10, 2020	Human-Object Interaction DetectionObject	—Unverified
Object-Occluded Human Shape and Pose Estimation From a Single Color Image	Jun 1, 2020	3D Human Pose Estimation3D Human Shape Estimation	—Unverified
Novel Human-Object Interaction Detection via Adversarial Domain Generalization	May 22, 2020	Domain GeneralizationHuman-Object Interaction Detection	—Unverified
Localizing Firearm Carriers by Identifying Human-Object Pairs	May 19, 2020	Human-Object Interaction DetectionObject	—Unverified
A Deep Learning Approach to Object Affordance Segmentation	Apr 18, 2020	Deep LearningHuman-Object Interaction Detection	—Unverified
Spatial Priming for Detecting Human-Object Interactions	Apr 9, 2020	Human-Object Interaction DetectionObject	—Unverified
GID-Net: Detecting Human-Object Interaction with Global and Instance Dependency	Mar 11, 2020	Human-Object Interaction DetectionObject	—Unverified
TPPO: A Novel Trajectory Predictor with Pseudo Oracle	Feb 4, 2020	Autonomous DrivingHuman-Object Interaction Detection	—Unverified
Classifying All Interacting Pairs in a Single Shot	Jan 13, 2020	AllHuman-Object Interaction Detection	—Unverified
PPDM: Parallel Point Detection and Matching for Real-time Human-Object Interaction Detection	Dec 30, 2019	GPUHuman-Object Interaction Detection	CodeCode Available
Generating Videos of Zero-Shot Compositions of Actions and Objects	Dec 5, 2019	Human-Object Interaction DetectionObject	—Unverified
Forecasting Human-Object Interaction: Joint Prediction of Motor Attention and Actions in First Person Video	Nov 25, 2019	Action AnticipationHuman-Object Interaction Detection	CodeCode Available

Show:10 25 50

← PrevPage 16 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified