Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 101–125 of 449 papers

Title	Date	Tasks	Status	Hype
A Plug-and-Play Method for Rare Human-Object Interactions Detection by Bridging Domain Gap	Jul 31, 2024	Human-Object Interaction DetectionImage Reconstruction	CodeCode Available	0
StackFLOW: Monocular Human-Object Reconstruction by Stacked Normalizing Flow with Offset	Jul 30, 2024	Human-Object Interaction DetectionObject	CodeCode Available	1
Monocular Human-Object Reconstruction in the Wild	Jul 30, 2024	DiversityHuman-Object Interaction Detection	CodeCode Available	1
Kinematics-based 3D Human-Object Interaction Reconstruction from Single View	Jul 19, 2024	Human-Object Interaction Detection	—Unverified	0
HIMO: A New Benchmark for Full-Body Human Interacting with Multiple Objects	Jul 17, 2024	BenchmarkingHuman-Object Interaction Detection	—Unverified	0
F-HOI: Toward Fine-grained Semantic-Aligned 3D Human-Object Interactions	Jul 17, 2024	Human-Object Interaction DetectionLanguage Modelling	—Unverified	0
CycleHOI: Improving Human-Object Interaction Detection with Cycle Consistency of Detection and Generation	Jul 16, 2024	Human-Object Interaction Detection	—Unverified	0
NODE-Adapter: Neural Ordinary Differential Equations for Better Vision-Language Reasoning	Jul 11, 2024	Domain GeneralizationHuman-Object Interaction Detection	—Unverified	0
Fine-Grained Multi-View Hand Reconstruction Using Inverse Rendering	Jul 8, 2024	Human-Object Interaction DetectionInverse Rendering	CodeCode Available	0
RAM: Retrieval-Based Affordance Transfer for Generalizable Zero-Shot Robotic Manipulation	Jul 5, 2024	Human-Object Interaction DetectionRetrieval	CodeCode Available	2
HOIMotion: Forecasting Human Motion During Human-Object Interactions Using Egocentric 3D Object Bounding Boxes	Jul 2, 2024	DecoderHuman-Object Interaction Detection	—Unverified	0
From Category to Scenery: An End-to-End Framework for Multi-Person Human-Object Interaction Recognition in Videos	Jul 1, 2024	Human-Object Interaction Detection	—Unverified	0
Learning Granularity-Aware Affordances from Human-Object Interaction for Tool-Based Functional Grasping in Dexterous Robotics	Jun 30, 2024	Human-Object Interaction DetectionObject	CodeCode Available	1
EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splatting	Jun 28, 2024	Human-Object Interaction DetectionObject	—Unverified	0
CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangement	Jun 27, 2024	Human-Object Interaction DetectionHuman-Object Interaction Generation	CodeCode Available	2
Human-Aware 3D Scene Generation with Spatially-constrained Diffusion Models	Jun 26, 2024	Collision AvoidanceHuman-Object Interaction Detection	—Unverified	0
Geometric Features Enhanced Human-Object Interaction Detection	Jun 26, 2024	Human-Object Interaction DetectionObject	CodeCode Available	0
Human-Object Interaction from Human-Level Instructions	Jun 25, 2024	Common Sense ReasoningHuman-Object Interaction Detection	—Unverified	0
CooHOI: Learning Cooperative Human-Object Interaction with Manipulated Object Dynamics	Jun 20, 2024	Human-Object Interaction DetectionHumanoid Control	—Unverified	0
LLAVIDAL: A Large LAnguage VIsion Model for Daily Activities of Living	Jun 13, 2024	BenchmarkingHuman-Object Interaction Detection	—Unverified	0
Open-World Human-Object Interaction Detection via Multi-modal Prompts	Jun 11, 2024	Human-Object Interaction Detection	—Unverified	0
EgoChoir: Capturing 3D Human-Object Interaction Regions from Egocentric Views	May 22, 2024	Human-Object Interaction DetectionObject	—Unverified	0
VirtualModel: Generating Object-ID-retentive Human-object Interaction Image by Diffusion Model for E-commerce Marketing	May 16, 2024	Human-Object Interaction DetectionImage Generation	—Unverified	0
Learning from Observer Gaze:Zero-Shot Attention Prediction Oriented by Human-Object Interaction Recognition	May 16, 2024	Human-Object Interaction Detection	—Unverified	0
CinePile: A Long Video Question Answering Dataset and Benchmark	May 14, 2024	FormHuman-Object Interaction Detection	—Unverified	0

Show:10 25 50

← PrevPage 5 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full ([email protected])	11.12	—	Unverified
2	ST-GAZE	Detection: Full ([email protected])	10.4	—	Unverified
3	STTRAN	Detection: Full ([email protected])	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	[email protected] role	25.93	—	Unverified