Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 151–175 of 449 papers

Title	Date	Tasks	Status
DreamHOI: Subject-Driven Generation of 3D Human-Object Interactions with Diffusion Priors	Sep 12, 2024	Human-Object Interaction DetectionNeRF	—Unverified
Compositional 3D Human-Object Neural Animation	Apr 27, 2023	Human-Object Interaction DetectionNeRF	—Unverified
DPMix: Mixture of Depth and Point Cloud Video Experts for 4D Action Segmentation	Jul 31, 2023	Action SegmentationHuman-Object Interaction Detection	—Unverified
Do Deep Neural Networks Model Nonlinear Compositionality in the Neural Representation of Human-Object Interactions?	Mar 31, 2019	Human-Object Interaction DetectionObject	—Unverified
Complex Video Action Reasoning via Learnable Markov Logic Network	Jan 1, 2022	Action RecognitionHuman-Object Interaction Detection	—Unverified
Distillation Using Oracle Queries for Transformer-Based Human-Object Interaction Detection	Jan 1, 2022	Data AugmentationDecoder	—Unverified
Distillation of Human-Object Interaction Contexts for Action Recognition	Dec 17, 2021	Action RecognitionGraph Attention	—Unverified
AvatarGO: Zero-shot 4D Human-Object Interaction Generation and Animation	Oct 9, 2024	Human-Object Interaction DetectionHuman-Object Interaction Generation	—Unverified
An Abstract Specification of VoxML as an Annotation Language	May 22, 2023	Human Agent CollaborationHuman-Object Interaction Detection	—Unverified
Amplifying Key Cues for Human-Object-Interaction Detection	Aug 1, 2020	Human-Object Interaction DetectionObject	—Unverified
COBE: Contextualized Object Embeddings from Narrated Instructional Video	Jul 14, 2020	Human-Object Interaction DetectionObject	—Unverified
CL-HOI: Cross-Level Human-Object Interaction Distillation from Vision Large Language Models	Oct 21, 2024	Human-Object Interaction Detection	—Unverified
Disentangled Interaction Representation for One-Stage Human-Object Interaction Detection	Dec 4, 2023	DecoderHuman-Object Interaction Detection	—Unverified
Autonomous Character-Scene Interaction Synthesis from Text Instruction	Oct 4, 2024	Human-Object Interaction Detection	—Unverified
Discovering Syntactic Interaction Clues for Human-Object Interaction Detection	Jan 1, 2024	DecoderHuman-Object Interaction Detection	—Unverified
Classifying All Interacting Pairs in a Single Shot	Jan 13, 2020	AllHuman-Object Interaction Detection	—Unverified
Discovering Human Interactions With Large-Vocabulary Objects via Query and Multi-Scale Detection	Jan 1, 2021	Human-Object Interaction DetectionObject	—Unverified
CinePile: A Long Video Question Answering Dataset and Benchmark	May 14, 2024	FormHuman-Object Interaction Detection	—Unverified
HIMO: A New Benchmark for Full-Body Human Interacting with Multiple Objects	Jul 17, 2024	BenchmarkingHuman-Object Interaction Detection	—Unverified
HODN: Disentangling Human-Object Feature for HOI Detection	Aug 20, 2023	DecoderHuman Detection	—Unverified
HOIAnimator: Generating Text-prompt Human-object Animations using Novel Perceptive Diffusion Models	Jan 1, 2024	DenoisingHuman-Object Interaction Detection	—Unverified
Discovering Human Interactions in Videos with Limited Data Labeling	Feb 12, 2015	ClusteringHuman-Object Interaction Detection	—Unverified
CHORUS : Learning Canonicalized 3D Human-Object Spatial Relations from Unbounded Synthesized Images	Jan 1, 2023	Common Sense ReasoningDiversity	—Unverified
Diffgrasp: Whole-Body Grasping Synthesis Guided by Object Motion Using a Diffusion Model	Dec 30, 2024	Human-Object Interaction Detection	—Unverified
CHORUS: Learning Canonicalized 3D Human-Object Spatial Relations from Unbounded Synthesized Images	Aug 23, 2023	Common Sense ReasoningDiversity	—Unverified

Show:10 25 50

← PrevPage 7 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified