Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 251–275 of 449 papers

Title	Date	Tasks	Status
HOIAnimator: Generating Text-prompt Human-object Animations using Novel Perceptive Diffusion Models	Jan 1, 2024	DenoisingHuman-Object Interaction Detection	—Unverified
HOI-M^3: Capture Multiple Humans and Objects Interaction within Contextual Environment	Jan 1, 2024	Human-Object Interaction DetectionObject	—Unverified
Bilateral Adaptation for Human-Object Interaction Detection with Occlusion-Robustness	Jan 1, 2024	Human-Object Interaction Detectionobject-detection	—Unverified
Learning from Observer Gaze: Zero-Shot Attention Prediction Oriented by Human-Object Interaction Recognition	Jan 1, 2024	Human-Object Interaction Detection	—Unverified
Pose2Gaze: Eye-body Coordination during Daily Activities for Gaze Prediction from Full-body Poses	Dec 19, 2023	Activity RecognitionGaze Prediction	—Unverified
UnionDet: Union-Level Detector Towards Real-Time Human-Object Interaction Detection	Dec 19, 2023	Human-Object Interaction Detectionobject-detection	—Unverified
Few-Shot Learning from Augmented Label-Uncertain Queries in Bongard-HOI	Dec 17, 2023	DiversityFew-Shot Learning	—Unverified
Primitive-based 3D Human-Object Interaction Modelling and Programming	Dec 17, 2023	3D ReconstructionHuman-Object Interaction Detection	—Unverified
LEMON: Learning 3D Human-Object Interaction Relation from 2D Images	Dec 14, 2023	Human-Object Interaction DetectionObject	—Unverified
Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation	Dec 12, 2023	Human-Object Interaction DetectionObject	—Unverified
HOI-Diff: Text-Driven Synthesis of 3D Human-Object Interactions using Diffusion Models	Dec 11, 2023	Human-Object Interaction DetectionMotion Generation	—Unverified
I'M HOI: Inertia-aware Monocular Capture of 3D Human-Object Interactions	Dec 10, 2023	Human-Object Interaction DetectionObject	—Unverified
PhysHOI: Physics-Based Imitation of Dynamic Human-Object Interaction	Dec 7, 2023	Human-Object Interaction DetectionObject	—Unverified
Controllable Human-Object Interaction Synthesis	Dec 6, 2023	Human-Object Interaction DetectionObject	—Unverified
Disentangled Interaction Representation for One-Stage Human-Object Interaction Detection	Dec 4, 2023	DecoderHuman-Object Interaction Detection	—Unverified
HandyPriors: Physically Consistent Perception of Hand-Object Interactions with Differentiable Priors	Nov 28, 2023	Human-Object Interaction DetectionObject	—Unverified
CG-HOI: Contact-Guided 3D Human-Object Interaction Generation	Nov 27, 2023	Human-Object Interaction DetectionHuman-Object Interaction Generation	—Unverified
Generating Human-Centric Visual Cues for Human-Object Interaction Detection via Large Vision-Language Models	Nov 26, 2023	Human-Object Interaction Detection	—Unverified
Towards a Unified Transformer-based Framework for Scene Graph Generation and Human-object Interaction Detection	Nov 3, 2023	Graph GenerationHuman-Object Interaction Detection	—Unverified
Object-centric Video Representation for Long-term Action Anticipation	Oct 31, 2023	Action AnticipationHuman-Object Interaction Detection	CodeCode Available
Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Models	Oct 3, 2023	DiversityHuman-Object Interaction Detection	—Unverified
Object Motion Guided Human Motion Synthesis	Sep 28, 2023	DenoisingHuman-Object Interaction Detection	—Unverified
HOI4ABOT: Human-Object Interaction Anticipation for Human Intention Reading Collaborative roBOTs	Sep 28, 2023	Human-Object Interaction AnticipationHuman-Object Interaction Detection	—Unverified
ENIGMA-51: Towards a Fine-Grained Understanding of Human-Object Interactions in Industrial Scenarios	Sep 26, 2023	Action DetectionHuman-Object Interaction Detection	—Unverified
Detection and Localization of Firearm Carriers in Complex Scenes for Improved Safety Measures	Sep 17, 2023	Human-Object Interaction Detection	—Unverified

Show:10 25 50

← PrevPage 11 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified