Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 76–100 of 449 papers

Title	Date	Tasks	Status	Hype
AnchorCrafter: Animate CyberAnchors Saling Your Products via Human-Object Interacting Video Generation	Nov 26, 2024	Human-Object Interaction DetectionObject	—Unverified	0
VioPose: Violin Performance 4D Pose Estimation by Hierarchical Audiovisual Inference	Nov 19, 2024	Human-Object Interaction DetectionPose Estimation	CodeCode Available	0
GLOVER: Generalizable Open-Vocabulary Affordance Reasoning for Task-Oriented Grasping	Nov 19, 2024	Common Sense ReasoningHuman-Object Interaction Detection	—Unverified	0
EZ-HOI: VLM Adaptation via Guided Prompt Learning for Zero-Shot HOI Detection	Oct 31, 2024	Human-Object Interaction DetectionLarge Language Model	CodeCode Available	1
Human-Object Interaction Detection Collaborated with Large Relation-driven Diffusion Models	Oct 26, 2024	Contrastive LearningHuman-Object Interaction Detection	—Unverified	0
CL-HOI: Cross-Level Human-Object Interaction Distillation from Vision Large Language Models	Oct 21, 2024	Human-Object Interaction Detection	—Unverified	0
GraspDiffusion: Synthesizing Realistic Whole-body Hand-Object Interaction	Oct 17, 2024	Human-Object Interaction DetectionImage Generation	—Unverified	0
Visual-Geometric Collaborative Guidance for Affordance Learning	Oct 15, 2024	Human-Object Interaction DetectionObject	CodeCode Available	0
3DArticCyclists: Generating Synthetic Articulated 8D Pose-Controllable Cyclist Data for Computer Vision Applications	Oct 14, 2024	3DGS3D Reconstruction	—Unverified	0
Understanding Spatio-Temporal Relations in Human-Object Interaction using Pyramid Graph Convolutional Network	Oct 10, 2024	Action RecognitionAction Segmentation	—Unverified	0
AvatarGO: Zero-shot 4D Human-Object Interaction Generation and Animation	Oct 9, 2024	Human-Object Interaction DetectionHuman-Object Interaction Generation	—Unverified	0
Autonomous Character-Scene Interaction Synthesis from Text Instruction	Oct 4, 2024	Human-Object Interaction Detection	—Unverified	0
Space-time 2D Gaussian Splatting for Accurate Surface Reconstruction under Complex Dynamic Scenes	Sep 27, 2024	Human-Object Interaction DetectionSurface Reconstruction	CodeCode Available	2
A Comprehensive Methodological Survey of Human Activity Recognition Across Divers Data Modalities	Sep 15, 2024	Action DetectionActivity Detection	—Unverified	0
DreamHOI: Subject-Driven Generation of 3D Human-Object Interactions with Diffusion Priors	Sep 12, 2024	Human-Object Interaction DetectionNeRF	—Unverified	0
InterTrack: Tracking Human Object Interaction without Object Templates	Aug 25, 2024	Human-Object Interaction DetectionObject	—Unverified	0
Learning 2D Invariant Affordance Knowledge for 3D Affordance Grounding	Aug 23, 2024	Human-Object Interaction DetectionObject	—Unverified	0
A Review of Human-Object Interaction Detection	Aug 20, 2024	Human-Object Interaction DetectionObject	—Unverified	0
Towards Flexible Visual Relationship Segmentation	Aug 15, 2024	Graph GenerationHuman-Object Interaction Detection	—Unverified	0
UAHOI: Uncertainty-aware Robust Interaction Learning for HOI Detection	Aug 14, 2024	Human-Object Interaction Detection	—Unverified	0
Efficient Human-Object-Interaction (EHOI) Detection via Interaction Label Coding and Conditional Decision	Aug 13, 2024	Decision MakingHuman-Object Interaction Detection	—Unverified	0
SkillMimic: Learning Basketball Interaction Skills from Demonstrations	Aug 12, 2024	DiversityHuman-Object Interaction Detection	CodeCode Available	3
Unseen No More: Unlocking the Potential of CLIP for Generative Zero-shot HOI Detection	Aug 12, 2024	Human-Object Interaction DetectionZero-Shot Human-Object Interaction Detection	CodeCode Available	1
An analysis of HOI: using a training-free method with multimodal visual foundation models when only the test set is available, without the training set	Aug 11, 2024	Human-Object Interaction Detection	—Unverified	0
Exploring Conditional Multi-Modal Prompts for Zero-shot HOI Detection	Aug 5, 2024	Human-Object Interaction DetectionPrompt Learning	CodeCode Available	1

Show:10 25 50

← PrevPage 4 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified