Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 26–50 of 449 papers

Title	Date	Tasks	Status	Hype
Learning Granularity-Aware Affordances from Human-Object Interaction for Tool-Based Functional Grasping in Dexterous Robotics	Jun 30, 2024	Human-Object Interaction DetectionObject	CodeCode Available	1
Exploring the Potential of Large Foundation Models for Open-Vocabulary HOI Detection	Apr 9, 2024	Human-Object Interaction DetectionWorld Knowledge	CodeCode Available	1
Disentangled Pre-training for Human-Object Interaction Detection	Apr 2, 2024	Action RecognitionDecoder	CodeCode Available	1
Glance and Focus: Memory Prompting for Multi-Event Video Question Answering	Jan 3, 2024	Action DetectionHuman-Object Interaction Detection	CodeCode Available	1
Person in Place: Generating Associative Skeleton-Guidance Maps for Human-Object Interaction Image Editing	Jan 1, 2024	Human-Object Interaction DetectionObject	CodeCode Available	1
Ins-HOI: Instance Aware Human-Object Interactions Recovery	Dec 15, 2023	DescriptiveDisentanglement	CodeCode Available	1
EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planning	Dec 11, 2023	BenchmarkingHuman-Object Interaction Detection	CodeCode Available	1
Instance Tracking in 3D Scenes from Egocentric Videos	Dec 7, 2023	Human-Object Interaction DetectionObject Tracking	CodeCode Available	1
Neural-Logic Human-Object Interaction Detection	Nov 16, 2023	DecoderHuman-Object Interaction Detection	CodeCode Available	1
Detecting Any Human-Object Interaction Relationship: Universal HOI Detector with Spatial Prompt Learning on Foundation Models	Nov 7, 2023	DecoderHuman-Object Interaction Detection	CodeCode Available	1
DECO: Dense Estimation of 3D Human-Scene Contact In The Wild	Sep 26, 2023	Contact DetectionDense contact estimation	CodeCode Available	1
Efficient Adaptive Human-Object Interaction Detection with Concept-guided Memory	Sep 7, 2023	Human-Object Interaction DetectionRetrieval	CodeCode Available	1
RLIPv2: Fast Scaling of Relational Language-Image Pre-training	Aug 18, 2023	Graph GenerationHuman-Object Interaction Detection	CodeCode Available	1
Diagnosing Human-object Interaction Detectors	Aug 16, 2023	ClassificationHuman-Object Interaction Detection	CodeCode Available	1
Exploring Predicate Visual Context in Detecting Human-Object Interactions	Aug 11, 2023	Human-Object Interaction DetectionObject	CodeCode Available	1
First Place Solution to the CVPR'2023 AQTC Challenge: A Function-Interaction Centric Approach with Spatiotemporal Visual-Language Alignment	Jun 23, 2023	Human-Object Interaction Detection	CodeCode Available	1
Human-Object Interaction Prediction in Videos through Gaze Following	Jun 6, 2023	Human-Object Interaction AnticipationHuman-Object Interaction Detection	CodeCode Available	1
Boosting Human-Object Interaction Detection with Text-to-Image Diffusion Model	May 20, 2023	DiversityHuman-Object Interaction Detection	CodeCode Available	1
What Happened 3 Seconds Ago? Inferring the Past with Thermal Imaging	Apr 26, 2023	Human-Object Interaction DetectionPose Estimation	CodeCode Available	1
ViPLO: Vision Transformer based Pose-Conditioned Self-Loop Graph for Human-Object Interaction Detection	Apr 17, 2023	Human-Object Interaction DetectionQuantization	CodeCode Available	1
Relational Context Learning for Human-Object Interaction Detection	Apr 11, 2023	DecoderHuman-Object Interaction Detection	CodeCode Available	1
StillFast: An End-to-End Approach for Short-Term Object Interaction Anticipation	Apr 8, 2023	Human-Object Interaction DetectionObject	CodeCode Available	1
HOICLIP: Efficient Knowledge Transfer for HOI Detection with Vision-Language Models	Mar 28, 2023	DecoderHuman-Object Interaction Detection	CodeCode Available	1
Category Query Learning for Human-Object Interaction Classification	Mar 24, 2023	ClassificationDecoder	CodeCode Available	1
FGAHOI: Fine-Grained Anchors for Human-Object Interaction Detection	Jan 8, 2023	Human-Object Interaction DetectionObject	CodeCode Available	1

Show:10 25 50

← PrevPage 2 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified