Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 276–300 of 449 papers

Title	Date	Tasks	Status
Physically Plausible Full-Body Hand-Object Interaction Synthesis	Sep 14, 2023	Human-Object Interaction DetectionObject	—Unverified
Exploiting CLIP for Zero-shot HOI Detection Requires Knowledge Distillation at Multiple Levels	Sep 10, 2023	Human-Object Interaction DetectionKnowledge Distillation	CodeCode Available
CHORUS: Learning Canonicalized 3D Human-Object Spatial Relations from Unbounded Synthesized Images	Aug 23, 2023	Common Sense ReasoningDiversity	—Unverified
HODN: Disentangling Human-Object Feature for HOI Detection	Aug 20, 2023	DecoderHuman Detection	—Unverified
Leveraging Next-Active Objects for Context-Aware Anticipation in Egocentric Videos	Aug 16, 2023	Action AnticipationActive Object Localization	—Unverified
Agglomerative Transformer for Human-Object Interaction Detection	Aug 16, 2023	ClusteringDecoder	—Unverified
Compositional Learning in Transformer-Based Human-Object Interaction Detection	Aug 11, 2023	Human-Object Interaction DetectionObject	—Unverified
Improving Human-Object Interaction Detection via Virtual Image Learning	Aug 4, 2023	Human-Object Interaction DetectionObject	—Unverified
DPMix: Mixture of Depth and Point Cloud Video Experts for 4D Action Segmentation	Jul 31, 2023	Action SegmentationHuman-Object Interaction Detection	—Unverified
Re-mine, Learn and Reason: Exploring the Cross-modal Semantic Correlations for Language-guided HOI detection	Jul 25, 2023	Human-Object Interaction DetectionSentence	—Unverified
Persistent-Transient Duality: A Multi-mechanism Approach for Modeling Human-Object Interaction	Jul 24, 2023	Graph AttentionHuman-Object Interaction Detection	—Unverified
Mining Conditional Part Semantics with Occluded Extrapolation for Human-Object Interaction Detection	Jul 19, 2023	Human-Object Interaction DetectionObject	—Unverified
Focusing on what to decode and what to train: SOV Decoding with Specific Target Guided DeNoising and Vision Language Advisor	Jul 5, 2023	DecoderDenoising	CodeCode Available
HOKEM: Human and Object Keypoint-based Extension Module for Human-Object Interaction Detection	Jun 25, 2023	Human-Object Interaction DetectionObject	—Unverified
Exploiting Multimodal Synthetic Data for Egocentric Human-Object Interaction Detection in an Industrial Scenario	Jun 21, 2023	Human-Object Interaction Detection	CodeCode Available
An Abstract Specification of VoxML as an Annotation Language	May 22, 2023	Human Agent CollaborationHuman-Object Interaction Detection	—Unverified
Synthesizing Diverse Human Motions in 3D Indoor Scenes	May 21, 2023	Collision AvoidanceHuman-Object Interaction Detection	—Unverified
HICO-DET-SG and V-COCO-SG: New Data Splits for Evaluating the Systematic Generalization Performance of Human-Object Interaction Detection Models	May 17, 2023	Human-Object Interaction DetectionSystematic Generalization	CodeCode Available
Group Activity Recognition via Dynamic Composition and Interaction	May 9, 2023	Activity RecognitionGroup Activity Recognition	—Unverified
Modelling Spatio-Temporal Interactions for Compositional Action Recognition	May 4, 2023	Action RecognitionHuman-Object Interaction Detection	—Unverified
Compositional 3D Human-Object Neural Animation	Apr 27, 2023	Human-Object Interaction DetectionNeRF	—Unverified
HOSNeRF: Dynamic Human-Object-Scene Neural Radiance Fields from a Single Video	Apr 24, 2023	Human-Object Interaction DetectionObject	—Unverified
Video-based Contrastive Learning on Decision Trees: from Action Recognition to Autism Diagnosis	Apr 20, 2023	Action RecognitionBinary Classification	—Unverified
Instant-NVR: Instant Neural Volumetric Rendering for Human-object Interactions from Monocular RGBD Stream	Apr 6, 2023	Human-Object Interaction DetectionNovel View Synthesis	—Unverified
Visibility Aware Human-Object Interaction Tracking from Single RGB Camera	Mar 29, 2023	3D Human Reconstruction3D Object Reconstruction	—Unverified

Show:10 25 50

← PrevPage 12 of 18Next →

All datasets HICO-DET V-COCO HICO VidHOI Ambiguious-HOI MECCANO

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Ours (PViC+)	mAP	46.49	—	Unverified
2	RLIPv2 (Swin-L)	mAP	45.09	—	Unverified
3	PViC-SwinL	mAP	44.32	—	Unverified
4	SOV-STG (Swin-L)	mAP	43.35	—	Unverified
5	DiffHOI	mAP	41.5	—	Unverified
6	ViPLO	mAP	37.22	—	Unverified
7	FGAHOI	mAP	37.18	—	Unverified
8	ERNet	mAP	36.89	—	Unverified
9	CQL+GEN-VLKT-L	mAP	36.03	—	Unverified
10	QAHOI (Swin-L)	mAP	35.78	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RLIPv2	AP(S1)	72.1	—	Unverified
2	MUREN	AP(S1)	68.8	—	Unverified
3	STIP	AP(S1)	66	—	Unverified
4	DiffHOI	AP(S1)	65.7	—	Unverified
5	OCN (ResNet101)	AP(S1)	65.3	—	Unverified
6	OCN (ResNet50)	AP(S1)	64.2	—	Unverified
7	CDN (ResNet101)	AP(S1)	63.91	—	Unverified
8	HOICLIP	AP(S1)	63.5	—	Unverified
9	QPIC + CPC	MAP	63.1	—	Unverified
10	Body Part Interactiveness	AP(S1)	63	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DEFR	mAP	65.6	—	Unverified
2	HAKE	mAP	47.1	—	Unverified
3	PaStaNet	mAP	46.3	—	Unverified
4	RelViT	mAP	43.98	—	Unverified
5	Pairwise-Part	mAP	39.9	—	Unverified
6	Mallya & Lazebnik	mAP	36.1	—	Unverified
7	Girdhar & Ramanan	mAP	34.6	—	Unverified
8	R*CNN	mAP	28.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	HOI4ABOT	Detection: Full (mAP@0.5)	11.12	—	Unverified
2	ST-GAZE	Detection: Full (mAP@0.5)	10.4	—	Unverified
3	STTRAN	Detection: Full (mAP@0.5)	7.61	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DJ-RN	mAP	10.37	—	Unverified
2	iCAN	mAP	8.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SlowFast + FasterRCNN	mAP@0.5 role	25.93	—	Unverified