SOTAVerified

Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 449 papers

TitleStatusHype
End-to-End Human Object Interaction Detection with HOI TransformerCode1
HOI Analysis: Integrating and Decomposing Human-Object InteractionCode1
Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise TransformerCode1
HOTR: End-to-End Human-Object Interaction Detection with TransformersCode1
Learning Human-Object Interaction Detection using Interaction PointsCode1
IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object InteractionsCode1
ConsNet: Learning Consistency Graph for Zero-Shot Human-Object Interaction DetectionCode1
Locality-Aware Zero-Shot Human-Object Interaction DetectionCode1
Learning Affordance Grounding from Exocentric ImagesCode1
Interacted Object Grounding in Spatio-Temporal Human-Object InteractionsCode1
Relational Context Learning for Human-Object Interaction DetectionCode1
RelViT: Concept-guided Vision Transformer for Visual Relational ReasoningCode1
Efficient Adaptive Human-Object Interaction Detection with Concept-guided MemoryCode1
Glance and Gaze: Inferring Action-aware Points for One-Stage Human-Object Interaction DetectionCode1
Learning Continuous Grasping Function with a Dexterous Hand from Human DemonstrationsCode1
Disentangled Pre-training for Human-Object Interaction DetectionCode1
Boosting Human-Object Interaction Detection with Text-to-Image Diffusion ModelCode1
D3D-HOI: Dynamic 3D Human-Object Interactions from VideosCode1
Dynamics-Regulated Kinematic Policy for Egocentric Pose EstimationCode1
DRG: Dual Relation Graph for Human-Object Interaction DetectionCode1
DECO: Dense Estimation of 3D Human-Scene Contact In The WildCode1
Affordance Transfer Learning for Human-Object Interaction DetectionCode1
Cascaded Human-Object Interaction RecognitionCode1
EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level PlanningCode1
Articulated 3D Human-Object Interactions from RGB Videos: An Empirical Analysis of Approaches and ChallengesCode1
End-to-End Zero-Shot HOI Detection via Vision and Language Knowledge DistillationCode1
Detailed 2D-3D Joint Representation for Human-Object InteractionCode1
Category Query Learning for Human-Object Interaction ClassificationCode1
Detecting Any Human-Object Interaction Relationship: Universal HOI Detector with Spatial Prompt Learning on Foundation ModelsCode1
Exploring Predicate Visual Context in Detecting Human-Object InteractionsCode1
Detecting Human-Object Interactions with Action Co-occurrence PriorsCode1
Detecting Human-Object Interactions with Action Co-occurrence PriorsCode1
Detecting Human-Object Interactions with Object-Guided Cross-Modal Calibrated SemanticsCode1
Detecting Human-Object Interaction via Fabricated Compositional LearningCode1
Full-Body Articulated Human-Object InteractionCode1
Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction DetectionCode1
Distance-Aware Occlusion Detection with Focused AttentionCode1
FGAHOI: Fine-Grained Anchors for Human-Object Interaction DetectionCode1
Diagnosing Human-object Interaction DetectorsCode1
First Place Solution to the CVPR'2023 AQTC Challenge: A Function-Interaction Centric Approach with Spatiotemporal Visual-Language AlignmentCode1
Person in Place: Generating Associative Skeleton-Guidance Maps for Human-Object Interaction Image EditingCode1
DIRV: Dense Interaction Region Voting for End-to-End Human-Object Interaction DetectionCode1
Discovering A Variety of Objects in Spatio-Temporal Human-Object InteractionsCode1
From My View to Yours: Ego-Augmented Learning in Large Vision Language Models for Understanding Exocentric Daily Living ActivitiesCode1
ACP++: Action Co-occurrence Priors for Human-Object Interaction DetectionCode1
Discovering Human Interactions With Novel Objects via Zero-Shot LearningCode1
Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object InteractionsCode1
GTNet:Guided Transformer Network for Detecting Human-Object InteractionsCode1
Exploring Conditional Multi-Modal Prompts for Zero-shot HOI DetectionCode1
Explanation-based Weakly-supervised Learning of Visual Relations with Graph NetworksCode1
Show:102550
← PrevPage 2 of 9Next →
All datasetsHICO-DETV-COCOHICOVidHOIAmbiguious-HOIMECCANO

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Ours (PViC+)mAP46.49—Unverified
2RLIPv2 (Swin-L)mAP45.09—Unverified
3PViC-SwinLmAP44.32—Unverified
4SOV-STG (Swin-L)mAP43.35—Unverified
5DiffHOImAP41.5—Unverified
6ViPLOmAP37.22—Unverified
7FGAHOImAP37.18—Unverified
8ERNetmAP36.89—Unverified
9CQL+GEN-VLKT-LmAP36.03—Unverified
10QAHOI (Swin-L)mAP35.78—Unverified
#ModelMetricClaimedVerifiedStatus
1RLIPv2AP(S1)72.1—Unverified
2MURENAP(S1)68.8—Unverified
3STIPAP(S1)66—Unverified
4DiffHOIAP(S1)65.7—Unverified
5OCN (ResNet101)AP(S1)65.3—Unverified
6OCN (ResNet50)AP(S1)64.2—Unverified
7CDN (ResNet101)AP(S1)63.91—Unverified
8HOICLIPAP(S1)63.5—Unverified
9QPIC + CPCMAP63.1—Unverified
10Body Part InteractivenessAP(S1)63—Unverified
#ModelMetricClaimedVerifiedStatus
1DEFRmAP65.6—Unverified
2HAKEmAP47.1—Unverified
3PaStaNetmAP46.3—Unverified
4RelViTmAP43.98—Unverified
5Pairwise-PartmAP39.9—Unverified
6Mallya & LazebnikmAP36.1—Unverified
7Girdhar & RamananmAP34.6—Unverified
8R*CNNmAP28.5—Unverified
#ModelMetricClaimedVerifiedStatus
1HOI4ABOTDetection: Full (mAP@0.5)11.12—Unverified
2ST-GAZEDetection: Full (mAP@0.5)10.4—Unverified
3STTRANDetection: Full (mAP@0.5)7.61—Unverified
#ModelMetricClaimedVerifiedStatus
1DJ-RNmAP10.37—Unverified
2iCANmAP8.14—Unverified
#ModelMetricClaimedVerifiedStatus
1SlowFast + FasterRCNNmAP@0.5 role25.93—Unverified