SOTAVerified

Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–200 of 449 papers

TitleStatusHype
Discovering Syntactic Interaction Clues for Human-Object Interaction Detection—0
Exploring Pose-Aware Human-Object Interaction via Hybrid Learning—0
HOIAnimator: Generating Text-prompt Human-object Animations using Novel Perceptive Diffusion Models—0
HOI-M^3: Capture Multiple Humans and Objects Interaction within Contextual Environment—0
Learning from Observer Gaze: Zero-Shot Attention Prediction Oriented by Human-Object Interaction Recognition—0
Person in Place: Generating Associative Skeleton-Guidance Maps for Human-Object Interaction Image EditingCode1
UnionDet: Union-Level Detector Towards Real-Time Human-Object Interaction Detection—0
Pose2Gaze: Eye-body Coordination during Daily Activities for Gaze Prediction from Full-body Poses—0
Primitive-based 3D Human-Object Interaction Modelling and Programming—0
Few-Shot Learning from Augmented Label-Uncertain Queries in Bongard-HOI—0
Ins-HOI: Instance Aware Human-Object Interactions RecoveryCode1
LEMON: Learning 3D Human-Object Interaction Relation from 2D Images—0
Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation—0
EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level PlanningCode1
HOI-Diff: Text-Driven Synthesis of 3D Human-Object Interactions using Diffusion Models—0
I'M HOI: Inertia-aware Monocular Capture of 3D Human-Object Interactions—0
Instance Tracking in 3D Scenes from Egocentric VideosCode1
PhysHOI: Physics-Based Imitation of Dynamic Human-Object Interaction—0
Controllable Human-Object Interaction Synthesis—0
Disentangled Interaction Representation for One-Stage Human-Object Interaction Detection—0
HandyPriors: Physically Consistent Perception of Hand-Object Interactions with Differentiable Priors—0
CG-HOI: Contact-Guided 3D Human-Object Interaction Generation—0
Generating Human-Centric Visual Cues for Human-Object Interaction Detection via Large Vision-Language Models—0
Neural-Logic Human-Object Interaction DetectionCode1
Detecting Any Human-Object Interaction Relationship: Universal HOI Detector with Spatial Prompt Learning on Foundation ModelsCode1
Towards a Unified Transformer-based Framework for Scene Graph Generation and Human-object Interaction Detection—0
Object-centric Video Representation for Long-term Action AnticipationCode0
Open-Set Image Tagging with Multi-Grained Text SupervisionCode4
Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Models—0
HOI4ABOT: Human-Object Interaction Anticipation for Human Intention Reading Collaborative roBOTs—0
Object Motion Guided Human Motion Synthesis—0
DECO: Dense Estimation of 3D Human-Scene Contact In The WildCode1
ENIGMA-51: Towards a Fine-Grained Understanding of Human-Object Interactions in Industrial ScenariosCode0
Detection and Localization of Firearm Carriers in Complex Scenes for Improved Safety Measures—0
Physically Plausible Full-Body Hand-Object Interaction Synthesis—0
Exploiting CLIP for Zero-shot HOI Detection Requires Knowledge Distillation at Multiple LevelsCode0
Efficient Adaptive Human-Object Interaction Detection with Concept-guided MemoryCode1
InterDiff: Generating 3D Human-Object Interactions with Physics-Informed DiffusionCode2
CHORUS: Learning Canonicalized 3D Human-Object Spatial Relations from Unbounded Synthesized Images—0
HODN: Disentangling Human-Object Feature for HOI Detection—0
RLIPv2: Fast Scaling of Relational Language-Image Pre-trainingCode1
Diagnosing Human-object Interaction DetectorsCode1
Agglomerative Transformer for Human-Object Interaction Detection—0
Leveraging Next-Active Objects for Context-Aware Anticipation in Egocentric Videos—0
Compositional Learning in Transformer-Based Human-Object Interaction Detection—0
Exploring Predicate Visual Context in Detecting Human-Object InteractionsCode1
Improving Human-Object Interaction Detection via Virtual Image Learning—0
DPMix: Mixture of Depth and Point Cloud Video Experts for 4D Action Segmentation—0
Re-mine, Learn and Reason: Exploring the Cross-modal Semantic Correlations for Language-guided HOI detection—0
Persistent-Transient Duality: A Multi-mechanism Approach for Modeling Human-Object Interaction—0
Show:102550
← PrevPage 4 of 9Next →
All datasetsHICO-DETV-COCOHICOVidHOIAmbiguious-HOIMECCANO

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Ours (PViC+)mAP46.49—Unverified
2RLIPv2 (Swin-L)mAP45.09—Unverified
3PViC-SwinLmAP44.32—Unverified
4SOV-STG (Swin-L)mAP43.35—Unverified
5DiffHOImAP41.5—Unverified
6ViPLOmAP37.22—Unverified
7FGAHOImAP37.18—Unverified
8ERNetmAP36.89—Unverified
9CQL+GEN-VLKT-LmAP36.03—Unverified
10QAHOI (Swin-L)mAP35.78—Unverified
#ModelMetricClaimedVerifiedStatus
1RLIPv2AP(S1)72.1—Unverified
2MURENAP(S1)68.8—Unverified
3STIPAP(S1)66—Unverified
4DiffHOIAP(S1)65.7—Unverified
5OCN (ResNet101)AP(S1)65.3—Unverified
6OCN (ResNet50)AP(S1)64.2—Unverified
7CDN (ResNet101)AP(S1)63.91—Unverified
8HOICLIPAP(S1)63.5—Unverified
9QPIC + CPCMAP63.1—Unverified
10Body Part InteractivenessAP(S1)63—Unverified
#ModelMetricClaimedVerifiedStatus
1DEFRmAP65.6—Unverified
2HAKEmAP47.1—Unverified
3PaStaNetmAP46.3—Unverified
4RelViTmAP43.98—Unverified
5Pairwise-PartmAP39.9—Unverified
6Mallya & LazebnikmAP36.1—Unverified
7Girdhar & RamananmAP34.6—Unverified
8R*CNNmAP28.5—Unverified
#ModelMetricClaimedVerifiedStatus
1HOI4ABOTDetection: Full (mAP@0.5)11.12—Unverified
2ST-GAZEDetection: Full (mAP@0.5)10.4—Unverified
3STTRANDetection: Full (mAP@0.5)7.61—Unverified
#ModelMetricClaimedVerifiedStatus
1DJ-RNmAP10.37—Unverified
2iCANmAP8.14—Unverified
#ModelMetricClaimedVerifiedStatus
1SlowFast + FasterRCNNmAP@0.5 role25.93—Unverified