SOTAVerified

Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 251–300 of 449 papers

TitleStatusHype
HOIAnimator: Generating Text-prompt Human-object Animations using Novel Perceptive Diffusion Models—0
HOI-M^3: Capture Multiple Humans and Objects Interaction within Contextual Environment—0
Bilateral Adaptation for Human-Object Interaction Detection with Occlusion-Robustness—0
Learning from Observer Gaze: Zero-Shot Attention Prediction Oriented by Human-Object Interaction Recognition—0
Pose2Gaze: Eye-body Coordination during Daily Activities for Gaze Prediction from Full-body Poses—0
UnionDet: Union-Level Detector Towards Real-Time Human-Object Interaction Detection—0
Few-Shot Learning from Augmented Label-Uncertain Queries in Bongard-HOI—0
Primitive-based 3D Human-Object Interaction Modelling and Programming—0
LEMON: Learning 3D Human-Object Interaction Relation from 2D Images—0
Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation—0
HOI-Diff: Text-Driven Synthesis of 3D Human-Object Interactions using Diffusion Models—0
I'M HOI: Inertia-aware Monocular Capture of 3D Human-Object Interactions—0
PhysHOI: Physics-Based Imitation of Dynamic Human-Object Interaction—0
Controllable Human-Object Interaction Synthesis—0
Disentangled Interaction Representation for One-Stage Human-Object Interaction Detection—0
HandyPriors: Physically Consistent Perception of Hand-Object Interactions with Differentiable Priors—0
CG-HOI: Contact-Guided 3D Human-Object Interaction Generation—0
Generating Human-Centric Visual Cues for Human-Object Interaction Detection via Large Vision-Language Models—0
Towards a Unified Transformer-based Framework for Scene Graph Generation and Human-object Interaction Detection—0
Object-centric Video Representation for Long-term Action AnticipationCode0
Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Models—0
Object Motion Guided Human Motion Synthesis—0
HOI4ABOT: Human-Object Interaction Anticipation for Human Intention Reading Collaborative roBOTs—0
ENIGMA-51: Towards a Fine-Grained Understanding of Human-Object Interactions in Industrial Scenarios—0
Detection and Localization of Firearm Carriers in Complex Scenes for Improved Safety Measures—0
Physically Plausible Full-Body Hand-Object Interaction Synthesis—0
Exploiting CLIP for Zero-shot HOI Detection Requires Knowledge Distillation at Multiple LevelsCode0
CHORUS: Learning Canonicalized 3D Human-Object Spatial Relations from Unbounded Synthesized Images—0
HODN: Disentangling Human-Object Feature for HOI Detection—0
Leveraging Next-Active Objects for Context-Aware Anticipation in Egocentric Videos—0
Agglomerative Transformer for Human-Object Interaction Detection—0
Compositional Learning in Transformer-Based Human-Object Interaction Detection—0
Improving Human-Object Interaction Detection via Virtual Image Learning—0
DPMix: Mixture of Depth and Point Cloud Video Experts for 4D Action Segmentation—0
Re-mine, Learn and Reason: Exploring the Cross-modal Semantic Correlations for Language-guided HOI detection—0
Persistent-Transient Duality: A Multi-mechanism Approach for Modeling Human-Object Interaction—0
Mining Conditional Part Semantics with Occluded Extrapolation for Human-Object Interaction Detection—0
Focusing on what to decode and what to train: SOV Decoding with Specific Target Guided DeNoising and Vision Language AdvisorCode0
HOKEM: Human and Object Keypoint-based Extension Module for Human-Object Interaction Detection—0
Exploiting Multimodal Synthetic Data for Egocentric Human-Object Interaction Detection in an Industrial ScenarioCode0
An Abstract Specification of VoxML as an Annotation Language—0
Synthesizing Diverse Human Motions in 3D Indoor Scenes—0
HICO-DET-SG and V-COCO-SG: New Data Splits for Evaluating the Systematic Generalization Performance of Human-Object Interaction Detection ModelsCode0
Group Activity Recognition via Dynamic Composition and Interaction—0
Modelling Spatio-Temporal Interactions for Compositional Action Recognition—0
Compositional 3D Human-Object Neural Animation—0
HOSNeRF: Dynamic Human-Object-Scene Neural Radiance Fields from a Single Video—0
Video-based Contrastive Learning on Decision Trees: from Action Recognition to Autism Diagnosis—0
Instant-NVR: Instant Neural Volumetric Rendering for Human-object Interactions from Monocular RGBD Stream—0
Visibility Aware Human-Object Interaction Tracking from Single RGB Camera—0
Show:102550
← PrevPage 6 of 9Next →
All datasetsHICO-DETV-COCOHICOVidHOIAmbiguious-HOIMECCANO

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Ours (PViC+)mAP46.49—Unverified
2RLIPv2 (Swin-L)mAP45.09—Unverified
3PViC-SwinLmAP44.32—Unverified
4SOV-STG (Swin-L)mAP43.35—Unverified
5DiffHOImAP41.5—Unverified
6ViPLOmAP37.22—Unverified
7FGAHOImAP37.18—Unverified
8ERNetmAP36.89—Unverified
9CQL+GEN-VLKT-LmAP36.03—Unverified
10QAHOI (Swin-L)mAP35.78—Unverified
#ModelMetricClaimedVerifiedStatus
1RLIPv2AP(S1)72.1—Unverified
2MURENAP(S1)68.8—Unverified
3STIPAP(S1)66—Unverified
4DiffHOIAP(S1)65.7—Unverified
5OCN (ResNet101)AP(S1)65.3—Unverified
6OCN (ResNet50)AP(S1)64.2—Unverified
7CDN (ResNet101)AP(S1)63.91—Unverified
8HOICLIPAP(S1)63.5—Unverified
9QPIC + CPCMAP63.1—Unverified
10Body Part InteractivenessAP(S1)63—Unverified
#ModelMetricClaimedVerifiedStatus
1DEFRmAP65.6—Unverified
2HAKEmAP47.1—Unverified
3PaStaNetmAP46.3—Unverified
4RelViTmAP43.98—Unverified
5Pairwise-PartmAP39.9—Unverified
6Mallya & LazebnikmAP36.1—Unverified
7Girdhar & RamananmAP34.6—Unverified
8R*CNNmAP28.5—Unverified
#ModelMetricClaimedVerifiedStatus
1HOI4ABOTDetection: Full (mAP@0.5)11.12—Unverified
2ST-GAZEDetection: Full (mAP@0.5)10.4—Unverified
3STTRANDetection: Full (mAP@0.5)7.61—Unverified
#ModelMetricClaimedVerifiedStatus
1DJ-RNmAP10.37—Unverified
2iCANmAP8.14—Unverified
#ModelMetricClaimedVerifiedStatus
1SlowFast + FasterRCNNmAP@0.5 role25.93—Unverified