SOTAVerified

Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Showing 401449 of 449 papers

TitleStatusHype
EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splatting0
EigenActor: Variant Body-Object Interaction Generation Evolved from Invariant Action Basis Reasoning0
Simultaneous Joint and Object Trajectory Templates for Human Activity Recognition from 3-D Data0
End-to-End HOI Reconstruction Transformer with Graph-based Encoding0
Skeleton-Based Action Recognition with Spatial Reasoning and Temporal Stack Learning0
Enhancing Human-Centered Dynamic Scene Understanding via Multiple LLMs Collaborated Reasoning0
ENIGMA-51: Towards a Fine-Grained Understanding of Human-Object Interactions in Industrial Scenarios0
Estimating 3D Motion and Forces of Human-Object Interactions from Internet Videos0
Expansion-Squeeze-Excitation Fusion Network for Elderly Activity Recognition0
TMHOI: Translational Model for Human-Object Interaction Detection0
A Comprehensive Methodological Survey of Human Activity Recognition Across Divers Data Modalities0
Exploring Interactive Semantic Alignment for Efficient HOI Detection with Vision-language Model0
Exploring Pose-Aware Human-Object Interaction via Hybrid Learning0
3D Human Interaction Generation: A Survey0
Exploring Self- and Cross-Triplet Correlations for Human-Object Interaction Detection0
Exploring State Change Capture of Heterogeneous Backbones @ Ego4D Hands and Objects Challenge 20220
Spatial Parsing and Dynamic Temporal Pooling networks for Human-Object Interaction detection0
Spatial Priming for Detecting Human-Object Interactions0
Eye Gaze as a Signal for Conveying User Attention in Contextual AI Systems0
Few-Shot Learning from Augmented Label-Uncertain Queries in Bongard-HOI0
Spatio-Temporal Interaction Graph Parsing Networks for Human-Object Interaction Recognition0
F-HOI: Toward Fine-grained Semantic-Aligned 3D Human-Object Interactions0
Fine-grained Event Learning of Human-Object Interaction with LSTM-CRF0
First Person Action-Object Detection with EgoNet0
Interaction Replica: Tracking Human-Object Interaction and Scene Changes From Human Motion0
FORCE: Physics-aware Human-object Interaction0
ForcePose: A Deep Learning Approach for Force Calculation Based on Action Recognition Using MediaPipe Pose Estimation Combined with Object Detection0
FreeA: Human-object Interaction Detection using Free Annotation Labels0
From Category to Scenery: An End-to-End Framework for Multi-Person Human-Object Interaction Recognition in Videos0
From Infants to AI: Incorporating Infant-like Learning in Models Boosts Efficiency and Generalization in Learning Social Prediction Tasks0
Visual Object Tracking in First Person Vision0
Functional 3D Scene Synthesis through Human-Scene Optimization0
GASPACHO: Gaussian Splatting for Controllable Humans and Objects0
Generalized Visual Relation Detection with Diffusion Models0
Generating Human-Centric Visual Cues for Human-Object Interaction Detection via Large Vision-Language Models0
Generating Human Interaction Motions in Scenes with Text Control0
What to look at and where: Semantic and Spatial Refined Transformer for detecting human-object interactions0
VLM-HOI: Vision Language Models for Interpretable Human-Object Interaction Analysis0
Geometric Visual Fusion Graph Neural Networks for Multi-Person Human-Object Interaction Recognition in Videos0
GID-Net: Detecting Human-Object Interaction with Global and Instance Dependency0
3DArticCyclists: Generating Synthetic Articulated 8D Pose-Controllable Cyclist Data for Computer Vision Applications0
SyncDiff: Synchronized Motion Diffusion for Multi-Body Human-Object Interaction Synthesis0
GLOVER: Generalizable Open-Vocabulary Affordance Reasoning for Task-Oriented Grasping0
Graphing the Future: Activity and Next Active Object Prediction using Graph-based Activity Representations0
GraspDiffusion: Synthesizing Realistic Whole-body Hand-Object Interaction0
Gravity-Aware Monocular 3D Human-Object Reconstruction0
Synthesizing Diverse Human Motions in 3D Indoor Scenes0
Grounded Human-Object Interaction Hotspots from Video (Extended Abstract)0
Group Activity Recognition via Dynamic Composition and Interaction0
Show:102550
← PrevPage 9 of 9Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Ours (PViC+)mAP46.49Unverified
2RLIPv2 (Swin-L)mAP45.09Unverified
3PViC-SwinLmAP44.32Unverified
4SOV-STG (Swin-L)mAP43.35Unverified
5DiffHOImAP41.5Unverified
6ViPLOmAP37.22Unverified
7FGAHOImAP37.18Unverified
8ERNetmAP36.89Unverified
9CQL+GEN-VLKT-LmAP36.03Unverified
10QAHOI (Swin-L)mAP35.78Unverified
#ModelMetricClaimedVerifiedStatus
1RLIPv2AP(S1)72.1Unverified
2MURENAP(S1)68.8Unverified
3STIPAP(S1)66Unverified
4DiffHOIAP(S1)65.7Unverified
5OCN (ResNet101)AP(S1)65.3Unverified
6OCN (ResNet50)AP(S1)64.2Unverified
7CDN (ResNet101)AP(S1)63.91Unverified
8HOICLIPAP(S1)63.5Unverified
9QPIC + CPCMAP63.1Unverified
10Body Part InteractivenessAP(S1)63Unverified
#ModelMetricClaimedVerifiedStatus
1DEFRmAP65.6Unverified
2HAKEmAP47.1Unverified
3PaStaNetmAP46.3Unverified
4RelViTmAP43.98Unverified
5Pairwise-PartmAP39.9Unverified
6Mallya & LazebnikmAP36.1Unverified
7Girdhar & RamananmAP34.6Unverified
8R*CNNmAP28.5Unverified
#ModelMetricClaimedVerifiedStatus
1HOI4ABOTDetection: Full (mAP@0.5)11.12Unverified
2ST-GAZEDetection: Full (mAP@0.5)10.4Unverified
3STTRANDetection: Full (mAP@0.5)7.61Unverified
#ModelMetricClaimedVerifiedStatus
1DJ-RNmAP10.37Unverified
2iCANmAP8.14Unverified
#ModelMetricClaimedVerifiedStatus
1SlowFast + FasterRCNNmAP@0.5 role25.93Unverified