SOTAVerified

Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Showing 201250 of 449 papers

TitleStatusHype
Visual Object Tracking in First Person Vision0
Functional 3D Scene Synthesis through Human-Scene Optimization0
GASPACHO: Gaussian Splatting for Controllable Humans and Objects0
Generalized Visual Relation Detection with Diffusion Models0
Generating Human-Centric Visual Cues for Human-Object Interaction Detection via Large Vision-Language Models0
Generating Human Interaction Motions in Scenes with Text Control0
What to look at and where: Semantic and Spatial Refined Transformer for detecting human-object interactions0
VLM-HOI: Vision Language Models for Interpretable Human-Object Interaction Analysis0
Geometric Visual Fusion Graph Neural Networks for Multi-Person Human-Object Interaction Recognition in Videos0
GID-Net: Detecting Human-Object Interaction with Global and Instance Dependency0
3DArticCyclists: Generating Synthetic Articulated 8D Pose-Controllable Cyclist Data for Computer Vision Applications0
SyncDiff: Synchronized Motion Diffusion for Multi-Body Human-Object Interaction Synthesis0
GLOVER: Generalizable Open-Vocabulary Affordance Reasoning for Task-Oriented Grasping0
Graphing the Future: Activity and Next Active Object Prediction using Graph-based Activity Representations0
GraspDiffusion: Synthesizing Realistic Whole-body Hand-Object Interaction0
Gravity-Aware Monocular 3D Human-Object Reconstruction0
Synthesizing Diverse Human Motions in 3D Indoor Scenes0
Grounded Human-Object Interaction Hotspots from Video (Extended Abstract)0
Group Activity Recognition via Dynamic Composition and Interaction0
Target-Aware Video Diffusion Models0
Guiding Human-Object Interactions with Rich Geometry and Relations0
An analysis of HOI: using a training-free method with multimodal visual foundation models when only the test set is available, without the training set0
Task-Oriented Human-Object Interactions Generation with Implicit Neural Representations0
HandyPriors: Physically Consistent Perception of Hand-Object Interactions with Differentiable Priors0
HICO: A Benchmark for Recognizing Human-Object Interactions in Images0
Hi-Dyna Graph: Hierarchical Dynamic Scene Graph for Robotic Autonomy in Human-Centric Environments0
Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Models0
Hierarchical Video Prediction Using Relational Layouts for Human-Object Interactions0
HIMO: A New Benchmark for Full-Body Human Interacting with Multiple Objects0
HODN: Disentangling Human-Object Feature for HOI Detection0
Hoi2Anomaly: An Explainable Anomaly Detection Approach Guided by Human-Object Interaction0
HOI4ABOT: Human-Object Interaction Anticipation for Human Intention Reading Collaborative roBOTs0
Tell Me What They're Holding: Weakly-supervised Object Detection with Transferable Knowledge from Human-object Interaction0
HOIAnimator: Generating Text-prompt Human-object Animations using Novel Perceptive Diffusion Models0
Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation0
HOI-Diff: Text-Driven Synthesis of 3D Human-Object Interactions using Diffusion Models0
HOIGen-1M: A Large-scale Dataset for Human-Object Interaction Video Generation0
HOI-M^3: Capture Multiple Humans and Objects Interaction within Contextual Environment0
HOI-M3:Capture Multiple Humans and Objects Interaction within Contextual Environment0
HOIMotion: Forecasting Human Motion During Human-Object Interactions Using Egocentric 3D Object Bounding Boxes0
HOI-PAGE: Zero-Shot Human-Object Interaction Generation with Part Affordance Guidance0
HOIverse: A Synthetic Scene Graph Dataset With Human Object Interactions0
HOKEM: Human and Object Keypoint-based Extension Module for Human-Object Interaction Detection0
Holistic++ Scene Understanding: Single-view 3D Holistic Scene Parsing and Human Pose Estimation with Human-Object Interaction and Physical Commonsense0
HORP: Human-Object Relation Priors Guided HOI Detection0
HOSNeRF: Dynamic Human-Object-Scene Neural Radiance Fields from a Single Video0
Human-Aware 3D Scene Generation with Spatially-constrained Diffusion Models0
Human Centred Object Co-Segmentation0
An Abstract Specification of VoxML as an Annotation Language0
Human Motion Prediction, Reconstruction, and Generation0
Show:102550
← PrevPage 5 of 9Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Ours (PViC+)mAP46.49Unverified
2RLIPv2 (Swin-L)mAP45.09Unverified
3PViC-SwinLmAP44.32Unverified
4SOV-STG (Swin-L)mAP43.35Unverified
5DiffHOImAP41.5Unverified
6ViPLOmAP37.22Unverified
7FGAHOImAP37.18Unverified
8ERNetmAP36.89Unverified
9CQL+GEN-VLKT-LmAP36.03Unverified
10QAHOI (Swin-L)mAP35.78Unverified
#ModelMetricClaimedVerifiedStatus
1RLIPv2AP(S1)72.1Unverified
2MURENAP(S1)68.8Unverified
3STIPAP(S1)66Unverified
4DiffHOIAP(S1)65.7Unverified
5OCN (ResNet101)AP(S1)65.3Unverified
6OCN (ResNet50)AP(S1)64.2Unverified
7CDN (ResNet101)AP(S1)63.91Unverified
8HOICLIPAP(S1)63.5Unverified
9QPIC + CPCMAP63.1Unverified
10Body Part InteractivenessAP(S1)63Unverified
#ModelMetricClaimedVerifiedStatus
1DEFRmAP65.6Unverified
2HAKEmAP47.1Unverified
3PaStaNetmAP46.3Unverified
4RelViTmAP43.98Unverified
5Pairwise-PartmAP39.9Unverified
6Mallya & LazebnikmAP36.1Unverified
7Girdhar & RamananmAP34.6Unverified
8R*CNNmAP28.5Unverified
#ModelMetricClaimedVerifiedStatus
1HOI4ABOTDetection: Full (mAP@0.5)11.12Unverified
2ST-GAZEDetection: Full (mAP@0.5)10.4Unverified
3STTRANDetection: Full (mAP@0.5)7.61Unverified
#ModelMetricClaimedVerifiedStatus
1DJ-RNmAP10.37Unverified
2iCANmAP8.14Unverified
#ModelMetricClaimedVerifiedStatus
1SlowFast + FasterRCNNmAP@0.5 role25.93Unverified