SOTAVerified

Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 449 papers

TitleStatusHype
A Plug-and-Play Method for Rare Human-Object Interactions Detection by Bridging Domain GapCode0
Monocular Human-Object Reconstruction in the WildCode1
StackFLOW: Monocular Human-Object Reconstruction by Stacked Normalizing Flow with OffsetCode1
Kinematics-based 3D Human-Object Interaction Reconstruction from Single View—0
HIMO: A New Benchmark for Full-Body Human Interacting with Multiple Objects—0
F-HOI: Toward Fine-grained Semantic-Aligned 3D Human-Object Interactions—0
CycleHOI: Improving Human-Object Interaction Detection with Cycle Consistency of Detection and Generation—0
NODE-Adapter: Neural Ordinary Differential Equations for Better Vision-Language Reasoning—0
Fine-Grained Multi-View Hand Reconstruction Using Inverse RenderingCode0
RAM: Retrieval-Based Affordance Transfer for Generalizable Zero-Shot Robotic ManipulationCode2
HOIMotion: Forecasting Human Motion During Human-Object Interactions Using Egocentric 3D Object Bounding Boxes—0
From Category to Scenery: An End-to-End Framework for Multi-Person Human-Object Interaction Recognition in Videos—0
Learning Granularity-Aware Affordances from Human-Object Interaction for Tool-Based Functional Grasping in Dexterous RoboticsCode1
EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splatting—0
CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangementCode2
Human-Aware 3D Scene Generation with Spatially-constrained Diffusion Models—0
Geometric Features Enhanced Human-Object Interaction DetectionCode0
Human-Object Interaction from Human-Level Instructions—0
CooHOI: Learning Cooperative Human-Object Interaction with Manipulated Object Dynamics—0
LLAVIDAL: A Large LAnguage VIsion Model for Daily Activities of Living—0
Open-World Human-Object Interaction Detection via Multi-modal Prompts—0
EgoChoir: Capturing 3D Human-Object Interaction Regions from Egocentric Views—0
Learning from Observer Gaze:Zero-Shot Attention Prediction Oriented by Human-Object Interaction Recognition—0
VirtualModel: Generating Object-ID-retentive Human-object Interaction Image by Diffusion Model for E-commerce Marketing—0
CinePile: A Long Video Question Answering Dataset and Benchmark—0
ChatHuman: Language-driven 3D Human Understanding with Retrieval-Augmented Tool Reasoning—0
Exploring Interactive Semantic Alignment for Efficient HOI Detection with Vision-language Model—0
Generating Human Interaction Motions in Scenes with Text Control—0
Exploring the Potential of Large Foundation Models for Open-Vocabulary HOI DetectionCode1
Disentangled Pre-training for Human-Object Interaction DetectionCode1
HOI-M3:Capture Multiple Humans and Objects Interaction within Contextual Environment—0
InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interaction—0
Toward Open-Set Human Object Interaction DetectionCode0
InterFusion: Text-Driven Generation of 3D Human-Object InteractionCode2
Boosting Zero-Shot Human-Object Interaction Detection with Vision-Language TransferCode0
THOR: Text to Human-Object Interaction Diffusion via Relation Intervention—0
FORCE: Physics-aware Human-object Interaction—0
Enhancing Human-Centered Dynamic Scene Understanding via Multiple LLMs Collaborated Reasoning—0
Towards Zero-shot Human-Object Interaction Detection via Vision-Language Integration—0
Test-time Distribution Learning Adapter for Cross-modal Visual Reasoning—0
FreeA: Human-object Interaction Detection using Free Annotation Labels—0
TED-Net: Dispersal Attention for Perceiving Interaction Region in Indirectly-Contact HOI DetectionCode0
Beyond the Contact: Discovering Comprehensive Affordance for 3D Objects from Pre-trained 2D Diffusion ModelsCode2
ParaHome: Parameterizing Everyday Home Activities Towards 3D Generative Modeling of Human-Object Interactions—0
AffordanceLLM: Grounding Affordance from Vision Language Models—0
Exploring Self- and Cross-Triplet Correlations for Human-Object Interaction Detection—0
RHOBIN Challenge: Reconstruction of Human Object Interaction—0
Glance and Focus: Memory Prompting for Multi-Event Video Question AnsweringCode1
Bilateral Adaptation for Human-Object Interaction Detection with Occlusion-Robustness—0
Bi-Causal: Group Activity Recognition via Bidirectional Causality—0
Show:102550
← PrevPage 3 of 9Next →
All datasetsHICO-DETV-COCOHICOVidHOIAmbiguious-HOIMECCANO

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Ours (PViC+)mAP46.49—Unverified
2RLIPv2 (Swin-L)mAP45.09—Unverified
3PViC-SwinLmAP44.32—Unverified
4SOV-STG (Swin-L)mAP43.35—Unverified
5DiffHOImAP41.5—Unverified
6ViPLOmAP37.22—Unverified
7FGAHOImAP37.18—Unverified
8ERNetmAP36.89—Unverified
9CQL+GEN-VLKT-LmAP36.03—Unverified
10QAHOI (Swin-L)mAP35.78—Unverified
#ModelMetricClaimedVerifiedStatus
1RLIPv2AP(S1)72.1—Unverified
2MURENAP(S1)68.8—Unverified
3STIPAP(S1)66—Unverified
4DiffHOIAP(S1)65.7—Unverified
5OCN (ResNet101)AP(S1)65.3—Unverified
6OCN (ResNet50)AP(S1)64.2—Unverified
7CDN (ResNet101)AP(S1)63.91—Unverified
8HOICLIPAP(S1)63.5—Unverified
9QPIC + CPCMAP63.1—Unverified
10Body Part InteractivenessAP(S1)63—Unverified
#ModelMetricClaimedVerifiedStatus
1DEFRmAP65.6—Unverified
2HAKEmAP47.1—Unverified
3PaStaNetmAP46.3—Unverified
4RelViTmAP43.98—Unverified
5Pairwise-PartmAP39.9—Unverified
6Mallya & LazebnikmAP36.1—Unverified
7Girdhar & RamananmAP34.6—Unverified
8R*CNNmAP28.5—Unverified
#ModelMetricClaimedVerifiedStatus
1HOI4ABOTDetection: Full (mAP@0.5)11.12—Unverified
2ST-GAZEDetection: Full (mAP@0.5)10.4—Unverified
3STTRANDetection: Full (mAP@0.5)7.61—Unverified
#ModelMetricClaimedVerifiedStatus
1DJ-RNmAP10.37—Unverified
2iCANmAP8.14—Unverified
#ModelMetricClaimedVerifiedStatus
1SlowFast + FasterRCNNmAP@0.5 role25.93—Unverified