SOTAVerified

Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–200 of 449 papers

TitleStatusHype
An Image-like Diffusion Method for Human-Object Interaction Detection—0
Re-HOLD: Video Hand Object Interaction Reenactment via adaptive Layout-instructed Diffusion Model—0
Reconstructing In-the-Wild Open-Vocabulary Human-Object Interactions—0
3D Human Interaction Generation: A Survey—0
Hoi2Anomaly: An Explainable Anomaly Detection Approach Guided by Human-Object Interaction—0
GASPACHO: Gaussian Splatting for Controllable Humans and Objects—0
InteractEdit: Zero-Shot Editing of Human-Object Interactions in Images—0
End-to-End HOI Reconstruction Transformer with Graph-based Encoding—0
From Infants to AI: Incorporating Infant-like Learning in Models Boosts Efficiency and Generalization in Learning Social Prediction Tasks—0
EigenActor: Variant Body-Object Interaction Generation Evolved from Invariant Action Basis Reasoning—0
3D-AffordanceLLM: Harnessing Large Language Models for Open-Vocabulary Affordance Detection in 3D Worlds—0
Human Motion Prediction, Reconstruction, and Generation—0
RHINO: Learning Real-Time Humanoid-Human-Object Interaction from Human Demonstrations—0
Hummingbird: High Fidelity Image Generation via Multimodal Context Alignment—0
Functional 3D Scene Synthesis through Human-Scene Optimization—0
OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Models—0
B-RIGHT: Benchmark Re-evaluation for Integrity in Generalized Human-Object Interaction TestingCode0
Eye Gaze as a Signal for Conveying User Attention in Contextual AI Systems—0
Dynamic Scene Understanding from Vision-Language Representations—0
DAViD: Modeling Dynamic Affordance of 3D Objects using Pre-trained Video Diffusion Models—0
PersonaHOI: Effortlessly Improving Personalized Face with Human-Object Interaction GenerationCode0
ChatHuman: Chatting about 3D Humans with Tools—0
HORP: Human-Object Relation Priors Guided HOI Detection—0
PICO: Reconstructing 3D People In Contact with Objects—0
ChainHOI: Joint-based Kinematic Chain Modeling for Human-Object Interaction Generation—0
PersonaHOI: Effortlessly Improving Face Personalization in Human-Object Interaction GenerationCode0
InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generation—0
Reasoning Mamba: Hypergraph-Guided Region Relation Calculating for Weakly Supervised Affordance Grounding—0
Vision-Guided Action: Enhancing 3D Human Motion Prediction with Gaze-informed Affordance in 3D Scenes—0
Diffgrasp: Whole-Body Grasping Synthesis Guided by Object Motion Using a Diffusion Model—0
SyncDiff: Synchronized Motion Diffusion for Multi-Body Human-Object Interaction Synthesis—0
ZeroHSI: Zero-Shot 4D Human-Scene Interaction by Video Generation—0
Descriptive Caption Enhancement with Visual Specialists for Multimodal PerceptionCode0
ContextHOI: Spatial Context Learning for Human-Object Interaction Detection—0
Orchestrating the Symphony of Prompt Distribution Learning for Human-Object Interaction Detection—0
TriDi: Trilateral Diffusion of 3D Humans, Objects, and Interactions—0
OOD-HOI: Text-Driven 3D Whole-Body Human-Object Interactions Generation Beyond Training Domains—0
VLM-HOI: Vision Language Models for Interpretable Human-Object Interaction Analysis—0
Lifting Motion to the 3D World via 2D Diffusion—0
AnchorCrafter: Animate CyberAnchors Saling Your Products via Human-Object Interacting Video Generation—0
GLOVER: Generalizable Open-Vocabulary Affordance Reasoning for Task-Oriented Grasping—0
VioPose: Violin Performance 4D Pose Estimation by Hierarchical Audiovisual InferenceCode0
Human-Object Interaction Detection Collaborated with Large Relation-driven Diffusion Models—0
CL-HOI: Cross-Level Human-Object Interaction Distillation from Vision Large Language Models—0
GraspDiffusion: Synthesizing Realistic Whole-body Hand-Object Interaction—0
Visual-Geometric Collaborative Guidance for Affordance LearningCode0
3DArticCyclists: Generating Synthetic Articulated 8D Pose-Controllable Cyclist Data for Computer Vision Applications—0
Understanding Spatio-Temporal Relations in Human-Object Interaction using Pyramid Graph Convolutional Network—0
AvatarGO: Zero-shot 4D Human-Object Interaction Generation and Animation—0
Autonomous Character-Scene Interaction Synthesis from Text Instruction—0
Show:102550
← PrevPage 4 of 9Next →
All datasetsHICO-DETV-COCOHICOVidHOIAmbiguious-HOIMECCANO

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Ours (PViC+)mAP46.49—Unverified
2RLIPv2 (Swin-L)mAP45.09—Unverified
3PViC-SwinLmAP44.32—Unverified
4SOV-STG (Swin-L)mAP43.35—Unverified
5DiffHOImAP41.5—Unverified
6ViPLOmAP37.22—Unverified
7FGAHOImAP37.18—Unverified
8ERNetmAP36.89—Unverified
9CQL+GEN-VLKT-LmAP36.03—Unverified
10QAHOI (Swin-L)mAP35.78—Unverified
#ModelMetricClaimedVerifiedStatus
1RLIPv2AP(S1)72.1—Unverified
2MURENAP(S1)68.8—Unverified
3STIPAP(S1)66—Unverified
4DiffHOIAP(S1)65.7—Unverified
5OCN (ResNet101)AP(S1)65.3—Unverified
6OCN (ResNet50)AP(S1)64.2—Unverified
7CDN (ResNet101)AP(S1)63.91—Unverified
8HOICLIPAP(S1)63.5—Unverified
9QPIC + CPCMAP63.1—Unverified
10Body Part InteractivenessAP(S1)63—Unverified
#ModelMetricClaimedVerifiedStatus
1DEFRmAP65.6—Unverified
2HAKEmAP47.1—Unverified
3PaStaNetmAP46.3—Unverified
4RelViTmAP43.98—Unverified
5Pairwise-PartmAP39.9—Unverified
6Mallya & LazebnikmAP36.1—Unverified
7Girdhar & RamananmAP34.6—Unverified
8R*CNNmAP28.5—Unverified
#ModelMetricClaimedVerifiedStatus
1HOI4ABOTDetection: Full (mAP@0.5)11.12—Unverified
2ST-GAZEDetection: Full (mAP@0.5)10.4—Unverified
3STTRANDetection: Full (mAP@0.5)7.61—Unverified
#ModelMetricClaimedVerifiedStatus
1DJ-RNmAP10.37—Unverified
2iCANmAP8.14—Unverified
#ModelMetricClaimedVerifiedStatus
1SlowFast + FasterRCNNmAP@0.5 role25.93—Unverified