SOTAVerified

Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–200 of 449 papers

TitleStatusHype
Compositional Learning for Human Object Interaction—0
DreamHOI: Subject-Driven Generation of 3D Human-Object Interactions with Diffusion Priors—0
Compositional 3D Human-Object Neural Animation—0
DPMix: Mixture of Depth and Point Cloud Video Experts for 4D Action Segmentation—0
Do Deep Neural Networks Model Nonlinear Compositionality in the Neural Representation of Human-Object Interactions?—0
Complex Video Action Reasoning via Learnable Markov Logic Network—0
Distillation Using Oracle Queries for Transformer-Based Human-Object Interaction Detection—0
Distillation of Human-Object Interaction Contexts for Action Recognition—0
AvatarGO: Zero-shot 4D Human-Object Interaction Generation and Animation—0
An Abstract Specification of VoxML as an Annotation Language—0
Amplifying Key Cues for Human-Object-Interaction Detection—0
COBE: Contextualized Object Embeddings from Narrated Instructional Video—0
CL-HOI: Cross-Level Human-Object Interaction Distillation from Vision Large Language Models—0
Disentangled Interaction Representation for One-Stage Human-Object Interaction Detection—0
Autonomous Character-Scene Interaction Synthesis from Text Instruction—0
Discovering Syntactic Interaction Clues for Human-Object Interaction Detection—0
HOI4ABOT: Human-Object Interaction Anticipation for Human Intention Reading Collaborative roBOTs—0
Classifying All Interacting Pairs in a Single Shot—0
HODN: Disentangling Human-Object Feature for HOI Detection—0
Discovering Human Interactions With Large-Vocabulary Objects via Query and Multi-Scale Detection—0
CinePile: A Long Video Question Answering Dataset and Benchmark—0
Human Object Interaction Detection using Two-Direction Spatial Enhancement and Exclusive Object Prior—0
Human-Object Interaction Detection via Disentangled Transformer—0
Human-Object Interaction Detection via Weak Supervision—0
HUMOTO: A 4D Dataset of Mocap Human Object Interactions—0
Discovering Human Interactions in Videos with Limited Data Labeling—0
CHORUS : Learning Canonicalized 3D Human-Object Spatial Relations from Unbounded Synthesized Images—0
A Graph-based Interactive Reasoning for Human-Object Interaction Detection—0
HandyPriors: Physically Consistent Perception of Hand-Object Interactions with Differentiable Priors—0
Diffgrasp: Whole-Body Grasping Synthesis Guided by Object Motion Using a Diffusion Model—0
CHORUS: Learning Canonicalized 3D Human-Object Spatial Relations from Unbounded Synthesized Images—0
Guiding Human-Object Interactions with Rich Geometry and Relations—0
Diagnosing Rarity in Human-Object Interaction Detection—0
Group Activity Recognition via Dynamic Composition and Interaction—0
Grounded Human-Object Interaction Hotspots from Video (Extended Abstract)—0
HICO: A Benchmark for Recognizing Human-Object Interactions in Images—0
ChatHuman: Language-driven 3D Human Understanding with Retrieval-Augmented Tool Reasoning—0
Hi-Dyna Graph: Hierarchical Dynamic Scene Graph for Robotic Autonomy in Human-Centric Environments—0
Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Models—0
Hierarchical Video Prediction Using Relational Layouts for Human-Object Interactions—0
DexVIP: Learning Dexterous Grasping with Human Hand Pose Priors from Video—0
HIMO: A New Benchmark for Full-Body Human Interacting with Multiple Objects—0
ChatHuman: Chatting about 3D Humans with Tools—0
Hoi2Anomaly: An Explainable Anomaly Detection Approach Guided by Human-Object Interaction—0
Gravity-Aware Monocular 3D Human-Object Reconstruction—0
GraspDiffusion: Synthesizing Realistic Whole-body Hand-Object Interaction—0
whu-nercms at trecvid2021:instance search task—0
HOIAnimator: Generating Text-prompt Human-object Animations using Novel Perceptive Diffusion Models—0
3D-AffordanceLLM: Harnessing Large Language Models for Open-Vocabulary Affordance Detection in 3D Worlds—0
Human Motion Prediction, Reconstruction, and Generation—0
Show:102550
← PrevPage 4 of 9Next →
All datasetsHICO-DETV-COCOHICOVidHOIAmbiguious-HOIMECCANO

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Ours (PViC+)mAP46.49—Unverified
2RLIPv2 (Swin-L)mAP45.09—Unverified
3PViC-SwinLmAP44.32—Unverified
4SOV-STG (Swin-L)mAP43.35—Unverified
5DiffHOImAP41.5—Unverified
6ViPLOmAP37.22—Unverified
7FGAHOImAP37.18—Unverified
8ERNetmAP36.89—Unverified
9CQL+GEN-VLKT-LmAP36.03—Unverified
10QAHOI (Swin-L)mAP35.78—Unverified
#ModelMetricClaimedVerifiedStatus
1RLIPv2AP(S1)72.1—Unverified
2MURENAP(S1)68.8—Unverified
3STIPAP(S1)66—Unverified
4DiffHOIAP(S1)65.7—Unverified
5OCN (ResNet101)AP(S1)65.3—Unverified
6OCN (ResNet50)AP(S1)64.2—Unverified
7CDN (ResNet101)AP(S1)63.91—Unverified
8HOICLIPAP(S1)63.5—Unverified
9QPIC + CPCMAP63.1—Unverified
10Body Part InteractivenessAP(S1)63—Unverified
#ModelMetricClaimedVerifiedStatus
1DEFRmAP65.6—Unverified
2HAKEmAP47.1—Unverified
3PaStaNetmAP46.3—Unverified
4RelViTmAP43.98—Unverified
5Pairwise-PartmAP39.9—Unverified
6Mallya & LazebnikmAP36.1—Unverified
7Girdhar & RamananmAP34.6—Unverified
8R*CNNmAP28.5—Unverified
#ModelMetricClaimedVerifiedStatus
1HOI4ABOTDetection: Full (mAP@0.5)11.12—Unverified
2ST-GAZEDetection: Full (mAP@0.5)10.4—Unverified
3STTRANDetection: Full (mAP@0.5)7.61—Unverified
#ModelMetricClaimedVerifiedStatus
1DJ-RNmAP10.37—Unverified
2iCANmAP8.14—Unverified
#ModelMetricClaimedVerifiedStatus
1SlowFast + FasterRCNNmAP@0.5 role25.93—Unverified