SOTAVerified

Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 251–300 of 449 papers

TitleStatusHype
Learning from Observer Gaze:Zero-Shot Attention Prediction Oriented by Human-Object Interaction Recognition—0
Learning from Observer Gaze: Zero-Shot Attention Prediction Oriented by Human-Object Interaction Recognition—0
Towards Zero-shot Human-Object Interaction Detection via Vision-Language Integration—0
TPPO: A Novel Trajectory Predictor with Pseudo Oracle—0
Learning Models for Actions and Person-Object Interactions with Transfer to Question Answering—0
Learning Structured Representations of Visual Scenes—0
Learning to Detect Human-Object Interactions—0
Learning to Detect Human-Object Interactions With Knowledge—0
Zero-Shot Human-Object Interaction Recognition via Affordance Graphs—0
Learn to Predict How Humans Manipulate Large-sized Objects from Interactive Motions—0
Weakly-Supervised HOI Detection from Interaction Labels Only and Language/Vision-Language Priors—0
LEMON: Learning 3D Human-Object Interaction Relation from 2D Images—0
Leveraging Next-Active Objects for Context-Aware Anticipation in Egocentric Videos—0
Lifting Motion to the 3D World via 2D Diffusion—0
TriDi: Trilateral Diffusion of 3D Humans, Objects, and Interactions—0
LLAVIDAL: A Large LAnguage VIsion Model for Daily Activities of Living—0
TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wild—0
Localizing Firearm Carriers by Identifying Human-Object Pairs—0
Low-Cost Scene Modeling using a Density Function Improves Segmentation Performance—0
MaskedManipulator: Versatile Whole-Body Control for Loco-Manipulation—0
MECCANO: A Multimodal Egocentric Dataset for Humans Behavior Understanding in the Industrial-like Domain—0
Mining Conditional Part Semantics with Occluded Extrapolation for Human-Object Interaction Detection—0
TUHOI: Trento Universal Human Object Interaction Dataset—0
Turbo Learning Framework for Human-Object Interactions Recognition and Human Pose Estimation—0
Modelling Spatio-Temporal Interactions for Compositional Action Recognition—0
UAHOI: Uncertainty-aware Robust Interaction Learning for HOI Detection—0
MSTR: Multi-Scale Transformer for End-to-End Human-Object Interaction Detection—0
Multi-Stage Deep Transfer Learning for EmIoT-enabled Human-Computer Interaction—0
Multi-View Region Adaptive Multi-temporal DMM and RGB Action Recognition—0
NeuralDome: A Neural Modeling Pipeline on Multi-View Human-Object Interactions—0
Neural Free-Viewpoint Performance Rendering under Complex Human-object Interactions—0
NeuralHOFusion: Neural Volumetric Rendering under Human-object Interactions—0
Understanding Spatio-Temporal Relations in Human-Object Interaction using Pyramid Graph Convolutional Network—0
NODE-Adapter: Neural Ordinary Differential Equations for Better Vision-Language Reasoning—0
Novel Human-Object Interaction Detection via Adversarial Domain Generalization—0
Object Modelling with a Handheld RGB-D Camera—0
Object Motion Guided Human Motion Synthesis—0
Object-Occluded Human Shape and Pose Estimation From a Single Color Image—0
OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Models—0
On the Robustness of Human-Object Interaction Detection against Distribution Shift—0
OOD-HOI: Text-Driven 3D Whole-Body Human-Object Interactions Generation Beyond Training Domains—0
Open-Category Human-Object Interaction Pre-Training via Language Modeling Framework—0
Open Set Video HOI detection from Action-Centric Chain-of-Look Prompting—0
Open-World Human-Object Interaction Detection via Multi-modal Prompts—0
Orchestrating the Symphony of Prompt Distribution Learning for Human-Object Interaction Detection—0
ParaHome: Parameterizing Everyday Home Activities Towards 3D Generative Modeling of Human-Object Interactions—0
Parallel Reasoning Network for Human-Object Interaction Detection—0
Unified Visual Relationship Detection with Vision and Language Models—0
UniHM: Universal Human Motion Generation with Object Interactions in Indoor Scenes—0
Persistent-Transient Duality: A Multi-mechanism Approach for Modeling Human-Object Interaction—0
Show:102550
← PrevPage 6 of 9Next →
All datasetsHICO-DETV-COCOHICOVidHOIAmbiguious-HOIMECCANO

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Ours (PViC+)mAP46.49—Unverified
2RLIPv2 (Swin-L)mAP45.09—Unverified
3PViC-SwinLmAP44.32—Unverified
4SOV-STG (Swin-L)mAP43.35—Unverified
5DiffHOImAP41.5—Unverified
6ViPLOmAP37.22—Unverified
7FGAHOImAP37.18—Unverified
8ERNetmAP36.89—Unverified
9CQL+GEN-VLKT-LmAP36.03—Unverified
10QAHOI (Swin-L)mAP35.78—Unverified
#ModelMetricClaimedVerifiedStatus
1RLIPv2AP(S1)72.1—Unverified
2MURENAP(S1)68.8—Unverified
3STIPAP(S1)66—Unverified
4DiffHOIAP(S1)65.7—Unverified
5OCN (ResNet101)AP(S1)65.3—Unverified
6OCN (ResNet50)AP(S1)64.2—Unverified
7CDN (ResNet101)AP(S1)63.91—Unverified
8HOICLIPAP(S1)63.5—Unverified
9QPIC + CPCMAP63.1—Unverified
10Body Part InteractivenessAP(S1)63—Unverified
#ModelMetricClaimedVerifiedStatus
1DEFRmAP65.6—Unverified
2HAKEmAP47.1—Unverified
3PaStaNetmAP46.3—Unverified
4RelViTmAP43.98—Unverified
5Pairwise-PartmAP39.9—Unverified
6Mallya & LazebnikmAP36.1—Unverified
7Girdhar & RamananmAP34.6—Unverified
8R*CNNmAP28.5—Unverified
#ModelMetricClaimedVerifiedStatus
1HOI4ABOTDetection: Full (mAP@0.5)11.12—Unverified
2ST-GAZEDetection: Full (mAP@0.5)10.4—Unverified
3STTRANDetection: Full (mAP@0.5)7.61—Unverified
#ModelMetricClaimedVerifiedStatus
1DJ-RNmAP10.37—Unverified
2iCANmAP8.14—Unverified
#ModelMetricClaimedVerifiedStatus
1SlowFast + FasterRCNNmAP@0.5 role25.93—Unverified