SOTAVerified

Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–200 of 449 papers

TitleStatusHype
PersonaHOI: Effortlessly Improving Personalized Face with Human-Object Interaction GenerationCode0
PersonaHOI: Effortlessly Improving Face Personalization in Human-Object Interaction GenerationCode0
Pairwise Body-Part Attention for Recognizing Human-Object InteractionsCode0
Object-centric Video Representation for Long-term Action AnticipationCode0
No-Frills Human-Object Interaction Detection: Factorization, Layout Encodings, and Training TechniquesCode0
Temporal Relational Reasoning in VideosCode0
Forecasting Human-Object Interaction: Joint Prediction of Motor Attention and Actions in First Person VideoCode0
Detecting and Recognizing Human-Object InteractionsCode0
Descriptive Caption Enhancement with Visual Specialists for Multimodal PerceptionCode0
Focusing on what to decode and what to train: SOV Decoding with Specific Target Guided DeNoising and Vision Language AdvisorCode0
Leverage Interactive Affinity for Affordance LearningCode0
Fine-Grained Multi-View Hand Reconstruction Using Inverse RenderingCode0
Fine-grained Affordance Annotation for Egocentric Hand-Object Interaction VideosCode0
Learning Human-Object Interactions by Graph Parsing Neural NetworksCode0
Multiverse Through Deepfakes: The MultiFakeVerse Dataset of Person-Centric Visual and Conceptual ManipulationsCode0
B-RIGHT: Benchmark Re-evaluation for Integrity in Generalized Human-Object Interaction TestingCode0
Interaction Region Visual Transformer for Egocentric Action AnticipationCode0
Boosting Zero-Shot Human-Object Interaction Detection with Vision-Language TransferCode0
A Plug-and-Play Method for Rare Human-Object Interactions Detection by Bridging Domain GapCode0
Interactiveness Field in Human-Object InteractionsCode0
Exploiting Multimodal Synthetic Data for Egocentric Human-Object Interaction Detection in an Industrial ScenarioCode0
Exploiting CLIP for Zero-shot HOI Detection Requires Knowledge Distillation at Multiple LevelsCode0
ERNet: Efficient and Reliable Human-Object Interaction DetectionCode0
ENIGMA-51: Towards a Fine-Grained Understanding of Human-Object Interactions in Industrial ScenariosCode0
Controllable Human-Object Interaction Synthesis—0
End-to-End HOI Reconstruction Transformer with Graph-based Encoding—0
EigenActor: Variant Body-Object Interaction Generation Evolved from Invariant Action Basis Reasoning—0
Contextual Heterogeneous Graph Network for Human-Object Interaction Detection—0
EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splatting—0
Contextual Guided Segmentation Framework for Semi-supervised Video Instance Segmentation—0
EgoChoir: Capturing 3D Human-Object Interaction Regions from Egocentric Views—0
Egocentric Human-Object Interaction Detection: A New Benchmark and Method—0
Bilateral Adaptation for Human-Object Interaction Detection with Occlusion-Robustness—0
AnchorCrafter: Animate CyberAnchors Saling Your Products via Human-Object Interacting Video Generation—0
ContextHOI: Spatial Context Learning for Human-Object Interaction Detection—0
Efficient Human-Object-Interaction (EHOI) Detection via Interaction Label Coding and Conditional Decision—0
Bi-Causal: Group Activity Recognition via Bidirectional Causality—0
Effective Actor-centric Human-object Interaction Detection—0
Dynamic Scene Understanding from Vision-Language Representations—0
Compositional Learning in Transformer-Based Human-Object Interaction Detection—0
Beyond Holistic Object Recognition: Enriching Image Understanding with Part States—0
An analysis of HOI: using a training-free method with multimodal visual foundation models when only the test set is available, without the training set—0
A Deep Learning Approach to Object Affordance Segmentation—0
DropKey for Vision Transformer—0
DropKey—0
Compositional Learning for Human Object Interaction—0
DreamHOI: Subject-Driven Generation of 3D Human-Object Interactions with Diffusion Priors—0
Compositional 3D Human-Object Neural Animation—0
DPMix: Mixture of Depth and Point Cloud Video Experts for 4D Action Segmentation—0
Do Deep Neural Networks Model Nonlinear Compositionality in the Neural Representation of Human-Object Interactions?—0
Show:102550
← PrevPage 4 of 9Next →
All datasetsHICO-DETV-COCOHICOVidHOIAmbiguious-HOIMECCANO

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Ours (PViC+)mAP46.49—Unverified
2RLIPv2 (Swin-L)mAP45.09—Unverified
3PViC-SwinLmAP44.32—Unverified
4SOV-STG (Swin-L)mAP43.35—Unverified
5DiffHOImAP41.5—Unverified
6ViPLOmAP37.22—Unverified
7FGAHOImAP37.18—Unverified
8ERNetmAP36.89—Unverified
9CQL+GEN-VLKT-LmAP36.03—Unverified
10QAHOI (Swin-L)mAP35.78—Unverified
#ModelMetricClaimedVerifiedStatus
1RLIPv2AP(S1)72.1—Unverified
2MURENAP(S1)68.8—Unverified
3STIPAP(S1)66—Unverified
4DiffHOIAP(S1)65.7—Unverified
5OCN (ResNet101)AP(S1)65.3—Unverified
6OCN (ResNet50)AP(S1)64.2—Unverified
7CDN (ResNet101)AP(S1)63.91—Unverified
8HOICLIPAP(S1)63.5—Unverified
9QPIC + CPCMAP63.1—Unverified
10Body Part InteractivenessAP(S1)63—Unverified
#ModelMetricClaimedVerifiedStatus
1DEFRmAP65.6—Unverified
2HAKEmAP47.1—Unverified
3PaStaNetmAP46.3—Unverified
4RelViTmAP43.98—Unverified
5Pairwise-PartmAP39.9—Unverified
6Mallya & LazebnikmAP36.1—Unverified
7Girdhar & RamananmAP34.6—Unverified
8R*CNNmAP28.5—Unverified
#ModelMetricClaimedVerifiedStatus
1HOI4ABOTDetection: Full (mAP@0.5)11.12—Unverified
2ST-GAZEDetection: Full (mAP@0.5)10.4—Unverified
3STTRANDetection: Full (mAP@0.5)7.61—Unverified
#ModelMetricClaimedVerifiedStatus
1DJ-RNmAP10.37—Unverified
2iCANmAP8.14—Unverified
#ModelMetricClaimedVerifiedStatus
1SlowFast + FasterRCNNmAP@0.5 role25.93—Unverified