SOTAVerified

Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 449 papers

TitleStatusHype
DIRV: Dense Interaction Region Voting for End-to-End Human-Object Interaction DetectionCode1
Human-Object Interaction Detection:A Quick Survey and Examination of MethodsCode1
DRG: Dual Relation Graph for Human-Object Interaction DetectionCode1
ConsNet: Learning Consistency Graph for Zero-Shot Human-Object Interaction DetectionCode1
Polysemy Deciphering Network for Robust Human-Object Interaction DetectionCode1
Pose-based Modular Network for Human-Object Interaction DetectionCode1
Polysemy Deciphering Network for Human-Object Interaction DetectionCode1
Detecting Human-Object Interactions with Action Co-occurrence PriorsCode1
LEMMA: A Multi-view Dataset for Learning Multi-agent Multi-task ActivitiesCode1
Perceiving 3D Human-Object Spatial Arrangements from a Single Image in the WildCode1
Visual Compositional Learning for Human-Object Interaction DetectionCode1
Detecting Human-Object Interactions with Action Co-occurrence PriorsCode1
VPN: Learning Video-Pose Embedding for Activities of Daily LivingCode1
Explanation-based Weakly-supervised Learning of Visual Relations with Graph NetworksCode1
Discovering Human Interactions With Novel Objects via Zero-Shot LearningCode1
Detailed 2D-3D Joint Representation for Human-Object InteractionCode1
PaStaNet: Toward Human Activity Knowledge EngineCode1
Learning Human-Object Interaction Detection using Interaction PointsCode1
Use the Force, Luke! Learning to Predict Physical Forces by Simulating EffectsCode1
VSGNet: Spatial Attention Network for Detecting Human Object Interactions Using Graph ConvolutionsCode1
Cascaded Human-Object Interaction RecognitionCode1
Visual-Semantic Graph Attention Networks for Human-Object Interaction DetectionCode1
HAKE: Human Activity Knowledge EngineCode1
Transferable Interactiveness Knowledge for Human-Object Interaction DetectionCode1
iCAN: Instance-Centric Attention Network for Human-Object Interaction DetectionCode1
RoHOI: Robustness Benchmark for Human-Object Interaction DetectionCode0
Bilateral Collaboration with Large Vision-Language Models for Open Vocabulary Human-Object Interaction DetectionCode0
HOIverse: A Synthetic Scene Graph Dataset With Human Object Interactions—0
On the Robustness of Human-Object Interaction Detection against Distribution Shift—0
Egocentric Human-Object Interaction Detection: A New Benchmark and Method—0
InterActHuman: Multi-Concept Human Animation with Layout-Aligned Audio Conditions—0
HunyuanVideo-HOMA: Generic Human-Object Interaction in Multimodal Driven Human Animation—0
HOI-PAGE: Zero-Shot Human-Object Interaction Generation with Part Affordance Guidance—0
Geometric Visual Fusion Graph Neural Networks for Multi-Person Human-Object Interaction Recognition in Videos—0
Multiverse Through Deepfakes: The MultiFakeVerse Dataset of Person-Centric Visual and Conceptual ManipulationsCode0
Hi-Dyna Graph: Hierarchical Dynamic Scene Graph for Robotic Autonomy in Human-Centric Environments—0
InteractAnything: Zero-shot Human Object Interaction Synthesis via LLM Feedback and Object Affordance Parsing—0
MaskedManipulator: Versatile Whole-Body Control for Loco-Manipulation—0
UniHM: Universal Human Motion Generation with Object Interactions in Indoor Scenes—0
ViSA-Flow: Accelerating Robot Skill Learning via Large-Scale Video Semantic Action Flow—0
Crossing the Human-Robot Embodiment Gap with Sim-to-Real RL using One Human Demonstration—0
Generalized Visual Relation Detection with Diffusion Models—0
HUMOTO: A 4D Dataset of Mocap Human Object Interactions—0
HOIGen-1M: A Large-scale Dataset for Human-Object Interaction Video Generation—0
Efficient Explicit Joint-level Interaction Modeling with Mamba for Text-guided HOI GenerationCode0
ForcePose: A Deep Learning Approach for Force Calculation Based on Action Recognition Using MediaPipe Pose Estimation Combined with Object Detection—0
Guiding Human-Object Interactions with Rich Geometry and Relations—0
Zero-Shot Human-Object Interaction Synthesis with Multimodal Priors—0
Target-Aware Video Diffusion Models—0
Human-Object Interaction with Vision-Language Model Guided Relative Movement Dynamics—0
Show:102550
← PrevPage 3 of 9Next →
All datasetsHICO-DETV-COCOHICOVidHOIAmbiguious-HOIMECCANO

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Ours (PViC+)mAP46.49—Unverified
2RLIPv2 (Swin-L)mAP45.09—Unverified
3PViC-SwinLmAP44.32—Unverified
4SOV-STG (Swin-L)mAP43.35—Unverified
5DiffHOImAP41.5—Unverified
6ViPLOmAP37.22—Unverified
7FGAHOImAP37.18—Unverified
8ERNetmAP36.89—Unverified
9CQL+GEN-VLKT-LmAP36.03—Unverified
10QAHOI (Swin-L)mAP35.78—Unverified
#ModelMetricClaimedVerifiedStatus
1RLIPv2AP(S1)72.1—Unverified
2MURENAP(S1)68.8—Unverified
3STIPAP(S1)66—Unverified
4DiffHOIAP(S1)65.7—Unverified
5OCN (ResNet101)AP(S1)65.3—Unverified
6OCN (ResNet50)AP(S1)64.2—Unverified
7CDN (ResNet101)AP(S1)63.91—Unverified
8HOICLIPAP(S1)63.5—Unverified
9QPIC + CPCMAP63.1—Unverified
10Body Part InteractivenessAP(S1)63—Unverified
#ModelMetricClaimedVerifiedStatus
1DEFRmAP65.6—Unverified
2HAKEmAP47.1—Unverified
3PaStaNetmAP46.3—Unverified
4RelViTmAP43.98—Unverified
5Pairwise-PartmAP39.9—Unverified
6Mallya & LazebnikmAP36.1—Unverified
7Girdhar & RamananmAP34.6—Unverified
8R*CNNmAP28.5—Unverified
#ModelMetricClaimedVerifiedStatus
1HOI4ABOTDetection: Full (mAP@0.5)11.12—Unverified
2ST-GAZEDetection: Full (mAP@0.5)10.4—Unverified
3STTRANDetection: Full (mAP@0.5)7.61—Unverified
#ModelMetricClaimedVerifiedStatus
1DJ-RNmAP10.37—Unverified
2iCANmAP8.14—Unverified
#ModelMetricClaimedVerifiedStatus
1SlowFast + FasterRCNNmAP@0.5 role25.93—Unverified