SOTAVerified

Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 449 papers

TitleStatusHype
Distance-Aware Occlusion Detection with Focused AttentionCode1
Towards Hard-Positive Query Mining for DETR-based Human-Object Interaction DetectionCode1
Use the Force, Luke! Learning to Predict Physical Forces by Simulating EffectsCode1
ViPLO: Vision Transformer based Pose-Conditioned Self-Loop Graph for Human-Object Interaction DetectionCode1
HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object InteractionCode1
Visual-Semantic Graph Attention Networks for Human-Object Interaction DetectionCode1
HOTR: End-to-End Human-Object Interaction Detection with TransformersCode1
DRG: Dual Relation Graph for Human-Object Interaction DetectionCode1
Weakly-Supervised Affordance Grounding Guided by Part-Level Semantic PriorsCode1
Weakly Supervised Human-Object Interaction Detection in Video via Contrastive Spatiotemporal RegionsCode1
GTNet:Guided Transformer Network for Detecting Human-Object InteractionsCode1
Exploring Conditional Multi-Modal Prompts for Zero-shot HOI DetectionCode1
Cascaded Human-Object Interaction RecognitionCode1
Efficient Adaptive Human-Object Interaction Detection with Concept-guided MemoryCode1
ConsNet: Learning Consistency Graph for Zero-Shot Human-Object Interaction DetectionCode1
Geometric Features Informed Multi-person Human-object Interaction Recognition in VideosCode1
Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise TransformerCode1
DECO: Dense Estimation of 3D Human-Scene Contact In The WildCode1
Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object InteractionsCode1
Grounded Affordance from Exocentric ViewCode1
HAKE: Human Activity Knowledge EngineCode1
EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level PlanningCode1
PaStaNet: Toward Human Activity Knowledge EngineCode1
Explanation-based Weakly-supervised Learning of Visual Relations with Graph NetworksCode1
StackFLOW: Monocular Human-Object Reconstruction by Stacked Normalizing Flow with OffsetCode1
Controllable Human-Object Interaction Synthesis—0
End-to-End HOI Reconstruction Transformer with Graph-based Encoding—0
EigenActor: Variant Body-Object Interaction Generation Evolved from Invariant Action Basis Reasoning—0
Contextual Heterogeneous Graph Network for Human-Object Interaction Detection—0
AnchorCrafter: Animate CyberAnchors Saling Your Products via Human-Object Interacting Video Generation—0
EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splatting—0
Contextual Guided Segmentation Framework for Semi-supervised Video Instance Segmentation—0
EgoChoir: Capturing 3D Human-Object Interaction Regions from Egocentric Views—0
Egocentric Human-Object Interaction Detection: A New Benchmark and Method—0
Bilateral Adaptation for Human-Object Interaction Detection with Occlusion-Robustness—0
A Deep Learning Approach to Object Affordance Segmentation—0
GID-Net: Detecting Human-Object Interaction with Global and Instance Dependency—0
ContextHOI: Spatial Context Learning for Human-Object Interaction Detection—0
3DArticCyclists: Generating Synthetic Articulated 8D Pose-Controllable Cyclist Data for Computer Vision Applications—0
Efficient Human-Object-Interaction (EHOI) Detection via Interaction Label Coding and Conditional Decision—0
Bi-Causal: Group Activity Recognition via Bidirectional Causality—0
Effective Actor-centric Human-object Interaction Detection—0
Beyond Holistic Object Recognition: Enriching Image Understanding with Part States—0
Dynamic Scene Understanding from Vision-Language Representations—0
Compositional Learning in Transformer-Based Human-Object Interaction Detection—0
An analysis of HOI: using a training-free method with multimodal visual foundation models when only the test set is available, without the training set—0
Geometric Visual Fusion Graph Neural Networks for Multi-Person Human-Object Interaction Recognition in Videos—0
DropKey for Vision Transformer—0
DropKey—0
Compositional Learning for Human Object Interaction—0
Show:102550
← PrevPage 3 of 9Next →
All datasetsHICO-DETV-COCOHICOVidHOIAmbiguious-HOIMECCANO

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Ours (PViC+)mAP46.49—Unverified
2RLIPv2 (Swin-L)mAP45.09—Unverified
3PViC-SwinLmAP44.32—Unverified
4SOV-STG (Swin-L)mAP43.35—Unverified
5DiffHOImAP41.5—Unverified
6ViPLOmAP37.22—Unverified
7FGAHOImAP37.18—Unverified
8ERNetmAP36.89—Unverified
9CQL+GEN-VLKT-LmAP36.03—Unverified
10QAHOI (Swin-L)mAP35.78—Unverified
#ModelMetricClaimedVerifiedStatus
1RLIPv2AP(S1)72.1—Unverified
2MURENAP(S1)68.8—Unverified
3STIPAP(S1)66—Unverified
4DiffHOIAP(S1)65.7—Unverified
5OCN (ResNet101)AP(S1)65.3—Unverified
6OCN (ResNet50)AP(S1)64.2—Unverified
7CDN (ResNet101)AP(S1)63.91—Unverified
8HOICLIPAP(S1)63.5—Unverified
9QPIC + CPCMAP63.1—Unverified
10Body Part InteractivenessAP(S1)63—Unverified
#ModelMetricClaimedVerifiedStatus
1DEFRmAP65.6—Unverified
2HAKEmAP47.1—Unverified
3PaStaNetmAP46.3—Unverified
4RelViTmAP43.98—Unverified
5Pairwise-PartmAP39.9—Unverified
6Mallya & LazebnikmAP36.1—Unverified
7Girdhar & RamananmAP34.6—Unverified
8R*CNNmAP28.5—Unverified
#ModelMetricClaimedVerifiedStatus
1HOI4ABOTDetection: Full (mAP@0.5)11.12—Unverified
2ST-GAZEDetection: Full (mAP@0.5)10.4—Unverified
3STTRANDetection: Full (mAP@0.5)7.61—Unverified
#ModelMetricClaimedVerifiedStatus
1DJ-RNmAP10.37—Unverified
2iCANmAP8.14—Unverified
#ModelMetricClaimedVerifiedStatus
1SlowFast + FasterRCNNmAP@0.5 role25.93—Unverified