SOTAVerified

Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 449 papers

TitleStatusHype
Full-Body Articulated Human-Object InteractionCode1
IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object InteractionsCode1
Discovering A Variety of Objects in Spatio-Temporal Human-Object InteractionsCode1
PoseGPT: Quantization-based 3D Human Motion Generation and ForecastingCode1
Articulated 3D Human-Object Interactions from RGB Videos: An Empirical Analysis of Approaches and ChallengesCode1
RLIP: Relational Language-Image Pre-training for Human-Object Interaction DetectionCode1
SR-GNN: Spatial Relation-aware Graph Neural Network for Fine-Grained Image CategorizationCode1
Grounded Affordance from Exocentric ViewCode1
Distance-Aware Occlusion Detection with Focused AttentionCode1
Mining Cross-Person Cues for Body-Part Interactiveness Learning in HOI DetectionCode1
Geometric Features Informed Multi-person Human-object Interaction Recognition in VideosCode1
Towards Hard-Positive Query Mining for DETR-based Human-Object Interaction DetectionCode1
Learning Continuous Grasping Function with a Dexterous Hand from Human DemonstrationsCode1
Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction DetectionCode1
Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object InteractionsCode1
RelViT: Concept-guided Vision Transformer for Visual Relational ReasoningCode1
BEHAVE: Dataset and Method for Tracking Human Object InteractionsCode1
End-to-End Zero-Shot HOI Detection via Vision and Language Knowledge DistillationCode1
Discovering Human-Object Interaction Concepts via Self-Compositional LearningCode1
GEN-VLKT: Simplify Association and Enhance Interaction Understanding for HOI DetectionCode1
Learning Affordance Grounding from Exocentric ImagesCode1
HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object InteractionCode1
Detecting Human-Object Interactions with Object-Guided Cross-Modal Calibrated SemanticsCode1
Learning Transferable Human-Object Interaction Detector With Natural Language SupervisionCode1
QAHOI: Query-Based Anchors for Human-Object Interaction DetectionCode1
Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise TransformerCode1
Virtual Multi-Modality Self-Supervised Foreground Matting for Human-Object InteractionCode1
Weakly Supervised Human-Object Interaction Detection in Video via Contrastive Spatiotemporal RegionsCode1
ACP++: Action Co-occurrence Priors for Human-Object Interaction DetectionCode1
Exploiting Scene Graphs for Human-Object Interaction DetectionCode1
D3D-HOI: Dynamic 3D Human-Object Interactions from VideosCode1
Mining the Benefits of Two-stage and One-stage HOI DetectionCode1
GTNet:Guided Transformer Network for Detecting Human-Object InteractionsCode1
Spot What Matters: Learning Context Using Graph Convolutional Networks for Weakly-Supervised Action DetectionCode1
Dynamics-Regulated Kinematic Policy for Egocentric Pose EstimationCode1
ST-HOI: A Spatial-Temporal Baseline for Human-Object Interaction Detection in VideosCode1
HOTR: End-to-End Human-Object Interaction Detection with TransformersCode1
Glance and Gaze: Inferring Action-aware Points for One-Stage Human-Object Interaction DetectionCode1
Affordance Transfer Learning for Human-Object Interaction DetectionCode1
Detecting Human-Object Interaction via Fabricated Compositional LearningCode1
Reformulating HOI Detection as Adaptive Set PredictionCode1
QPIC: Query-Based Pairwise Human-Object Interaction Detection with Image-Wide Contextual InformationCode1
End-to-End Human Object Interaction Detection with HOI TransformerCode1
In Defense of Scene Graphs for Image CaptioningCode1
Transferable Interactiveness Knowledge for Human-Object Interaction DetectionCode1
Interaction Compass: Multi-Label Zero-Shot Learning of Human-Object Interactions via Spatial RelationsCode1
LIGHTEN: Learning Interactions with Graph and Hierarchical TEmporal Networks for HOI in videosCode1
Spatially Conditioned Graphs for Detecting Human-Object InteractionsCode1
HOI Analysis: Integrating and Decomposing Human-Object InteractionCode1
The MECCANO Dataset: Understanding Human-Object Interactions from Egocentric Videos in an Industrial-like DomainCode1
Show:102550
← PrevPage 2 of 9Next →
All datasetsHICO-DETV-COCOHICOVidHOIAmbiguious-HOIMECCANO

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Ours (PViC+)mAP46.49—Unverified
2RLIPv2 (Swin-L)mAP45.09—Unverified
3PViC-SwinLmAP44.32—Unverified
4SOV-STG (Swin-L)mAP43.35—Unverified
5DiffHOImAP41.5—Unverified
6ViPLOmAP37.22—Unverified
7FGAHOImAP37.18—Unverified
8ERNetmAP36.89—Unverified
9CQL+GEN-VLKT-LmAP36.03—Unverified
10QAHOI (Swin-L)mAP35.78—Unverified
#ModelMetricClaimedVerifiedStatus
1RLIPv2AP(S1)72.1—Unverified
2MURENAP(S1)68.8—Unverified
3STIPAP(S1)66—Unverified
4DiffHOIAP(S1)65.7—Unverified
5OCN (ResNet101)AP(S1)65.3—Unverified
6OCN (ResNet50)AP(S1)64.2—Unverified
7CDN (ResNet101)AP(S1)63.91—Unverified
8HOICLIPAP(S1)63.5—Unverified
9QPIC + CPCMAP63.1—Unverified
10Body Part InteractivenessAP(S1)63—Unverified
#ModelMetricClaimedVerifiedStatus
1DEFRmAP65.6—Unverified
2HAKEmAP47.1—Unverified
3PaStaNetmAP46.3—Unverified
4RelViTmAP43.98—Unverified
5Pairwise-PartmAP39.9—Unverified
6Mallya & LazebnikmAP36.1—Unverified
7Girdhar & RamananmAP34.6—Unverified
8R*CNNmAP28.5—Unverified
#ModelMetricClaimedVerifiedStatus
1HOI4ABOTDetection: Full (mAP@0.5)11.12—Unverified
2ST-GAZEDetection: Full (mAP@0.5)10.4—Unverified
3STTRANDetection: Full (mAP@0.5)7.61—Unverified
#ModelMetricClaimedVerifiedStatus
1DJ-RNmAP10.37—Unverified
2iCANmAP8.14—Unverified
#ModelMetricClaimedVerifiedStatus
1SlowFast + FasterRCNNmAP@0.5 role25.93—Unverified