SOTAVerified

Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 251–300 of 449 papers

TitleStatusHype
RLIP: Relational Language-Image Pre-training for Human-Object Interaction DetectionCode1
Grounded Affordance from Exocentric ViewCode1
Distance-Aware Occlusion Detection with Focused AttentionCode1
DropKey—0
Mining Cross-Person Cues for Body-Part Interactiveness Learning in HOI DetectionCode1
SAVCHOI: Detecting Suspicious Activities using Dense Video Captioning with Human Object Interactions—0
Geometric Features Informed Multi-person Human-object Interaction Recognition in VideosCode1
Knowledge Guided Bidirectional Attention Network for Human-Object Interaction Detection—0
Towards Hard-Positive Query Mining for DETR-based Human-Object Interaction DetectionCode1
A Skeleton-aware Graph Convolutional Network for Human-Object Interaction DetectionCode0
Learning Continuous Grasping Function with a Dexterous Hand from Human DemonstrationsCode1
Learning Structured Representations of Visual Scenes—0
Chairs Can be Stood on: Overcoming Object Bias in Human-Object Interaction DetectionCode0
Distance Matters in Human-Object Interaction DetectionCode0
Learn to Predict How Humans Manipulate Large-sized Objects from Interactive Motions—0
Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction DetectionCode1
Precise Affordance Annotation for Egocentric Action Video Datasets—0
Spatial Parsing and Dynamic Temporal Pooling networks for Human-Object Interaction detection—0
Video-based Human-Object Interaction Detection from Tubelet Tokens—0
Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object InteractionsCode1
Interaction Replica: Tracking Human-Object Interaction and Scene Changes From Human Motion—0
COUCH: Towards Controllable Human-Chair Interactions—0
RelViT: Concept-guided Vision Transformer for Visual Relational ReasoningCode1
Persistent-Transient Duality in Human Behavior Modeling—0
Human-Object Interaction Detection via Disentangled Transformer—0
THORN: Temporal Human-Object Relation Network for Action Recognition—0
Interactiveness Field in Human-Object InteractionsCode0
Egocentric Human-Object Interaction Detection Exploiting Synthetic DataCode0
BEHAVE: Dataset and Method for Tracking Human Object InteractionsCode1
Consistency Learning via Decoding Path Augmentation for Transformers in Human Object Interaction DetectionCode0
Category-Aware Transformer Network for Better Human-Object Interaction Detection—0
What to look at and where: Semantic and Spatial Refined Transformer for detecting human-object interactions—0
End-to-End Zero-Shot HOI Detection via Vision and Language Knowledge DistillationCode1
MSTR: Multi-Scale Transformer for End-to-End Human-Object Interaction Detection—0
Discovering Human-Object Interaction Concepts via Self-Compositional LearningCode1
GEN-VLKT: Simplify Association and Enhance Interaction Understanding for HOI DetectionCode1
Iwin: Human-Object Interaction Detection via Transformer with Irregular Windows—0
Learning Affordance Grounding from Exocentric ImagesCode1
The Overlooked Classifier in Human-Object Interaction Recognition—0
HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object InteractionCode1
NeuralHOFusion: Neural Volumetric Rendering under Human-object Interactions—0
Effective Actor-centric Human-object Interaction Detection—0
Highlighting Object Category Immunity for the Generalization of Human-Object Interaction DetectionCode0
HAKE: A Knowledge Engine Foundation for Human Activity UnderstandingCode2
Webly Supervised Concept Expansion for General Purpose Vision Models—0
Multi-Stage Deep Transfer Learning for EmIoT-enabled Human-Computer Interaction—0
DexVIP: Learning Dexterous Grasping with Human Hand Pose Priors from Video—0
Detecting Human-Object Interactions with Object-Guided Cross-Modal Calibrated SemanticsCode1
Complex Video Action Reasoning via Learnable Markov Logic Network—0
Learning Transferable Human-Object Interaction Detector With Natural Language SupervisionCode1
Show:102550
← PrevPage 6 of 9Next →
All datasetsHICO-DETV-COCOHICOVidHOIAmbiguious-HOIMECCANO

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Ours (PViC+)mAP46.49—Unverified
2RLIPv2 (Swin-L)mAP45.09—Unverified
3PViC-SwinLmAP44.32—Unverified
4SOV-STG (Swin-L)mAP43.35—Unverified
5DiffHOImAP41.5—Unverified
6ViPLOmAP37.22—Unverified
7FGAHOImAP37.18—Unverified
8ERNetmAP36.89—Unverified
9CQL+GEN-VLKT-LmAP36.03—Unverified
10QAHOI (Swin-L)mAP35.78—Unverified
#ModelMetricClaimedVerifiedStatus
1RLIPv2AP(S1)72.1—Unverified
2MURENAP(S1)68.8—Unverified
3STIPAP(S1)66—Unverified
4DiffHOIAP(S1)65.7—Unverified
5OCN (ResNet101)AP(S1)65.3—Unverified
6OCN (ResNet50)AP(S1)64.2—Unverified
7CDN (ResNet101)AP(S1)63.91—Unverified
8HOICLIPAP(S1)63.5—Unverified
9QPIC + CPCMAP63.1—Unverified
10Body Part InteractivenessAP(S1)63—Unverified
#ModelMetricClaimedVerifiedStatus
1DEFRmAP65.6—Unverified
2HAKEmAP47.1—Unverified
3PaStaNetmAP46.3—Unverified
4RelViTmAP43.98—Unverified
5Pairwise-PartmAP39.9—Unverified
6Mallya & LazebnikmAP36.1—Unverified
7Girdhar & RamananmAP34.6—Unverified
8R*CNNmAP28.5—Unverified
#ModelMetricClaimedVerifiedStatus
1HOI4ABOTDetection: Full (mAP@0.5)11.12—Unverified
2ST-GAZEDetection: Full (mAP@0.5)10.4—Unverified
3STTRANDetection: Full (mAP@0.5)7.61—Unverified
#ModelMetricClaimedVerifiedStatus
1DJ-RNmAP10.37—Unverified
2iCANmAP8.14—Unverified
#ModelMetricClaimedVerifiedStatus
1SlowFast + FasterRCNNmAP@0.5 role25.93—Unverified