SOTAVerified

Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Showing 301350 of 449 papers

TitleStatusHype
Task-Oriented Human-Object Interactions Generation with Implicit Neural Representations0
Unified Visual Relationship Detection with Vision and Language Models0
Weakly-Supervised HOI Detection from Interaction Labels Only and Language/Vision-Language Priors0
TMHOI: Translational Model for Human-Object Interaction Detection0
Weakly-supervised HOI Detection via Prior-guided Bi-level Representation Learning0
Fine-grained Affordance Annotation for Egocentric Hand-Object Interaction VideosCode0
ERNet: Efficient and Reliable Human-Object Interaction DetectionCode0
Parallel Reasoning Network for Human-Object Interaction Detection0
Leverage Interactive Affinity for Affordance LearningCode0
CHORUS : Learning Canonicalized 3D Human-Object Spatial Relations from Unbounded Synthesized Images0
Open Set Video HOI detection from Action-Centric Chain-of-Look Prompting0
DropKey for Vision Transformer0
Open-Category Human-Object Interaction Pre-Training via Language Modeling Framework0
NeuralDome: A Neural Modeling Pipeline on Multi-View Human-Object Interactions0
Interaction Region Visual Transformer for Egocentric Action AnticipationCode0
Exploring State Change Capture of Heterogeneous Backbones @ Ego4D Hands and Objects Challenge 20220
Visual Object Tracking in First Person Vision0
MECCANO: A Multimodal Egocentric Dataset for Humans Behavior Understanding in the Industrial-like Domain0
Graphing the Future: Activity and Next Active Object Prediction using Graph-based Activity Representations0
Reconstructing Action-Conditioned Human-Object Interactions Using Commonsense Knowledge Priors0
DropKey0
SAVCHOI: Detecting Suspicious Activities using Dense Video Captioning with Human Object Interactions0
Knowledge Guided Bidirectional Attention Network for Human-Object Interaction Detection0
A Skeleton-aware Graph Convolutional Network for Human-Object Interaction DetectionCode0
Learning Structured Representations of Visual Scenes0
Chairs Can be Stood on: Overcoming Object Bias in Human-Object Interaction DetectionCode0
Distance Matters in Human-Object Interaction DetectionCode0
Learn to Predict How Humans Manipulate Large-sized Objects from Interactive Motions0
Precise Affordance Annotation for Egocentric Action Video Datasets0
Spatial Parsing and Dynamic Temporal Pooling networks for Human-Object Interaction detection0
Video-based Human-Object Interaction Detection from Tubelet Tokens0
Interaction Replica: Tracking Human-Object Interaction and Scene Changes From Human Motion0
COUCH: Towards Controllable Human-Chair Interactions0
Persistent-Transient Duality in Human Behavior Modeling0
Human-Object Interaction Detection via Disentangled Transformer0
THORN: Temporal Human-Object Relation Network for Action Recognition0
Interactiveness Field in Human-Object InteractionsCode0
Egocentric Human-Object Interaction Detection Exploiting Synthetic DataCode0
Consistency Learning via Decoding Path Augmentation for Transformers in Human Object Interaction DetectionCode0
Category-Aware Transformer Network for Better Human-Object Interaction Detection0
What to look at and where: Semantic and Spatial Refined Transformer for detecting human-object interactions0
MSTR: Multi-Scale Transformer for End-to-End Human-Object Interaction Detection0
Iwin: Human-Object Interaction Detection via Transformer with Irregular Windows0
The Overlooked Classifier in Human-Object Interaction Recognition0
NeuralHOFusion: Neural Volumetric Rendering under Human-object Interactions0
Effective Actor-centric Human-object Interaction Detection0
Highlighting Object Category Immunity for the Generalization of Human-Object Interaction DetectionCode0
Webly Supervised Concept Expansion for General Purpose Vision Models0
Multi-Stage Deep Transfer Learning for EmIoT-enabled Human-Computer Interaction0
DexVIP: Learning Dexterous Grasping with Human Hand Pose Priors from Video0
Show:102550
← PrevPage 7 of 9Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Ours (PViC+)mAP46.49Unverified
2RLIPv2 (Swin-L)mAP45.09Unverified
3PViC-SwinLmAP44.32Unverified
4SOV-STG (Swin-L)mAP43.35Unverified
5DiffHOImAP41.5Unverified
6ViPLOmAP37.22Unverified
7FGAHOImAP37.18Unverified
8ERNetmAP36.89Unverified
9CQL+GEN-VLKT-LmAP36.03Unverified
10QAHOI (Swin-L)mAP35.78Unverified
#ModelMetricClaimedVerifiedStatus
1RLIPv2AP(S1)72.1Unverified
2MURENAP(S1)68.8Unverified
3STIPAP(S1)66Unverified
4DiffHOIAP(S1)65.7Unverified
5OCN (ResNet101)AP(S1)65.3Unverified
6OCN (ResNet50)AP(S1)64.2Unverified
7CDN (ResNet101)AP(S1)63.91Unverified
8HOICLIPAP(S1)63.5Unverified
9QPIC + CPCMAP63.1Unverified
10Body Part InteractivenessAP(S1)63Unverified
#ModelMetricClaimedVerifiedStatus
1DEFRmAP65.6Unverified
2HAKEmAP47.1Unverified
3PaStaNetmAP46.3Unverified
4RelViTmAP43.98Unverified
5Pairwise-PartmAP39.9Unverified
6Mallya & LazebnikmAP36.1Unverified
7Girdhar & RamananmAP34.6Unverified
8R*CNNmAP28.5Unverified
#ModelMetricClaimedVerifiedStatus
1HOI4ABOTDetection: Full (mAP@0.5)11.12Unverified
2ST-GAZEDetection: Full (mAP@0.5)10.4Unverified
3STTRANDetection: Full (mAP@0.5)7.61Unverified
#ModelMetricClaimedVerifiedStatus
1DJ-RNmAP10.37Unverified
2iCANmAP8.14Unverified
#ModelMetricClaimedVerifiedStatus
1SlowFast + FasterRCNNmAP@0.5 role25.93Unverified