SOTAVerified

Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Showing 150 of 449 papers

TitleStatusHype
Open-Set Image Tagging with Multi-Grained Text SupervisionCode4
Human-Humanoid Robots Cross-Embodiment Behavior-Skill Transfer Using Decomposed Adversarial Learning from DemonstrationCode4
SkillMimic: Learning Basketball Interaction Skills from DemonstrationsCode3
InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object InteractionsCode3
DexTrack: Towards Generalizable Neural Tracking Control for Dexterous Manipulation from Human ReferencesCode2
Space-time 2D Gaussian Splatting for Accurate Surface Reconstruction under Complex Dynamic ScenesCode2
InterDiff: Generating 3D Human-Object Interactions with Physics-Informed DiffusionCode2
Beyond the Contact: Discovering Comprehensive Affordance for 3D Objects from Pre-trained 2D Diffusion ModelsCode2
RAM: Retrieval-Based Affordance Transfer for Generalizable Zero-Shot Robotic ManipulationCode2
CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangementCode2
InterFusion: Text-Driven Generation of 3D Human-Object InteractionCode2
HAKE: A Knowledge Engine Foundation for Human Activity UnderstandingCode2
VolumetricSMPL: A Neural Volumetric Body Model for Efficient Interactions, Contacts, and CollisionsCode2
Geometric Features Informed Multi-person Human-object Interaction Recognition in VideosCode1
First Place Solution to the CVPR'2023 AQTC Challenge: A Function-Interaction Centric Approach with Spatiotemporal Visual-Language AlignmentCode1
Glance and Focus: Memory Prompting for Multi-Event Video Question AnsweringCode1
Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction DetectionCode1
Exploiting Scene Graphs for Human-Object Interaction DetectionCode1
Exploring the Potential of Large Foundation Models for Open-Vocabulary HOI DetectionCode1
Glance and Gaze: Inferring Action-aware Points for One-Stage Human-Object Interaction DetectionCode1
Efficient Adaptive Human-Object Interaction Detection with Concept-guided MemoryCode1
Distance-Aware Occlusion Detection with Focused AttentionCode1
End-to-End Zero-Shot HOI Detection via Vision and Language Knowledge DistillationCode1
Explanation-based Weakly-supervised Learning of Visual Relations with Graph NetworksCode1
Exploring Predicate Visual Context in Detecting Human-Object InteractionsCode1
BEHAVE: Dataset and Method for Tracking Human Object InteractionsCode1
EZ-HOI: VLM Adaptation via Guided Prompt Learning for Zero-Shot HOI DetectionCode1
FGAHOI: Fine-Grained Anchors for Human-Object Interaction DetectionCode1
From My View to Yours: Ego-Augmented Learning in Large Vision Language Models for Understanding Exocentric Daily Living ActivitiesCode1
GEN-VLKT: Simplify Association and Enhance Interaction Understanding for HOI DetectionCode1
Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise TransformerCode1
Discovering A Variety of Objects in Spatio-Temporal Human-Object InteractionsCode1
Diagnosing Human-object Interaction DetectorsCode1
Discovering Human Interactions With Novel Objects via Zero-Shot LearningCode1
EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level PlanningCode1
Category Query Learning for Human-Object Interaction ClassificationCode1
Articulated 3D Human-Object Interactions from RGB Videos: An Empirical Analysis of Approaches and ChallengesCode1
Detecting Human-Object Interactions with Action Co-occurrence PriorsCode1
Detecting Human-Object Interaction via Fabricated Compositional LearningCode1
Cascaded Human-Object Interaction RecognitionCode1
DIRV: Dense Interaction Region Voting for End-to-End Human-Object Interaction DetectionCode1
Full-Body Articulated Human-Object InteractionCode1
Discovering Human-Object Interaction Concepts via Self-Compositional LearningCode1
Disentangled Pre-training for Human-Object Interaction DetectionCode1
DRG: Dual Relation Graph for Human-Object Interaction DetectionCode1
Dynamics-Regulated Kinematic Policy for Egocentric Pose EstimationCode1
ACP++: Action Co-occurrence Priors for Human-Object Interaction DetectionCode1
ConsNet: Learning Consistency Graph for Zero-Shot Human-Object Interaction DetectionCode1
Auto-Regressive Diffusion for Generating 3D Human-Object InteractionsCode1
Affordance Transfer Learning for Human-Object Interaction DetectionCode1
Show:102550
← PrevPage 1 of 9Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Ours (PViC+)mAP46.49Unverified
2RLIPv2 (Swin-L)mAP45.09Unverified
3PViC-SwinLmAP44.32Unverified
4SOV-STG (Swin-L)mAP43.35Unverified
5DiffHOImAP41.5Unverified
6ViPLOmAP37.22Unverified
7FGAHOImAP37.18Unverified
8ERNetmAP36.89Unverified
9CQL+GEN-VLKT-LmAP36.03Unverified
10QAHOI (Swin-L)mAP35.78Unverified
#ModelMetricClaimedVerifiedStatus
1RLIPv2AP(S1)72.1Unverified
2MURENAP(S1)68.8Unverified
3STIPAP(S1)66Unverified
4DiffHOIAP(S1)65.7Unverified
5OCN (ResNet101)AP(S1)65.3Unverified
6OCN (ResNet50)AP(S1)64.2Unverified
7CDN (ResNet101)AP(S1)63.91Unverified
8HOICLIPAP(S1)63.5Unverified
9QPIC + CPCMAP63.1Unverified
10Body Part InteractivenessAP(S1)63Unverified
#ModelMetricClaimedVerifiedStatus
1DEFRmAP65.6Unverified
2HAKEmAP47.1Unverified
3PaStaNetmAP46.3Unverified
4RelViTmAP43.98Unverified
5Pairwise-PartmAP39.9Unverified
6Mallya & LazebnikmAP36.1Unverified
7Girdhar & RamananmAP34.6Unverified
8R*CNNmAP28.5Unverified
#ModelMetricClaimedVerifiedStatus
1HOI4ABOTDetection: Full (mAP@0.5)11.12Unverified
2ST-GAZEDetection: Full (mAP@0.5)10.4Unverified
3STTRANDetection: Full (mAP@0.5)7.61Unverified
#ModelMetricClaimedVerifiedStatus
1DJ-RNmAP10.37Unverified
2iCANmAP8.14Unverified
#ModelMetricClaimedVerifiedStatus
1SlowFast + FasterRCNNmAP@0.5 role25.93Unverified