SOTAVerified

Human-Object Interaction Detection

Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.

Papers

Showing 201250 of 449 papers

TitleStatusHype
Mining Conditional Part Semantics with Occluded Extrapolation for Human-Object Interaction Detection0
Focusing on what to decode and what to train: SOV Decoding with Specific Target Guided DeNoising and Vision Language AdvisorCode0
HOKEM: Human and Object Keypoint-based Extension Module for Human-Object Interaction Detection0
First Place Solution to the CVPR'2023 AQTC Challenge: A Function-Interaction Centric Approach with Spatiotemporal Visual-Language AlignmentCode1
Exploiting Multimodal Synthetic Data for Egocentric Human-Object Interaction Detection in an Industrial ScenarioCode0
Human-Object Interaction Prediction in Videos through Gaze FollowingCode1
An Abstract Specification of VoxML as an Annotation Language0
Synthesizing Diverse Human Motions in 3D Indoor Scenes0
Boosting Human-Object Interaction Detection with Text-to-Image Diffusion ModelCode1
HICO-DET-SG and V-COCO-SG: New Data Splits for Evaluating the Systematic Generalization Performance of Human-Object Interaction Detection ModelsCode0
Group Activity Recognition via Dynamic Composition and Interaction0
Modelling Spatio-Temporal Interactions for Compositional Action Recognition0
Compositional 3D Human-Object Neural Animation0
What Happened 3 Seconds Ago? Inferring the Past with Thermal ImagingCode1
HOSNeRF: Dynamic Human-Object-Scene Neural Radiance Fields from a Single Video0
Video-based Contrastive Learning on Decision Trees: from Action Recognition to Autism Diagnosis0
ViPLO: Vision Transformer based Pose-Conditioned Self-Loop Graph for Human-Object Interaction DetectionCode1
Relational Context Learning for Human-Object Interaction DetectionCode1
StillFast: An End-to-End Approach for Short-Term Object Interaction AnticipationCode1
Instant-NVR: Instant Neural Volumetric Rendering for Human-object Interactions from Monocular RGBD Stream0
Visibility Aware Human-Object Interaction Tracking from Single RGB Camera0
HOICLIP: Efficient Knowledge Transfer for HOI Detection with Vision-Language ModelsCode1
Category Query Learning for Human-Object Interaction ClassificationCode1
Task-Oriented Human-Object Interactions Generation with Implicit Neural Representations0
Unified Visual Relationship Detection with Vision and Language ModelsCode0
Weakly-Supervised HOI Detection from Interaction Labels Only and Language/Vision-Language Priors0
TMHOI: Translational Model for Human-Object Interaction Detection0
Weakly-supervised HOI Detection via Prior-guided Bi-level Representation Learning0
Fine-grained Affordance Annotation for Egocentric Hand-Object Interaction VideosCode0
ERNet: Efficient and Reliable Human-Object Interaction DetectionCode0
Parallel Reasoning Network for Human-Object Interaction Detection0
FGAHOI: Fine-Grained Anchors for Human-Object Interaction DetectionCode1
Open Set Video HOI detection from Action-Centric Chain-of-Look Prompting0
CHORUS : Learning Canonicalized 3D Human-Object Spatial Relations from Unbounded Synthesized Images0
Open-Category Human-Object Interaction Pre-Training via Language Modeling Framework0
Leverage Interactive Affinity for Affordance LearningCode0
DropKey for Vision Transformer0
Full-Body Articulated Human-Object InteractionCode1
NeuralDome: A Neural Modeling Pipeline on Multi-View Human-Object Interactions0
IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object InteractionsCode1
Interaction Region Visual Transformer for Egocentric Action AnticipationCode0
Exploring State Change Capture of Heterogeneous Backbones @ Ego4D Hands and Objects Challenge 20220
Discovering A Variety of Objects in Spatio-Temporal Human-Object InteractionsCode1
PoseGPT: Quantization-based 3D Human Motion Generation and ForecastingCode1
Visual Object Tracking in First Person Vision0
MECCANO: A Multimodal Egocentric Dataset for Humans Behavior Understanding in the Industrial-like Domain0
Articulated 3D Human-Object Interactions from RGB Videos: An Empirical Analysis of Approaches and ChallengesCode1
Graphing the Future: Activity and Next Active Object Prediction using Graph-based Activity Representations0
Reconstructing Action-Conditioned Human-Object Interactions Using Commonsense Knowledge Priors0
SR-GNN: Spatial Relation-aware Graph Neural Network for Fine-Grained Image CategorizationCode1
Show:102550
← PrevPage 5 of 9Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Ours (PViC+)mAP46.49Unverified
2RLIPv2 (Swin-L)mAP45.09Unverified
3PViC-SwinLmAP44.32Unverified
4SOV-STG (Swin-L)mAP43.35Unverified
5DiffHOImAP41.5Unverified
6ViPLOmAP37.22Unverified
7FGAHOImAP37.18Unverified
8ERNetmAP36.89Unverified
9CQL+GEN-VLKT-LmAP36.03Unverified
10QAHOI (Swin-L)mAP35.78Unverified
#ModelMetricClaimedVerifiedStatus
1RLIPv2AP(S1)72.1Unverified
2MURENAP(S1)68.8Unverified
3STIPAP(S1)66Unverified
4DiffHOIAP(S1)65.7Unverified
5OCN (ResNet101)AP(S1)65.3Unverified
6OCN (ResNet50)AP(S1)64.2Unverified
7CDN (ResNet101)AP(S1)63.91Unverified
8HOICLIPAP(S1)63.5Unverified
9QPIC + CPCMAP63.1Unverified
10Body Part InteractivenessAP(S1)63Unverified
#ModelMetricClaimedVerifiedStatus
1DEFRmAP65.6Unverified
2HAKEmAP47.1Unverified
3PaStaNetmAP46.3Unverified
4RelViTmAP43.98Unverified
5Pairwise-PartmAP39.9Unverified
6Mallya & LazebnikmAP36.1Unverified
7Girdhar & RamananmAP34.6Unverified
8R*CNNmAP28.5Unverified
#ModelMetricClaimedVerifiedStatus
1HOI4ABOTDetection: Full (mAP@0.5)11.12Unverified
2ST-GAZEDetection: Full (mAP@0.5)10.4Unverified
3STTRANDetection: Full (mAP@0.5)7.61Unverified
#ModelMetricClaimedVerifiedStatus
1DJ-RNmAP10.37Unverified
2iCANmAP8.14Unverified
#ModelMetricClaimedVerifiedStatus
1SlowFast + FasterRCNNmAP@0.5 role25.93Unverified