RMPE: Regional Multi-person Pose Estimation
Hao-Shu Fang, Shuqin Xie, Yu-Wing Tai, Cewu Lu
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/MVIG-SJTU/AlphaPosepytorch★ 8,536
- github.com/osmr/imgclsmobmxnet★ 3,015
- github.com/lyqcom/alphaposemindspore★ 0
- github.com/yangyucheng000/AlphaPosemindspore★ 0
- github.com/Fangyh09/pose_nmsnone★ 0
- github.com/2023-MindSpore-4/Code8/tree/main/AlphaPosemindspore★ 0
- github.com/MVIG-SJTU/RMPEtorch★ 0
- github.com/ManifoldFR/recvis-projecttf★ 0
- github.com/MattyChoi/PoseMachinespytorch★ 0
- github.com/mindspore-ai/models/tree/master/research/cv/AlphaPosemindspore★ 0
Abstract
Multi-person pose estimation in the wild is challenging. Although state-of-the-art human detectors have demonstrated good performance, small errors in localization and recognition are inevitable. These errors can cause failures for a single-person pose estimator (SPPE), especially for methods that solely depend on human detection results. In this paper, we propose a novel regional multi-person pose estimation (RMPE) framework to facilitate pose estimation in the presence of inaccurate human bounding boxes. Our framework consists of three components: Symmetric Spatial Transformer Network (SSTN), Parametric Pose Non-Maximum-Suppression (NMS), and Pose-Guided Proposals Generator (PGPG). Our method is able to handle inaccurate bounding boxes and redundant detections, allowing it to achieve a 17% increase in mAP over the state-of-the-art methods on the MPII (multi person) dataset.Our model and source codes are publicly available.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| CrowdPose | AlphaPose | mAP @0.5:0.95 | 61 | — | Unverified |
| MPII Multi-Person | AlphaPose | AP | 82.1 | — | Unverified |