SOTAVerified

Parsing R-CNN for Instance-Level Human Analysis

2018-11-30CVPR 2019Code Available1· sign in to hype

Lu Yang, Qing Song, Zhihui Wang, Ming Jiang

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Instance-level human analysis is common in real-life scenarios and has multiple manifestations, such as human part segmentation, dense pose estimation, human-object interactions, etc. Models need to distinguish different human instances in the image panel and learn rich features to represent the details of each instance. In this paper, we present an end-to-end pipeline for solving the instance-level human analysis, named Parsing R-CNN. It processes a set of human instances simultaneously through comprehensive considering the characteristics of region-based approach and the appearance of a human, thus allowing representing the details of instances. Parsing R-CNN is very flexible and efficient, which is applicable to many issues in human instance analysis. Our approach outperforms all state-of-the-art methods on CIHP (Crowd Instance-level Human Parsing), MHP v2.0 (Multi-Human Parsing) and DensePose-COCO datasets. Based on the proposed Parsing R-CNN, we reach the 1st place in the COCO 2018 Challenge DensePose Estimation task. Code and models are public available.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
CIHPParsing R-CNN + ResNext101Mean IoU61.1Unverified
MHP v2.0Parsing R-CNN + ResNext101Mean IoU41.8Unverified

Reproductions