Pyramid Scene Parsing Network
Hengshuang Zhao, Jianping Shi, Xiaojuan Qi, Xiaogang Wang, Jiaya Jia
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/hszhao/PSPNetOfficialIn paperpytorch★ 0
- github.com/tensorflow/modelstf★ 77,694
- github.com/open-mmlab/mmsegmentationpytorch★ 9,690
- github.com/PaddlePaddle/PaddleSegpaddle★ 9,319
- github.com/CSAILVision/semantic-segmentation-pytorchpytorch★ 5,064
- github.com/osmr/imgclsmobmxnet★ 3,015
- github.com/divamgupta/image-segmentation-kerastf★ 3,004
- github.com/manideep2510/eye-in-the-skytf★ 317
- github.com/JanMarcelKezmann/TensorFlow-Advanced-Segmentation-Modelstf★ 157
- github.com/ZFTurbo/segmentation_models_3Dtf★ 137
Abstract
Scene parsing is challenging for unrestricted open vocabulary and diverse scenes. In this paper, we exploit the capability of global context information by different-region-based context aggregation through our pyramid pooling module together with the proposed pyramid scene parsing network (PSPNet). Our global prior representation is effective to produce good quality results on the scene parsing task, while PSPNet provides a superior framework for pixel-level prediction tasks. The proposed approach achieves state-of-the-art performance on various datasets. It came first in ImageNet scene parsing challenge 2016, PASCAL VOC 2012 benchmark and Cityscapes benchmark. A single PSPNet yields new record of mIoU accuracy 85.4% on PASCAL VOC 2012 and accuracy 80.2% on Cityscapes.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| ADE20K | PSPNet (ResNet-152) | Validation mIoU | 43.51 | — | Unverified |
| ADE20K | PSPNet (ResNet-101) | Validation mIoU | 43.29 | — | Unverified |
| ADE20K | PSPNet | Validation mIoU | 44.94 | — | Unverified |
| ADE20K val | PSPNet (ResNet-152) | mIoU | 43.51 | — | Unverified |
| ADE20K val | PSPNet (ResNet-101) | mIoU | 43.29 | — | Unverified |
| BDD100K val | PSPNet | mIoU | 62.3 | — | Unverified |
| Cityscapes test | PSPNet | Mean IoU (class) | 78.4 | — | Unverified |
| Cityscapes test | PSPNet++ | Mean IoU (class) | 80.2 | — | Unverified |
| Cityscapes val | PSPNet (Dilated-ResNet-101) | mIoU | 79.7 | — | Unverified |
| DADA-seg | PSPNet (ResNet-101) | mIoU | 20.1 | — | Unverified |
| DensePASS | PSPNet (ResNet-50) | mIoU | 29.5 | — | Unverified |
| Fine-Grained Grass Segmentation Dataset | PSPNet | mIoU | 47.95 | — | Unverified |
| PASCAL Context | PSPNet (ResNet-101) | mIoU | 47.8 | — | Unverified |
| PASCAL VOC 2012 test | PSPNet (ResNet-101) | Mean IoU | 82.6 | — | Unverified |
| PASCAL VOC 2012 test | PSPNet | Mean IoU | 85.4 | — | Unverified |
| Potsdam | PSPNet | mIoU | 82.98 | — | Unverified |
| ScanNetV2 | PSPNet | Mean IoU | 47.5 | — | Unverified |
| SELMA | PSPNet | mIoU | 68.4 | — | Unverified |
| Trans10K | PSPNet | mIoU | 68.23 | — | Unverified |
| UrbanLF | PSPNet | mIoU (Syn) | 75.78 | — | Unverified |
| US3D | PSNet | mIoU | 73.12 | — | Unverified |
| Vaihingen | PSPNet | mIoU | 76.79 | — | Unverified |