SOTAVerified

Hierarchical Back Projection Network for Image Super-Resolution

2019-06-17Code Available0· sign in to hype

Zhi-Song Liu, Li-Wen Wang, Chu-Tak Li, Wan-Chi Siu

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Deep learning based single image super-resolution methods use a large number of training datasets and have recently achieved great quality progress both quantitatively and qualitatively. Most deep networks focus on nonlinear mapping from low-resolution inputs to high-resolution outputs via residual learning without exploring the feature abstraction and analysis. We propose a Hierarchical Back Projection Network (HBPN), that cascades multiple HourGlass (HG) modules to bottom-up and top-down process features across all scales to capture various spatial correlations and then consolidates the best representation for reconstruction. We adopt the back projection blocks in our proposed network to provide the error correlated up and down-sampling process to replace simple deconvolution and pooling process for better estimation. A new Softmax based Weighted Reconstruction (WR) process is used to combine the outputs of HG modules to further improve super-resolution. Experimental results on various datasets (including the validation dataset, NTIRE2019, of the Real Image Super-resolution Challenge) show that our proposed approach can achieve and improve the performance of the state-of-the-art methods for different scaling factors.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
BSD100 - 2x upscalingHBPNPSNR32.33Unverified
BSD100 - 4x upscalingHBPNPSNR27.77Unverified
BSD100 - 8x upscalingHBPNPSNR24.93Unverified
Manga109 - 2x upscalingHBPNPSNR39.3Unverified
Manga109 - 4x upscalingHBPNSSIM0.92Unverified
Manga109 - 8x upscalingHBPNPSNR25.24Unverified
Set14 - 2x upscalingHBPNPSNR33.78Unverified
Set14 - 4x upscalingHBPNPSNR28.67Unverified
Set14 - 8x upscalingHBPNPSNR24.96Unverified
Set5 - 2x upscalingHBPNPSNR38.13Unverified
Set5 - 8x upscalingHBPNPSNR27.17Unverified
Urban100 - 2x upscalingHBPNPSNR33.12Unverified
Urban100 - 4x upscalingHBPNPSNR27.3Unverified
Urban100 - 8x upscalingHBPNPSNR23.04Unverified

Reproductions