SOTAVerified

Deep Back-Projection Networks for Single Image Super-resolution

2019-04-04Code Available0· sign in to hype

Muhammad Haris, Greg Shakhnarovich, Norimichi Ukita

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Previous feed-forward architectures of recently proposed deep super-resolution networks learn the features of low-resolution inputs and the non-linear mapping from those to a high-resolution output. However, this approach does not fully address the mutual dependencies of low- and high-resolution images. We propose Deep Back-Projection Networks (DBPN), the winner of two image super-resolution challenges (NTIRE2018 and PIRM2018), that exploit iterative up- and down-sampling layers. These layers are formed as a unit providing an error feedback mechanism for projection errors. We construct mutually-connected up- and down-sampling units each of which represents different types of low- and high-resolution components. We also show that extending this idea to demonstrate a new insight towards more efficient network design substantially, such as parameter sharing on the projection module and transition layer on projection step. The experimental results yield superior results and in particular establishing new state-of-the-art results across multiple data sets, especially for large scaling factors such as 8x.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
BSDS100 - 2x upscalingDBPN-RES-MR64-3PSNR32.31Unverified
BSDS100 - 4x upscalingDBPN-RES-MR64-3PSNR27.82Unverified
BSDS100 - 8x upscalingDBPN-RES-MR64-3PSNR25.05Unverified
Manga109 - 2x upscalingDBPN-RES-MR64-3PSNR39.28Unverified
Manga109 - 4x upscalingDBPN-RES-MR64-3SSIM0.92Unverified
Manga109 - 8x upscalingDBPN-RES-MR64-3PSNR25.71Unverified
Set14 - 2x upscalingDBPN-RES-MR64-3PSNR34.09Unverified
Set14 - 4x upscalingDBPN-RES-MR64-3PSNR29.03Unverified
Set14 - 8x upscalingDBPN-RES-MR64-3PSNR25.41Unverified
Set5 - 2x upscalingDBPN-RES-MR64-3PSNR38.08Unverified
Set5 - 8x upscalingDBPN-RES-MR64-3PSNR27.51Unverified
Urban100 - 2x upscalingDBPN-RES-MR64-3PSNR32.92Unverified
Urban100 - 4x upscalingDBPN-RES-MR64-3PSNR27.08Unverified
Urban100 - 8x upscalingDBPN-RES-MR64-3PSNR23.2Unverified

Reproductions