SOTAVerified

ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks

2018-09-01Code Available3· sign in to hype

Xintao Wang, Ke Yu, Shixiang Wu, Jinjin Gu, Yihao Liu, Chao Dong, Chen Change Loy, Yu Qiao, Xiaoou Tang

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

The Super-Resolution Generative Adversarial Network (SRGAN) is a seminal work that is capable of generating realistic textures during single image super-resolution. However, the hallucinated details are often accompanied with unpleasant artifacts. To further enhance the visual quality, we thoroughly study three key components of SRGAN - network architecture, adversarial loss and perceptual loss, and improve each of them to derive an Enhanced SRGAN (ESRGAN). In particular, we introduce the Residual-in-Residual Dense Block (RRDB) without batch normalization as the basic network building unit. Moreover, we borrow the idea from relativistic GAN to let the discriminator predict relative realness instead of the absolute value. Finally, we improve the perceptual loss by using the features before activation, which could provide stronger supervision for brightness consistency and texture recovery. Benefiting from these improvements, the proposed ESRGAN achieves consistently better visual quality with more realistic and natural textures than SRGAN and won the first place in the PIRM2018-SR Challenge. The code is available at https://github.com/xinntao/ESRGAN .

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
BSD100 - 4x upscalingSRGAN + Residual-in-Residual Dense BlockPSNR27.85Unverified
FFHQ 1024 x 1024 - 4x upscalingESRGANFID72.73Unverified
FFHQ 256 x 256 - 4x upscalingESRGANFID166.36Unverified
FFHQ 512 x 512 - 4x upscalingESRGANPSNR27.13Unverified
Manga109 - 4x upscalingSRGAN + Residual-in-Residual Dense BlockSSIM0.92Unverified
Manga109 - 4x upscalingbicubicSSIM0.79Unverified
PIRM-testESRGANNIQE2.55Unverified
Set14 - 4x upscalingSRGAN + Residual-in-Residual Dense BlockPSNR28.99Unverified
Urban100 - 4x upscalingbicubicPSNR23.14Unverified
Urban100 - 4x upscalingSRGAN + Residual-in-Residual Dense BlockPSNR27.03Unverified

Reproductions