SOTAVerified

Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data

2021-07-22Code Available4· sign in to hype

Xintao Wang, Liangbin Xie, Chao Dong, Ying Shan

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Though many attempts have been made in blind super-resolution to restore low-resolution images with unknown and complex degradations, they are still far from addressing general real-world degraded images. In this work, we extend the powerful ESRGAN to a practical restoration application (namely, Real-ESRGAN), which is trained with pure synthetic data. Specifically, a high-order degradation modeling process is introduced to better simulate complex real-world degradations. We also consider the common ringing and overshoot artifacts in the synthesis process. In addition, we employ a U-Net discriminator with spectral normalization to increase discriminator capability and stabilize the training dynamics. Extensive comparisons have shown its superior visual performance than prior works on various real datasets. We also provide efficient implementations to synthesize training pairs on the fly.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
MSU Super-Resolution for Video CompressionReal-ESRGAN + x264BSQ-rate over Subjective Score0.34Unverified
MSU Super-Resolution for Video CompressionReal-ESRGAN + vvencBSQ-rate over ERQA6.71Unverified
MSU Super-Resolution for Video CompressionReal-ESRGAN + uavs3eBSQ-rate over Subjective Score1.42Unverified
MSU Super-Resolution for Video CompressionReal-ESRGAN + aomencBSQ-rate over Subjective Score1.4Unverified
MSU Super-Resolution for Video CompressionReal-ESRGAN + x265BSQ-rate over Subjective Score0.64Unverified
MSU Video Super Resolution Benchmark: Detail RestorationReal-ESRnetSubjective score3.7Unverified
MSU Video Super Resolution Benchmark: Detail RestorationReal-ESRGANSubjective score5.39Unverified
MSU Video Upscalers: Quality EnhancementRealEsrnetLPIPS0.3Unverified
MSU Video Upscalers: Quality EnhancementRealEsrnet-FLPIPS0.28Unverified
MSU Video Upscalers: Quality EnhancementRealEsrgan-ALPIPS0.24Unverified
MSU Video Upscalers: Quality EnhancementRealEsrgan-FLPIPS0.19Unverified
MSU Video Upscalers: Quality EnhancementRealEsrganLPIPS0.18Unverified
MSU Video Upscalers: Quality EnhancementRealEsrgan-VLPIPS0.33Unverified

Reproductions