SOTAVerified

Feedback Network for Image Super-Resolution

2019-03-23CVPR 2019Code Available0· sign in to hype

Zhen Li, Jinglei Yang, Zheng Liu, Xiaomin Yang, Gwanggil Jeon, Wei Wu

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Recent advances in image super-resolution (SR) explored the power of deep learning to achieve a better reconstruction performance. However, the feedback mechanism, which commonly exists in human visual system, has not been fully exploited in existing deep learning based image SR methods. In this paper, we propose an image super-resolution feedback network (SRFBN) to refine low-level representations with high-level information. Specifically, we use hidden states in an RNN with constraints to achieve such feedback manner. A feedback block is designed to handle the feedback connections and to generate powerful high-level representations. The proposed SRFBN comes with a strong early reconstruction ability and can create the final high-resolution image step by step. In addition, we introduce a curriculum learning strategy to make the network well suitable for more complicated tasks, where the low-resolution images are corrupted by multiple types of degradation. Extensive experimental results demonstrate the superiority of the proposed SRFBN in comparison with the state-of-the-art methods. Code is avaliable at https://github.com/Paper99/SRFBN_CVPR19.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
BSD100 - 2x upscalingSRFBNPSNR32.29Unverified
BSD100 - 3x upscalingSRFBNPSNR29.24Unverified
BSD100 - 4x upscalingSRFBNPSNR27.72Unverified
FFHQ 1024 x 1024 - 4x upscalingSRFBNFID17.14Unverified
FFHQ 256 x 256 - 4x upscalingSRFBNFID132.59Unverified
FFHQ 512 x 512 - 4x upscalingSRFBNPSNR29.58Unverified
Manga109 - 2x upscalingSRFBNPSNR39.08Unverified
Manga109 - 3x upscalingSRFBNPSNR34.18Unverified
Manga109 - 4x upscalingSRFBNSSIM0.92Unverified
Set14 - 2x upscalingSRFBNPSNR33.82Unverified
Set14 - 3x upscalingSRFBNPSNR30.1Unverified
Set14 - 4x upscalingSRFBNPSNR28.81Unverified
Set5 - 2x upscalingSRFBNPSNR38.11Unverified
Set5 - 3x upscalingSRFBNPSNR34.7Unverified
Urban100 - 2x upscalingSRFBNPSNR32.62Unverified
Urban100 - 3x upscalingSRFBNPSNR28.73Unverified
Urban100 - 4x upscalingSRFBNPSNR26.6Unverified

Reproductions