SOTAVerified

Single Image Super-Resolution via a Holistic Attention Network

2020-08-20ECCV 2020Code Available1· sign in to hype

Ben Niu, Weilei Wen, Wenqi Ren, Xiangde Zhang, Lianping Yang, Shuzhen Wang, Kaihao Zhang, Xiaochun Cao, Haifeng Shen

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Informative features play a crucial role in the single image super-resolution task. Channel attention has been demonstrated to be effective for preserving information-rich features in each layer. However, channel attention treats each convolution layer as a separate process that misses the correlation among different layers. To address this problem, we propose a new holistic attention network (HAN), which consists of a layer attention module (LAM) and a channel-spatial attention module (CSAM), to model the holistic interdependencies among layers, channels, and positions. Specifically, the proposed LAM adaptively emphasizes hierarchical features by considering correlations among layers. Meanwhile, CSAM learns the confidence at all the positions of each channel to selectively capture more informative features. Extensive experiments demonstrate that the proposed HAN performs favorably against the state-of-the-art single image super-resolution approaches.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
BSD100 - 2x upscalingHAN+PSNR32.45Unverified
BSD100 - 3x upscalingHAN+PSNR29.41Unverified
BSD100 - 4x upscalingHAN+PSNR27.85Unverified
BSD100 - 8x upscalingHAN+PSNR25.04Unverified
Manga109 - 2x upscalingHAN+PSNR39.62Unverified
Manga109 - 3x upscalingHAN+PSNR34.87Unverified
Manga109 - 4x upscalingHAN+SSIM0.92Unverified
Manga109 - 8x upscalingHAN+PSNR25.54Unverified
Set14 - 2x upscalingHAN+PSNR34.24Unverified
Set14 - 3x upscalingHAN+PSNR30.79Unverified
Set14 - 4x upscalingHAN+PSNR28.99Unverified
Set14 - 8x upscalingHAN+PSNR25.39Unverified
Set5 - 2x upscalingHAN+PSNR38.33Unverified
Set5 - 3x upscalingHAN+PSNR34.85Unverified
Set5 - 8x upscalingHAN+PSNR27.47Unverified
Urban100 - 2x upscalingHAN+PSNR33.53Unverified
Urban100 - 3x upscalingHAN+PSNR29.21Unverified
Urban100 - 4x upscalingHAN+PSNR27.02Unverified
Urban100 - 8x upscalingHAN+PSNR23.2Unverified

Reproductions