SOTAVerified

Lightweight Feature Fusion Network for Single Image Super-Resolution

2019-02-15Code Available0· sign in to hype

Wenming Yang, Wei Wang, Xuechen Zhang, Shuifa Sun, Qingmin Liao

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Single image super-resolution(SISR) has witnessed great progress as convolutional neural network(CNN) gets deeper and wider. However, enormous parameters hinder its application to real world problems. In this letter, We propose a lightweight feature fusion network (LFFN) that can fully explore multi-scale contextual information and greatly reduce network parameters while maximizing SISR results. LFFN is built on spindle blocks and a softmax feature fusion module (SFFM). Specifically, a spindle block is composed of a dimension extension unit, a feature exploration unit and a feature refinement unit. The dimension extension layer expands low dimension to high dimension and implicitly learns the feature maps which is suitable for the next unit. The feature exploration unit performs linear and nonlinear feature exploration aimed at different feature maps. The feature refinement layer is used to fuse and refine features. SFFM fuses the features from different modules in a self-adaptive learning manner with softmax function, making full use of hierarchical information with a small amount of parameter cost. Both qualitative and quantitative experiments on benchmark datasets show that LFFN achieves favorable performance against state-of-the-art methods with similar parameters.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
BSD100 - 2x upscalingLFFN-SPSNR31.96Unverified
BSD100 - 3x upscalingLFFN-SPSNR28.91Unverified
BSD100 - 4x upscalingLFFN-SPSNR27.42Unverified
Manga109 - 2x upscalingLFFN-SPSNR37.93Unverified
Manga109 - 3x upscalingLFFN-SPSNR32.8Unverified
Manga109 - 4x upscalingLFFN-SSSIM0.9Unverified
Set5 - 2x upscalingLFFN-SPSNR37.66Unverified
Set5 - 3x upscalingLFFN-SPSNR34.04Unverified

Reproductions