Noise2Info: Noisy Image to Information of Noise for Self-Supervised Image Denoising

Code

• github.com/dominatorX/Noise2Info-code
  Officialtf★ 3

Abstract

Unsupervised image denoising has been proposed to alleviate the widespread noise problem without requiring clean images. Existing works mainly follow the self-supervised way, which tries to reconstruct each pixel x of noisy images without the knowledge of x. More recently, some pioneer works further emphasize the importance of x and propose to weigh the information extracted from x and other pixels when recovering x. However, such a method is highly sensitive to the standard deviation _n of noises injected to clean images, where _n is inaccessible without knowing clean images. Thus, it is unrealistic to assume that _n is known for pursuing high model performance. To alleviate this issue, we propose Noise2Info to extract the critical information, the standard deviation _n of injected noise, only based on the noisy images. Specifically, we first theoretically provide an upper bound on _n, while the bound requires clean images. Then, we propose a novel method to estimate the bound of _n by only using noisy images. Besides, we prove that the difference between our estimation with the true deviation goes smaller as the model training. Empirical studies show that Noise2Info is effective and robust on benchmark data sets and closely estimates the standard deviation of noises during model training.

Tasks

Reproductions