SOTAVerified

ID-Blau: Image Deblurring by Implicit Diffusion-based reBLurring AUgmentation

2023-12-18CVPR 2024Code Available1· sign in to hype

Jia-Hao Wu, Fu-Jen Tsai, Yan-Tsung Peng, Chung-Chi Tsai, Chia-Wen Lin, Yen-Yu Lin

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Image deblurring aims to remove undesired blurs from an image captured in a dynamic scene. Much research has been dedicated to improving deblurring performance through model architectural designs. However, there is little work on data augmentation for image deblurring. Since continuous motion causes blurred artifacts during image exposure, we aspire to develop a groundbreaking blur augmentation method to generate diverse blurred images by simulating motion trajectories in a continuous space. This paper proposes Implicit Diffusion-based reBLurring AUgmentation (ID-Blau), utilizing a sharp image paired with a controllable blur condition map to produce a corresponding blurred image. We parameterize the blur patterns of a blurred image with their orientations and magnitudes as a pixel-wise blur condition map to simulate motion trajectories and implicitly represent them in a continuous space. By sampling diverse blur conditions, ID-Blau can generate various blurred images unseen in the training set. Experimental results demonstrate that ID-Blau can produce realistic blurred images for training and thus significantly improve performance for state-of-the-art deblurring models. The source code is available at https://github.com/plusgood-steven/ID-Blau.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
GoProID-Blau (FFTformer)PSNR34.36Unverified
GoProID-Blau (Restormer)PSNR33.51Unverified
GoProID-Blau (Stripformer)PSNR33.66Unverified
HIDE (trained on GOPRO)ID-Blau (Stripformer)PSNR (sRGB)31.5Unverified
HIDE (trained on GOPRO)ID-Blau (FFTformer)PSNR (sRGB)31.94Unverified
HIDE (trained on GOPRO)ID-Blau (Restormer)PSNR (sRGB)31.66Unverified
RealBlur-JID-Blau (FFTformer)PSNR (sRGB)32.88Unverified
RealBlur-JID-Blau (Restormer)PSNR (sRGB)33.11Unverified
RealBlur-JID-Blau (Stripformer)PSNR (sRGB)33.77Unverified
RealBlur-RID-Blau (Stripformer)PSNR (sRGB)41.06Unverified
RealBlur-RID-Blau (FFTformer)PSNR (sRGB)40.45Unverified
RealBlur-RID-Blau (Restormer)PSNR (sRGB)40.31Unverified

Reproductions