Towards Faster and Stabilized GAN Training for High-fidelity Few-shot Image Synthesis
Bingchen Liu, Yizhe Zhu, Kunpeng Song, Ahmed Elgammal
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/odegeasslbc/FastGAN-pytorchOfficialIn paperpytorch★ 0
- github.com/gaborvecsei/SLE-GANtf★ 70
- github.com/reyllama/mixdlpytorch★ 26
- github.com/milmor/self-supervised-gantf★ 6
- github.com/silentz/Towards-Faster-And-Stabilized-GAN-Training-For-High-Fidelity-Few-Shot-Image-Synthesispytorch★ 2
- github.com/palandr1234/exploring-gan-latent-spacespytorch★ 0
- github.com/lucidrains/lightweight-ganpytorch★ 0
Abstract
Training Generative Adversarial Networks (GAN) on high-fidelity images usually requires large-scale GPU-clusters and a vast number of training images. In this paper, we study the few-shot image synthesis task for GAN with minimum computing cost. We propose a light-weight GAN structure that gains superior quality on 1024*1024 resolution. Notably, the model converges from scratch with just a few hours of training on a single RTX-2080 GPU, and has a consistent performance, even with less than 100 training samples. Two technique designs constitute our work, a skip-layer channel-wise excitation module and a self-supervised discriminator trained as a feature-encoder. With thirteen datasets covering a wide variety of image domains (The datasets and code are available at: https://github.com/odegeasslbc/FastGAN-pytorch), we show our model's superior performance compared to the state-of-the-art StyleGAN2, when data and computing budget are limited.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| ADE-Indoor | FastGAN | FID | 30.33 | — | Unverified |
| Pokemon 1024x1024 | FastGAN | FID | 56.46 | — | Unverified |
| Pokemon 256x256 | FastGAN | FID | 81.86 | — | Unverified |