SOTAVerified

Signature and Log-signature for the Study of Empirical Distributions Generated with GANs

2022-03-07Code Available0· sign in to hype

Joaquim de Curtò, Irene de Zarzà, Hong Yan, Carlos T. Calafate

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

In this paper, we bring forward the use of the recently developed Signature Transform as a way to measure the similarity between image distributions and provide detailed acquaintance and extensive evaluations. We are the first to pioneer RMSE and MAE Signature, along with log-signature as an alternative to measure GAN convergence, a problem that has been extensively studied. We are also forerunners to introduce analytical measures based on statistics to study the goodness of fit of the GAN sample distribution that are both efficient and effective. Current GAN measures involve lots of computation normally done at the GPU and are very time consuming. In contrast, we diminish the computation time to the order of seconds and computation is done at the CPU achieving the same level of goodness. Lastly, a PCA adaptive t-SNE approach, which is novel in this context, is also proposed for data visualization.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
AFHQ CatStylegan2-ada (NVIDIA pre-trained)MAE Signature45,968Unverified
AFHQ DogStylegan2-ada (NVIDIA pre-trained)MAE Signature30,441Unverified
AFHQ WildStylegan2-ada (NVIDIA pre-trained)MAE Signature25,578Unverified
MetFacest-Stylegan3-ada (NVIDIA pre-trained)MAE Signature19,872Unverified
MetFacesr-Stylegan3-ada (NVIDIA pre-trained)MAE Signature22,799Unverified
MetFacesStylegan2-ada (NVIDIA pre-trained)MAE Signature23,428Unverified
NASA PerseveranceStylegan2-adaMAE Signature9,086Unverified

Reproductions