SOTAVerified

ReLU Code Space: A Basis for Rating Network Quality Besides Accuracy

2020-05-20Code Available0· sign in to hype

Natalia Shepeleva, Werner Zellinger, Michal Lewandowski, Bernhard Moser

arXivPDF

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

We propose a new metric space of ReLU activation codes equipped with a truncated Hamming distance which establishes an isometry between its elements and polyhedral bodies in the input space which have recently been shown to be strongly related to safety, robustness, and confidence. This isometry allows the efficient computation of adjacency relations between the polyhedral bodies. Experiments on MNIST and CIFAR-10 indicate that information besides accuracy might be stored in the code space.

Reproductions