SOTAVerified

Out-of-Distribution Detection Using Outlier Detection Methods

2021-08-18Code Available0· sign in to hype

Jan Diers, Christian Pigorsch

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Out-of-distribution detection (OOD) deals with anomalous input to neural networks. In the past, specialized methods have been proposed to reject predictions on anomalous input. Similarly, it was shown that feature extraction models in combination with outlier detection algorithms are well suited to detect anomalous input. We use outlier detection algorithms to detect anomalous input as reliable as specialized methods from the field of OOD. No neural network adaptation is required; detection is based on the model's softmax score. Our approach works unsupervised using an Isolation Forest and can be further improved by using a supervised learning method such as Gradient Boosting.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
CIFAR-10 vs CIFAR-100Isolation Forest on EfficientNet Softmax valuesAUROC91.95Unverified

Reproductions