Out-of-Distribution Detection
Detect out-of-distribution or anomalous examples.
Papers
Showing 1–10 of 888 papers
All datasetsImageNet-1k vs TexturesImageNet-1k vs iNaturalistImageNet-1k vs PlacesImageNet-1k vs SUNImageNet-1k vs Curated OODs (avg.)CIFAR-100 vs CIFAR-10CIFAR-10 vs CIFAR-100CIFAR-10ImageNet-1k vs OpenImage-OSTL-10CIFAR-100 vs SVHNADE-OoD
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ViM (BiT) | AUROC | 98.92 | — | Unverified |
| 2 | NAC-UE (ResNet-50) | AUROC | 97.9 | — | Unverified |
| 3 | ASH-S (ResNet-50) | AUROC | 97.6 | — | Unverified |
| 4 | SCALE (ResNet50) | AUROC | 97.37 | — | Unverified |
| 5 | KNN (ResNet-50) | AUROC | 97.18 | — | Unverified |
| 6 | DisCoPatch | AUROC | 96.4 | — | Unverified |
| 7 | NNGuide (ResNet50 w/ ReAct) | AUROC | 96.11 | — | Unverified |
| 8 | NNGuide (RegNet) | AUROC | 95.82 | — | Unverified |
| 9 | ViM (ViT-B/16) | AUROC | 95.34 | — | Unverified |
| 10 | KNN (ResNet-50 SupCon) | AUROC | 94.45 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | CMA(ViT-B/16, NegLabel) | AUROC | 99.62 | — | Unverified |
| 2 | NNGuide (RegNet) | AUROC | 99.57 | — | Unverified |
| 3 | ViM (ViT-B/16) | AUROC | 99.41 | — | Unverified |
| 4 | DisCoPatch | AUROC | 99.1 | — | Unverified |
| 5 | SCALE (ResNet50) | AUROC | 98.17 | — | Unverified |
| 6 | MOS (BiT-S-R101x1) | AUROC | 98.15 | — | Unverified |
| 7 | ASH-S (ResNet-50) | AUROC | 97.87 | — | Unverified |
| 8 | NNGuide (ResNet50 w/ ReAct) | AUROC | 97.7 | — | Unverified |
| 9 | BATS (ResNet-50) | AUROC | 97.67 | — | Unverified |
| 10 | LINe (ResNet-50) | AUROC | 97.56 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | MOOD | AUROC | 88.5 | — | Unverified |
| 2 | RP+GradNorm | FPR95 | 83.29 | — | Unverified |
| 3 | KNN (ResNet-50) | FPR95 | 77.09 | — | Unverified |
| 4 | Watermarking (WRN-40-2 w/ Energy) | FPR95 | 71.85 | — | Unverified |
| 5 | Watermarking (WRN-40-2 w/ MSP) | FPR95 | 70.59 | — | Unverified |
| 6 | DOE | FPR95 | 67.84 | — | Unverified |
| 7 | DML | FPR95 | 61.43 | — | Unverified |
| 8 | GradNorm (ResNetv2-101) | FPR95 | 60.86 | — | Unverified |
| 9 | KNN (ResNet-50 SupCon) | FPR95 | 60.02 | — | Unverified |
| 10 | ReAct (ResNet-50) | FPR95 | 51.56 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | MOOD | AUROC | 89.8 | — | Unverified |
| 2 | DOE | FPR95 | 80.94 | — | Unverified |
| 3 | RP+GradNorm | FPR95 | 73.53 | — | Unverified |
| 4 | KNN (ResNet-50) | FPR95 | 69.53 | — | Unverified |
| 5 | DML | FPR95 | 57.4 | — | Unverified |
| 6 | SHE | FPR95 | 54.19 | — | Unverified |
| 7 | ODIN+UMAP (ResNet-50) | FPR95 | 49.69 | — | Unverified |
| 8 | KNN (ResNet-50 SupCon) | FPR95 | 48.91 | — | Unverified |
| 9 | ReAct (ResNet-50) | FPR95 | 47.69 | — | Unverified |
| 10 | GradNorm (ResNetv2-101) | FPR95 | 46.48 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | MOOD | AUROC | 89.1 | — | Unverified |
| 2 | RP+GradNorm | FPR95 | 70.12 | — | Unverified |
| 3 | DOE | FPR95 | 59.83 | — | Unverified |
| 4 | DML | FPR95 | 54.74 | — | Unverified |
| 5 | ODIN+UMAP (ResNet-50) | FPR95 | 40.94 | — | Unverified |
| 6 | MOS (BiT-S-R101x1) | FPR95 | 39.97 | — | Unverified |
| 7 | MCM (CLIP-L) | FPR95 | 38.17 | — | Unverified |
| 8 | NPOS | FPR95 | 37.93 | — | Unverified |
| 9 | RankFeat (ResNetv2-101) | FPR95 | 36.8 | — | Unverified |
| 10 | DICE + ReAct (ResNet-50) | FPR95 | 27.25 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | DHM | AUROC | 100 | — | Unverified |
| 2 | Ensemble of ViTs | AUROC | 98.11 | — | Unverified |
| 3 | ViT-L_16 finetuned on CIFAR-100 | AUROC | 97.98 | — | Unverified |
| 4 | R50+ViT_B-16 finetuned on CIFAR-100 | AUROC | 96.23 | — | Unverified |
| 5 | ViT_B-16 finetuned on CIFAR-100 | AUROC | 95.53 | — | Unverified |
| 6 | MLP-Mixer_B-16 finetuned on CIFAR-100 | AUROC | 95.31 | — | Unverified |
| 7 | CLIP using class name words describing the two distributions | AUROC | 94.68 | — | Unverified |
| 8 | ERD (ResNet18) | AUROC | 94.3 | — | Unverified |
| 9 | OpenHybrid | AUROC | 85.6 | — | Unverified |
| 10 | Maximum Logit Score (MLS) | AUROC | 83.2 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | DHM | AUROC | 100 | — | Unverified |
| 2 | R+ViT finetuned on CIFAR-10 | AUROC | 98.52 | — | Unverified |
| 3 | ViT finetuned on CIFAR-10 | AUROC | 98.42 | — | Unverified |
| 4 | MLP-Mixer finetuned on CIFAR-10 | AUROC | 97.85 | — | Unverified |
| 5 | ZODE-KNN | AUROC | 97.12 | — | Unverified |
| 6 | OpenHybrid | AUROC | 95.1 | — | Unverified |
| 7 | ERD (ResNet18) | AUROC | 95.1 | — | Unverified |
| 8 | Wide 40-2 + OECC | AUROC | 94.9 | — | Unverified |
| 9 | WRN 40-2 + OE | AUROC | 93.3 | — | Unverified |
| 10 | Isolation Forest on EfficientNet Softmax values | AUROC | 91.95 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | DHM | AUROC | 100 | — | Unverified |
| 2 | Wide ResNet 40x2 | AUROC | 99.9 | — | Unverified |
| 3 | ResNet 34 + OECC+GM | AUROC | 99.7 | — | Unverified |
| 4 | ResNet 34 + FSSD | AUROC | 99.5 | — | Unverified |
| 5 | Wide ResNet 40x2 | AUROC | 99.43 | — | Unverified |
| 6 | ZODE-KNN | AUROC | 99.12 | — | Unverified |
| 7 | ResNet18 + APR-P | AUROC | 98.1 | — | Unverified |
| 8 | WRN 40-2 + OE | AUROC | 97.8 | — | Unverified |
| 9 | WRN 40-2 (MSP Baseline) | AUROC | 97.8 | — | Unverified |
| 10 | WRN 40-2 + Rotation Prediction | AUROC | 96.2 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | NNGuide (RegNet) | AUROC | 97.73 | — | Unverified |
| 2 | ViM (ViT-B/16) | AUROC | 97.61 | — | Unverified |
| 3 | DisCoPatch | AUROC | 94.4 | — | Unverified |
| 4 | NNGuide (ResNet50 w/ ReAct) | AUROC | 92.49 | — | Unverified |
| 5 | NAC-UE (ResNet-50) | AUROC | 91.45 | — | Unverified |
| 6 | GEN | AUROC | 80.43 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Mixup (Gaussian) | Percentage correct | 95.93 | — | Unverified |
| 2 | Mixup (Imagenet) | Percentage correct | 83.28 | — | Unverified |
| 3 | Baseline (Imagenet) | Percentage correct | 80.57 | — | Unverified |
| 4 | Dropout(Imagenet) | Percentage correct | 78.93 | — | Unverified |
| 5 | Baseline (Gaussian) | Percentage correct | 73.28 | — | Unverified |
| 6 | Dropout(Gaussian) | Percentage correct | 70.57 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | OECC + MD | AUROC | 98.7 | — | Unverified |
| 2 | DenseNet-BC-100 | AUROC | 98.4 | — | Unverified |
| 3 | ResNet-34 | AUROC | 97.9 | — | Unverified |
| 4 | CSNN | AUROC | 87.2 | — | Unverified |
| 5 | OE | AUROC | 86.9 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | WRN 40-2 (MSP Baseline) | FPR95 | 62.66 | — | Unverified |
| 2 | WRN 40-2 + OE | FPR95 | 38.5 | — | Unverified |
| 3 | WRN 40-2 + OECC | FPR95 | 28.89 | — | Unverified |
| 4 | Wide ResNet 40x2 | FPR95 | 23.4 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ViT-B-384 Mahalanobis (pre-trained on IN-21k) | AUROC | 95 | — | Unverified |
| 2 | DisCoPatch | AUROC | 94.3 | — | Unverified |
| 3 | EffNetv2-M Relative Mahalanobis | AUROC | 88.9 | — | Unverified |
| 4 | EffNetb7 Relative Cosine Sim | AUROC | 87.9 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ResNeXt50 + FSSD | AUROC | 86.7 | — | Unverified |
| 2 | ResNeXt 50 + Maha distance | AUROC | 82.5 | — | Unverified |
| 3 | ResNeXt 50 + ODIN | AUROC | 61.3 | — | Unverified |
| 4 | ResNeXt 50 + OE | AUROC | 52.6 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | GEN | FPR95 | 97.3 | — | Unverified |
| 2 | ViM (ViT-B/16) | FPR95 | 36.75 | — | Unverified |
| 3 | NNGuide-ViM (ViT-B/16) | FPR95 | 33.1 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ResNet34 + FSSD | AUROC | 93.1 | — | Unverified |
| 2 | ResNet 34 + OE | AUROC | 92.5 | — | Unverified |
| 3 | ResNet 34 + ODIN | AUROC | 90.8 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | 2-Layered GRU | AUROC | 99.6 | — | Unverified |