SimpleShot: Revisiting Nearest-Neighbor Classification for Few-Shot Learning
Yan Wang, Wei-Lun Chao, Kilian Q. Weinberger, Laurens van der Maaten
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/mileyan/simple_shotOfficialIn paperpytorch★ 0
- github.com/sicara/easy-few-shot-learningpytorch★ 1,301
- github.com/yhu01/PT-MAPpytorch★ 215
- github.com/yhu01/bmspytorch★ 39
- github.com/mbonto/fewshot_neuroimaging_classificationpytorch★ 10
- github.com/mbonto/fewshot_generalizationpytorch★ 2
Abstract
Few-shot learners aim to recognize new object classes based on a small number of labeled training examples. To prevent overfitting, state-of-the-art few-shot learners use meta-learning on convolutional-network features and perform classification using a nearest-neighbor classifier. This paper studies the accuracy of nearest-neighbor baselines without meta-learning. Surprisingly, we find simple feature transformations suffice to obtain competitive few-shot learning accuracies. For example, we find that a nearest-neighbor classifier used in combination with mean-subtraction and L2-normalization outperforms prior results in three out of five settings on the miniImageNet dataset.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| Dirichlet CUB-200 (5-way, 1-shot) | Simpleshot | 1:1 Accuracy | 70.6 | — | Unverified |
| Dirichlet CUB-200 (5-way, 5-shot) | Simpleshot | 1:1 Accuracy | 87.5 | — | Unverified |
| Dirichlet Mini-Imagenet (5-way, 1-shot) | Simpleshot | 1:1 Accuracy | 63 | — | Unverified |
| Dirichlet Mini-Imagenet (5-way, 5-shot) | Simpleshot | 1:1 Accuracy | 80.1 | — | Unverified |
| Dirichlet Tiered-Imagenet (5-way, 1-shot) | Simpleshot | 1:1 Accuracy | 69.6 | — | Unverified |
| Dirichlet Tiered-Imagenet (5-way, 5-shot) | Simpleshot | 1:1 Accuracy | 84.7 | — | Unverified |
| Mini-Imagenet 5-way (1-shot) | SimpleShot (CL2N-DenseNet) | Accuracy | 64.29 | — | Unverified |
| Mini-Imagenet 5-way (5-shot) | SimpleShot (CL2N-DenseNet) | Accuracy | 81.5 | — | Unverified |