EASY: Ensemble Augmented-Shot Y-shaped Learning: State-Of-The-Art Few-Shot Classification with Simple Ingredients
Yassir Bendou, Yuqing Hu, Raphael Lafargue, Giulia Lioi, Bastien Pasdeloup, Stéphane Pateux, Vincent Gripon
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/ybendou/easyOfficialIn paperpytorch★ 117
- github.com/brain-bzh/pefslpytorch★ 12
- github.com/ybendou/fs-generalizationpytorch★ 4
Abstract
Few-shot learning aims at leveraging knowledge learned by one or more deep learning models, in order to obtain good classification performance on new problems, where only a few labeled samples per class are available. Recent years have seen a fair number of works in the field, introducing methods with numerous ingredients. A frequent problem, though, is the use of suboptimally trained models to extract knowledge, leading to interrogations on whether proposed approaches bring gains compared to using better initial models without the introduced ingredients. In this work, we propose a simple methodology, that reaches or even beats state of the art performance on multiple standardized benchmarks of the field, while adding almost no hyperparameters or parameters to those used for training the initial deep learning models on the generic dataset. This methodology offers a new baseline on which to propose (and fairly compare) new techniques or adapt existing ones.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| CIFAR-FS 5-way (1-shot) | EASY 3xResNet12 (transductive) | Accuracy | 87.16 | — | Unverified |
| CIFAR-FS 5-way (1-shot) | EASY 2xResNet12 1/√2 (inductive) | Accuracy | 75.24 | — | Unverified |
| CIFAR-FS 5-way (1-shot) | EASY 3xResNet12 (inductive) | Accuracy | 76.2 | — | Unverified |
| CIFAR-FS 5-way (1-shot) | EASY 2xResNet12 1/√2 (transductive) | Accuracy | 86.99 | — | Unverified |
| CIFAR-FS 5-way (5-shot) | EASY 3xResNet12 (transductive) | Accuracy | 90.47 | — | Unverified |
| CIFAR-FS 5-way (5-shot) | EASY 3xResNet12 (inductive) | Accuracy | 89 | — | Unverified |
| CIFAR-FS 5-way (5-shot) | EASY 2xResNet12 1/√2 (inductive) | Accuracy | 88.38 | — | Unverified |
| CIFAR-FS 5-way (5-shot) | EASY 2xResNet12 1/√2 (transductive) | Accuracy | 90.2 | — | Unverified |
| CUB 200 5-way | EASY 3xResNet12 (transductive) | Accuracy | 93.79 | — | Unverified |
| CUB 200 5-way 1-shot | EASY 3xResNet12 (inductive) | Accuracy | 78.56 | — | Unverified |
| CUB 200 5-way 1-shot | EASY 3xResNet12 (transductive) | Accuracy | 90.56 | — | Unverified |
| CUB 200 5-way 1-shot | EASY 4xResNet12 (transductive) | Accuracy | 90.5 | — | Unverified |
| CUB 200 5-way 1-shot | EASY 4xResNet12 (inductive) | Accuracy | 77.97 | — | Unverified |
| CUB 200 5-way 5-shot | EASY 4xResNet12 (transductive) | Accuracy | 93.5 | — | Unverified |
| CUB 200 5-way 5-shot | EASY 4xResNet12 (inductive) | Accuracy | 91.59 | — | Unverified |
| CUB 200 5-way 5-shot | EASY 3xResNet12 (inductive) | Accuracy | 91.93 | — | Unverified |
| FC100 5-way (1-shot) | EASY 2xResNet12 1/√2 (transductive) | Accuracy | 54.47 | — | Unverified |
| FC100 5-way (1-shot) | EASY 2xResNet12 1/√2 (inductive) | Accuracy | 47.94 | — | Unverified |
| FC100 5-way (1-shot) | EASY 3xResNet12 (inductive) | Accuracy | 48.07 | — | Unverified |
| FC100 5-way (1-shot) | EASY 3xResNet12 (transductive) | Accuracy | 54.13 | — | Unverified |
| FC100 5-way (5-shot) | EASY 3xResNet12 (transductive) | Accuracy | 66.86 | — | Unverified |
| FC100 5-way (5-shot) | EASY 2xResNet12 1/√2 (transductive) | Accuracy | 65.82 | — | Unverified |
| FC100 5-way (5-shot) | EASY 3xResNet12 (inductive) | Accuracy | 64.74 | — | Unverified |
| FC100 5-way (5-shot) | EASY 2xResNet12 1/√2 (inductive) | Accuracy | 64.14 | — | Unverified |
| Mini-Imagenet 5-way (1-shot) | EASY 2xResNet12 1/√2 (inductive) | Accuracy | 70.63 | — | Unverified |
| Mini-Imagenet 5-way (1-shot) | EASY 3xResNet12 (transductive) | Accuracy | 84.04 | — | Unverified |
| Mini-Imagenet 5-way (1-shot) | EASY 2xResNet12 1/√2 (transductive) | Accuracy | 82.31 | — | Unverified |
| Mini-Imagenet 5-way (1-shot) | EASY 3xResNet12 (inductive) | Accuracy | 71.75 | — | Unverified |
| Mini-Imagenet 5-way (5-shot) | EASY 3xResNet12 (inductive) | Accuracy | 87.15 | — | Unverified |
| Mini-Imagenet 5-way (5-shot) | EASY 2xResNet12 1/√2 (inductive) | Accuracy | 86.28 | — | Unverified |
| Mini-Imagenet 5-way (5-shot) | EASY 3xResNet12 (transductive) | Accuracy | 89.14 | — | Unverified |
| Mini-Imagenet 5-way (5-shot) | EASY 2xResNet12 1/√2 (transductive) | Accuracy | 88.57 | — | Unverified |
| Tiered ImageNet 5-way (1-shot) | ASY ResNet12 (transductive) | Accuracy | 83.98 | — | Unverified |
| Tiered ImageNet 5-way (1-shot) | ASY ResNet12 (ours) | Accuracy | 74.31 | — | Unverified |
| Tiered ImageNet 5-way (1-shot) | EASY 3xResNet12 (transductive) | Accuracy | 84.29 | — | Unverified |
| Tiered ImageNet 5-way (1-shot) | EASY 3xResNet12 (inductive) | Accuracy | 74.71 | — | Unverified |
| Tiered ImageNet 5-way (5-shot) | ASY ResNet12 (transductive) | Accuracy | 89.26 | — | Unverified |
| Tiered ImageNet 5-way (5-shot) | EASY 3xResNet12 (transductive) | Accuracy | 89.76 | — | Unverified |
| Tiered ImageNet 5-way (5-shot) | EASY 3xResNet12 (inductive) | Accuracy | 88.33 | — | Unverified |
| Tiered ImageNet 5-way (5-shot) | ASY ResNet12 (inductive) | Accuracy | 87.86 | — | Unverified |