SOTAVerified

EASY: Ensemble Augmented-Shot Y-shaped Learning: State-Of-The-Art Few-Shot Classification with Simple Ingredients

2022-01-24Code Available1· sign in to hype

Yassir Bendou, Yuqing Hu, Raphael Lafargue, Giulia Lioi, Bastien Pasdeloup, Stéphane Pateux, Vincent Gripon

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Few-shot learning aims at leveraging knowledge learned by one or more deep learning models, in order to obtain good classification performance on new problems, where only a few labeled samples per class are available. Recent years have seen a fair number of works in the field, introducing methods with numerous ingredients. A frequent problem, though, is the use of suboptimally trained models to extract knowledge, leading to interrogations on whether proposed approaches bring gains compared to using better initial models without the introduced ingredients. In this work, we propose a simple methodology, that reaches or even beats state of the art performance on multiple standardized benchmarks of the field, while adding almost no hyperparameters or parameters to those used for training the initial deep learning models on the generic dataset. This methodology offers a new baseline on which to propose (and fairly compare) new techniques or adapt existing ones.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
CIFAR-FS 5-way (1-shot)EASY 3xResNet12 (transductive)Accuracy87.16Unverified
CIFAR-FS 5-way (1-shot)EASY 2xResNet12 1/√2 (inductive)Accuracy75.24Unverified
CIFAR-FS 5-way (1-shot)EASY 3xResNet12 (inductive)Accuracy76.2Unverified
CIFAR-FS 5-way (1-shot)EASY 2xResNet12 1/√2 (transductive)Accuracy86.99Unverified
CIFAR-FS 5-way (5-shot)EASY 3xResNet12 (transductive)Accuracy90.47Unverified
CIFAR-FS 5-way (5-shot)EASY 3xResNet12 (inductive)Accuracy89Unverified
CIFAR-FS 5-way (5-shot)EASY 2xResNet12 1/√2 (inductive)Accuracy88.38Unverified
CIFAR-FS 5-way (5-shot)EASY 2xResNet12 1/√2 (transductive)Accuracy90.2Unverified
CUB 200 5-wayEASY 3xResNet12 (transductive)Accuracy93.79Unverified
CUB 200 5-way 1-shotEASY 3xResNet12 (inductive)Accuracy78.56Unverified
CUB 200 5-way 1-shotEASY 3xResNet12 (transductive)Accuracy90.56Unverified
CUB 200 5-way 1-shotEASY 4xResNet12 (transductive)Accuracy90.5Unverified
CUB 200 5-way 1-shotEASY 4xResNet12 (inductive)Accuracy77.97Unverified
CUB 200 5-way 5-shotEASY 4xResNet12 (transductive)Accuracy93.5Unverified
CUB 200 5-way 5-shotEASY 4xResNet12 (inductive)Accuracy91.59Unverified
CUB 200 5-way 5-shotEASY 3xResNet12 (inductive)Accuracy91.93Unverified
FC100 5-way (1-shot)EASY 2xResNet12 1/√2 (transductive)Accuracy54.47Unverified
FC100 5-way (1-shot)EASY 2xResNet12 1/√2 (inductive)Accuracy47.94Unverified
FC100 5-way (1-shot)EASY 3xResNet12 (inductive)Accuracy48.07Unverified
FC100 5-way (1-shot)EASY 3xResNet12 (transductive)Accuracy54.13Unverified
FC100 5-way (5-shot)EASY 3xResNet12 (transductive)Accuracy66.86Unverified
FC100 5-way (5-shot)EASY 2xResNet12 1/√2 (transductive)Accuracy65.82Unverified
FC100 5-way (5-shot)EASY 3xResNet12 (inductive)Accuracy64.74Unverified
FC100 5-way (5-shot)EASY 2xResNet12 1/√2 (inductive)Accuracy64.14Unverified
Mini-Imagenet 5-way (1-shot)EASY 2xResNet12 1/√2 (inductive)Accuracy70.63Unverified
Mini-Imagenet 5-way (1-shot)EASY 3xResNet12 (transductive)Accuracy84.04Unverified
Mini-Imagenet 5-way (1-shot)EASY 2xResNet12 1/√2 (transductive)Accuracy82.31Unverified
Mini-Imagenet 5-way (1-shot)EASY 3xResNet12 (inductive)Accuracy71.75Unverified
Mini-Imagenet 5-way (5-shot)EASY 3xResNet12 (inductive)Accuracy87.15Unverified
Mini-Imagenet 5-way (5-shot)EASY 2xResNet12 1/√2 (inductive)Accuracy86.28Unverified
Mini-Imagenet 5-way (5-shot)EASY 3xResNet12 (transductive)Accuracy89.14Unverified
Mini-Imagenet 5-way (5-shot)EASY 2xResNet12 1/√2 (transductive)Accuracy88.57Unverified
Tiered ImageNet 5-way (1-shot)ASY ResNet12 (transductive)Accuracy83.98Unverified
Tiered ImageNet 5-way (1-shot)ASY ResNet12 (ours)Accuracy74.31Unverified
Tiered ImageNet 5-way (1-shot)EASY 3xResNet12 (transductive)Accuracy84.29Unverified
Tiered ImageNet 5-way (1-shot)EASY 3xResNet12 (inductive)Accuracy74.71Unverified
Tiered ImageNet 5-way (5-shot)ASY ResNet12 (transductive)Accuracy89.26Unverified
Tiered ImageNet 5-way (5-shot)EASY 3xResNet12 (transductive)Accuracy89.76Unverified
Tiered ImageNet 5-way (5-shot)EASY 3xResNet12 (inductive)Accuracy88.33Unverified
Tiered ImageNet 5-way (5-shot)ASY ResNet12 (inductive)Accuracy87.86Unverified

Reproductions