SOTAVerified

Leveraging the Feature Distribution in Transfer-based Few-Shot Learning

2020-06-06Code Available1· sign in to hype

Yuqing Hu, Vincent Gripon, Stéphane Pateux

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Few-shot classification is a challenging problem due to the uncertainty caused by using few labelled samples. In the past few years, many methods have been proposed to solve few-shot classification, among which transfer-based methods have proved to achieve the best performance. Following this vein, in this paper we propose a novel transfer-based method that builds on two successive steps: 1) preprocessing the feature vectors so that they become closer to Gaussian-like distributions, and 2) leveraging this preprocessing using an optimal-transport inspired algorithm (in the case of transductive settings). Using standardized vision benchmarks, we prove the ability of the proposed methodology to achieve state-of-the-art accuracy with various datasets, backbone architectures and few-shot settings.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
CIFAR-FS 5-way (1-shot)PT+MAPAccuracy87.69Unverified
CIFAR-FS 5-way (5-shot)PT+MAPAccuracy90.68Unverified
CUB 200 5-way 1-shotPT+MAPAccuracy91.55Unverified
CUB 200 5-way 5-shotPT+MAPAccuracy93.99Unverified
Dirichlet CUB-200 (5-way, 1-shot)PT-MAP1:1 Accuracy65.1Unverified
Dirichlet CUB-200 (5-way, 5-shot)PT-MAP1:1 Accuracy71.3Unverified
Dirichlet Mini-Imagenet (5-way, 1-shot)PT-MAP1:1 Accuracy60.6Unverified
Dirichlet Mini-Imagenet (5-way, 5-shot)PT-MAP1:1 Accuracy67.1Unverified
Dirichlet Tiered-Imagenet (5-way, 1-shot)PT-MAP1:1 Accuracy64.1Unverified
Dirichlet Tiered-Imagenet (5-way, 5-shot)PT-MAP1:1 Accuracy70Unverified
Mini-ImageNet - 1-Shot LearningPT+MAPAccuracy82.92Unverified
Mini-Imagenet 5-way (10-shot)PT+MAPAccuracy90.03Unverified
Mini-Imagenet 5-way (1-shot)PT+MAP (transductive)Accuracy82.92Unverified
Mini-Imagenet 5-way (5-shot)PT+MAPAccuracy88.82Unverified
Mini-ImageNet-CUB 5-way (1-shot)PT+MAPAccuracy62.49Unverified
Mini-ImageNet-CUB 5-way (5-shot)PT+MAPAccuracy76.51Unverified
Tiered ImageNet 5-way (1-shot)PT+MAPAccuracy85.41Unverified
Tiered ImageNet 5-way (5-shot)PT+MAPAccuracy90.44Unverified

Reproductions