Leveraging the Feature Distribution in Transfer-based Few-Shot Learning
Yuqing Hu, Vincent Gripon, Stéphane Pateux
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/yhu01/PT-MAPOfficialIn paperpytorch★ 215
- github.com/sicara/easy-few-shot-learningpytorch★ 1,301
- github.com/yhu01/bmspytorch★ 39
- github.com/xiangyu8/PT-MAP-sfpytorch★ 24
- github.com/mbonto/fewshot_neuroimaging_classificationpytorch★ 10
- github.com/allenhaozhu/easepytorch★ 10
Abstract
Few-shot classification is a challenging problem due to the uncertainty caused by using few labelled samples. In the past few years, many methods have been proposed to solve few-shot classification, among which transfer-based methods have proved to achieve the best performance. Following this vein, in this paper we propose a novel transfer-based method that builds on two successive steps: 1) preprocessing the feature vectors so that they become closer to Gaussian-like distributions, and 2) leveraging this preprocessing using an optimal-transport inspired algorithm (in the case of transductive settings). Using standardized vision benchmarks, we prove the ability of the proposed methodology to achieve state-of-the-art accuracy with various datasets, backbone architectures and few-shot settings.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| CIFAR-FS 5-way (1-shot) | PT+MAP | Accuracy | 87.69 | — | Unverified |
| CIFAR-FS 5-way (5-shot) | PT+MAP | Accuracy | 90.68 | — | Unverified |
| CUB 200 5-way 1-shot | PT+MAP | Accuracy | 91.55 | — | Unverified |
| CUB 200 5-way 5-shot | PT+MAP | Accuracy | 93.99 | — | Unverified |
| Dirichlet CUB-200 (5-way, 1-shot) | PT-MAP | 1:1 Accuracy | 65.1 | — | Unverified |
| Dirichlet CUB-200 (5-way, 5-shot) | PT-MAP | 1:1 Accuracy | 71.3 | — | Unverified |
| Dirichlet Mini-Imagenet (5-way, 1-shot) | PT-MAP | 1:1 Accuracy | 60.6 | — | Unverified |
| Dirichlet Mini-Imagenet (5-way, 5-shot) | PT-MAP | 1:1 Accuracy | 67.1 | — | Unverified |
| Dirichlet Tiered-Imagenet (5-way, 1-shot) | PT-MAP | 1:1 Accuracy | 64.1 | — | Unverified |
| Dirichlet Tiered-Imagenet (5-way, 5-shot) | PT-MAP | 1:1 Accuracy | 70 | — | Unverified |
| Mini-ImageNet - 1-Shot Learning | PT+MAP | Accuracy | 82.92 | — | Unverified |
| Mini-Imagenet 5-way (10-shot) | PT+MAP | Accuracy | 90.03 | — | Unverified |
| Mini-Imagenet 5-way (1-shot) | PT+MAP (transductive) | Accuracy | 82.92 | — | Unverified |
| Mini-Imagenet 5-way (5-shot) | PT+MAP | Accuracy | 88.82 | — | Unverified |
| Mini-ImageNet-CUB 5-way (1-shot) | PT+MAP | Accuracy | 62.49 | — | Unverified |
| Mini-ImageNet-CUB 5-way (5-shot) | PT+MAP | Accuracy | 76.51 | — | Unverified |
| Tiered ImageNet 5-way (1-shot) | PT+MAP | Accuracy | 85.41 | — | Unverified |
| Tiered ImageNet 5-way (5-shot) | PT+MAP | Accuracy | 90.44 | — | Unverified |