Prototype Rectification for Few-Shot Learning
Jinlu Liu, Liang Song, Yongqiang Qin
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/sicara/easy-few-shot-learningpytorch★ 1,301
Abstract
Few-shot learning requires to recognize novel classes with scarce labeled data. Prototypical network is useful in existing researches, however, training on narrow-size distribution of scarce data usually tends to get biased prototypes. In this paper, we figure out two key influencing factors of the process: the intra-class bias and the cross-class bias. We then propose a simple yet effective approach for prototype rectification in transductive setting. The approach utilizes label propagation to diminish the intra-class bias and feature shifting to diminish the cross-class bias. We also conduct theoretical analysis to derive its rationality as well as the lower bound of the performance. Effectiveness is shown on three few-shot benchmarks. Notably, our approach achieves state-of-the-art performance on both miniImageNet (70.31% on 1-shot and 81.89% on 5-shot) and tieredImageNet (78.74% on 1-shot and 86.92% on 5-shot).
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| Dirichlet CUB-200 (5-way, 1-shot) | BDCSPN | 1:1 Accuracy | 74.5 | — | Unverified |
| Dirichlet CUB-200 (5-way, 5-shot) | BDCSPN | 1:1 Accuracy | 87.1 | — | Unverified |
| Dirichlet Mini-Imagenet (5-way, 1-shot) | BD-CSPN | 1:1 Accuracy | 67 | — | Unverified |
| Dirichlet Mini-Imagenet (5-way, 5-shot) | BDCSPN | 1:1 Accuracy | 80.2 | — | Unverified |
| Dirichlet Tiered-Imagenet (5-way, 1-shot) | BDCSPN | 1:1 Accuracy | 74.1 | — | Unverified |
| Dirichlet Tiered-Imagenet (5-way, 5-shot) | BDCSPN | 1:1 Accuracy | 84.8 | — | Unverified |
| Mini-ImageNet - 1-Shot Learning | BD-CSPN | Accuracy | 70.31 | — | Unverified |