Enhancing Few-Shot Image Classification with Unlabelled Examples
Peyman Bateni, Jarred Barber, Jan-Willem van de Meent, Frank Wood
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/plai-group/simple-cnapsOfficialIn papertf★ 58
- github.com/peymanbateni/simple-cnapspytorch★ 120
Abstract
We develop a transductive meta-learning method that uses unlabelled instances to improve few-shot image classification performance. Our approach combines a regularized Mahalanobis-distance-based soft k-means clustering procedure with a modified state of the art neural adaptive feature extractor to achieve improved test-time classification accuracy using unlabelled data. We evaluate our method on transductive few-shot learning tasks, in which the goal is to jointly predict labels for query (test) examples given a set of support (training) examples. We achieve state of the art performance on the Meta-Dataset, mini-ImageNet and tiered-ImageNet benchmarks. All trained models and code have been made publicly available at github.com/plai-group/simple-cnaps.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| Meta-Dataset | Transductive CNAPS | Accuracy | 70.32 | — | Unverified |
| Meta-Dataset Rank | Transductive CNAPS | Mean Rank | 3.05 | — | Unverified |
| Mini-Imagenet 10-way (1-shot) | Transductive CNAPS + FETI | Accuracy | 68.5 | — | Unverified |
| Mini-Imagenet 10-way (1-shot) | Transductive CNAPS | Accuracy | 42.8 | — | Unverified |
| Mini-Imagenet 10-way (5-shot) | Transductive CNAPS | Accuracy | 59.6 | — | Unverified |
| Mini-Imagenet 10-way (5-shot) | Transductive CNAPS + FETI | Accuracy | 85.9 | — | Unverified |
| Mini-Imagenet 5-way (1-shot) | Transductive CNAPS | Accuracy | 55.6 | — | Unverified |
| Mini-Imagenet 5-way (1-shot) | Transductive CNAPS + FETI | Accuracy | 79.9 | — | Unverified |
| Mini-Imagenet 5-way (5-shot) | Transductive CNAPS | Accuracy | 73.1 | — | Unverified |
| Mini-Imagenet 5-way (5-shot) | Transductive CNAPS + FETI | Accuracy | 91.5 | — | Unverified |
| Tiered ImageNet 10-way (1-shot) | Transductive CNAPS | Accuracy | 54.6 | — | Unverified |
| Tiered ImageNet 10-way (1-shot) | Transductive CNAPS + FETI | Accuracy | 65.1 | — | Unverified |
| Tiered ImageNet 10-way (5-shot) | Transductive CNAPS + FETI | Accuracy | 80.6 | — | Unverified |
| Tiered ImageNet 10-way (5-shot) | Transductive CNAPS | Accuracy | 72.5 | — | Unverified |
| Tiered ImageNet 5-way (1-shot) | Transductive CNAPS + FETI | Accuracy | 73.8 | — | Unverified |
| Tiered ImageNet 5-way (1-shot) | Transductive CNAPS | Accuracy | 65.9 | — | Unverified |
| Tiered ImageNet 5-way (5-shot) | Transductive CNAPS + FETI | Accuracy | 87.7 | — | Unverified |
| Tiered ImageNet 5-way (5-shot) | Transductive CNAPS | Accuracy | 81.8 | — | Unverified |