SOTAVerified

Enhancing Few-Shot Image Classification with Unlabelled Examples

2020-06-17Code Available0· sign in to hype

Peyman Bateni, Jarred Barber, Jan-Willem van de Meent, Frank Wood

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

We develop a transductive meta-learning method that uses unlabelled instances to improve few-shot image classification performance. Our approach combines a regularized Mahalanobis-distance-based soft k-means clustering procedure with a modified state of the art neural adaptive feature extractor to achieve improved test-time classification accuracy using unlabelled data. We evaluate our method on transductive few-shot learning tasks, in which the goal is to jointly predict labels for query (test) examples given a set of support (training) examples. We achieve state of the art performance on the Meta-Dataset, mini-ImageNet and tiered-ImageNet benchmarks. All trained models and code have been made publicly available at github.com/plai-group/simple-cnaps.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
Meta-DatasetTransductive CNAPSAccuracy70.32Unverified
Meta-Dataset RankTransductive CNAPSMean Rank3.05Unverified
Mini-Imagenet 10-way (1-shot)Transductive CNAPS + FETIAccuracy68.5Unverified
Mini-Imagenet 10-way (1-shot)Transductive CNAPSAccuracy42.8Unverified
Mini-Imagenet 10-way (5-shot)Transductive CNAPSAccuracy59.6Unverified
Mini-Imagenet 10-way (5-shot)Transductive CNAPS + FETIAccuracy85.9Unverified
Mini-Imagenet 5-way (1-shot)Transductive CNAPSAccuracy55.6Unverified
Mini-Imagenet 5-way (1-shot)Transductive CNAPS + FETIAccuracy79.9Unverified
Mini-Imagenet 5-way (5-shot)Transductive CNAPSAccuracy73.1Unverified
Mini-Imagenet 5-way (5-shot)Transductive CNAPS + FETIAccuracy91.5Unverified
Tiered ImageNet 10-way (1-shot)Transductive CNAPSAccuracy54.6Unverified
Tiered ImageNet 10-way (1-shot)Transductive CNAPS + FETIAccuracy65.1Unverified
Tiered ImageNet 10-way (5-shot)Transductive CNAPS + FETIAccuracy80.6Unverified
Tiered ImageNet 10-way (5-shot)Transductive CNAPSAccuracy72.5Unverified
Tiered ImageNet 5-way (1-shot)Transductive CNAPS + FETIAccuracy73.8Unverified
Tiered ImageNet 5-way (1-shot)Transductive CNAPSAccuracy65.9Unverified
Tiered ImageNet 5-way (5-shot)Transductive CNAPS + FETIAccuracy87.7Unverified
Tiered ImageNet 5-way (5-shot)Transductive CNAPSAccuracy81.8Unverified

Reproductions