SOTAVerified

Improved Few-Shot Visual Classification

2019-12-07CVPR 2020Code Available0· sign in to hype

Peyman Bateni, Raghav Goyal, Vaden Masrani, Frank Wood, Leonid Sigal

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Few-shot learning is a fundamental task in computer vision that carries the promise of alleviating the need for exhaustively labeled data. Most few-shot learning approaches to date have focused on progressively more complex neural feature extractors and classifier adaptation strategies, as well as the refinement of the task definition itself. In this paper, we explore the hypothesis that a simple class-covariance-based distance metric, namely the Mahalanobis distance, adopted into a state of the art few-shot learning approach (CNAPS) can, in and of itself, lead to a significant performance improvement. We also discover that it is possible to learn adaptive feature extractors that allow useful estimation of the high dimensional feature covariances required by this metric from surprisingly few samples. The result of our work is a new "Simple CNAPS" architecture which has up to 9.2% fewer trainable parameters than CNAPS and performs up to 6.1% better than state of the art on the standard few-shot image classification benchmark dataset.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
Meta-DatasetSimple CNAPSAccuracy69.86Unverified
Meta-Dataset RankSimple CNAPSMean Rank3.45Unverified
Mini-Imagenet 10-way (1-shot)Simple CNAPS + FETIAccuracy63.5Unverified
Mini-Imagenet 10-way (1-shot)Simple CNAPSAccuracy37.1Unverified
Mini-Imagenet 10-way (5-shot)Simple CNAPSAccuracy56.7Unverified
Mini-Imagenet 10-way (5-shot)Simple CNAPS + FETIAccuracy83.1Unverified
Mini-Imagenet 5-way (1-shot)Simple CNAPSAccuracy53.2Unverified
Mini-Imagenet 5-way (1-shot)Simple CNAPS + FETIAccuracy77.4Unverified
Mini-Imagenet 5-way (5-shot)Simple CNAPSAccuracy70.8Unverified
Mini-Imagenet 5-way (5-shot)Simple CNAPS + FETIAccuracy90.3Unverified
Tiered ImageNet 10-way (1-shot)Simple CNAPSAccuracy48.1Unverified
Tiered ImageNet 10-way (1-shot)Simple CNAPS + FETIAccuracy57.1Unverified
Tiered ImageNet 10-way (5-shot)Simple CNAPS + FETIAccuracy78.5Unverified
Tiered ImageNet 10-way (5-shot)Simple CNAPSAccuracy70.2Unverified
Tiered ImageNet 5-way (1-shot)Simple CNAPS + FETIAccuracy71.4Unverified
Tiered ImageNet 5-way (1-shot)Simple CNAPSAccuracy63Unverified
Tiered ImageNet 5-way (5-shot)Simple CNAPS + FETIAccuracy86Unverified
Tiered ImageNet 5-way (5-shot)Simple CNAPSAccuracy80Unverified

Reproductions