SOTAVerified

Prototypical Networks for Few-shot Learning

2017-03-15NeurIPS 2017Code Available2· sign in to hype

Jake Snell, Kevin Swersky, Richard S. Zemel

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

We propose prototypical networks for the problem of few-shot classification, where a classifier must generalize to new classes not seen in the training set, given only a small number of examples of each new class. Prototypical networks learn a metric space in which classification can be performed by computing distances to prototype representations of each class. Compared to recent approaches for few-shot learning, they reflect a simpler inductive bias that is beneficial in this limited-data regime, and achieve excellent results. We provide an analysis showing that some simple design decisions can yield substantial improvements over recent approaches involving complicated architectural choices and meta-learning. We further extend prototypical networks to zero-shot learning and achieve state-of-the-art results on the CU-Birds dataset.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
CUB 200 50-way (0-shot)Prototypical NetworksAccuracy54.6Unverified
Dirichlet Mini-Imagenet (5-way, 1-shot)ProtoNet1:1 Accuracy53.6Unverified
Dirichlet Mini-Imagenet (5-way, 5-shot)ProtoNet1:1 Accuracy74.2Unverified
Meta-DatasetPrototypical NetworksAccuracy60.57Unverified
Meta-Dataset RankPrototypical NetworksMean Rank8.5Unverified
Mini-Imagenet 10-way (1-shot)Prototypical NetworksAccuracy32.9Unverified
Mini-Imagenet 10-way (1-shot)Prototypical Networks (Higher Way)Accuracy34.6Unverified
Mini-Imagenet 10-way (5-shot)Prototypical NetworksAccuracy49.3Unverified
Mini-Imagenet 10-way (5-shot)Prototypical Networks (Higher Way)Accuracy50.1Unverified
Mini-Imagenet 5-way (10-shot)Prototypical NetworksAccuracy74.3Unverified
Mini-Imagenet 5-way (1-shot)Prototypical NetworksAccuracy49.42Unverified
Mini-Imagenet 5-way (5-shot)Prototypical NetworksAccuracy68.2Unverified
Mini-ImageNet-CUB 5-way (1-shot)ProtoNet (Snell et al., 2017)Accuracy45.31Unverified
OMNIGLOT - 1-Shot, 20-wayPrototypical NetworksAccuracy96Unverified
OMNIGLOT - 1-Shot, 5-wayPrototypical NetworksAccuracy98.8Unverified
OMNIGLOT - 5-Shot, 20-wayPrototypical NetworksAccuracy98.9Unverified
OMNIGLOT - 5-Shot, 5-wayPrototypical NetworksAccuracy99.7Unverified
Stanford Cars 5-way (1-shot)Prototypical Nets++Accuracy40.9Unverified
Stanford Cars 5-way (5-shot)Prototypical Nets++Accuracy52.93Unverified
Stanford Dogs 5-way (5-shot)Prototypical Nets++Accuracy48.19Unverified
Tiered ImageNet 10-way (1-shot)Prototypical Networks (Higher Way)Accuracy38.6Unverified
Tiered ImageNet 10-way (1-shot)Prototypical NetworksAccuracy37.3Unverified
Tiered ImageNet 10-way (5-shot)Prototypical NetworksAccuracy57.8Unverified
Tiered ImageNet 10-way (5-shot)Prototypical Networks (Higher Way)Accuracy58.3Unverified

Reproductions