SOTAVerified

Prototypical Networks for Few-shot Learning

2017-03-15NeurIPS 2017Code Available2· sign in to hype

Jake Snell, Kevin Swersky, Richard S. Zemel

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

We propose prototypical networks for the problem of few-shot classification, where a classifier must generalize to new classes not seen in the training set, given only a small number of examples of each new class. Prototypical networks learn a metric space in which classification can be performed by computing distances to prototype representations of each class. Compared to recent approaches for few-shot learning, they reflect a simpler inductive bias that is beneficial in this limited-data regime, and achieve excellent results. We provide an analysis showing that some simple design decisions can yield substantial improvements over recent approaches involving complicated architectural choices and meta-learning. We further extend prototypical networks to zero-shot learning and achieve state-of-the-art results on the CU-Birds dataset.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
CUB 200 50-way (0-shot)Prototypical NetworksAccuracy54.6—Unverified
Dirichlet Mini-Imagenet (5-way, 1-shot)ProtoNet1:1 Accuracy53.6—Unverified
Dirichlet Mini-Imagenet (5-way, 5-shot)ProtoNet1:1 Accuracy74.2—Unverified
Meta-DatasetPrototypical NetworksAccuracy60.57—Unverified
Meta-Dataset RankPrototypical NetworksMean Rank8.5—Unverified
Mini-Imagenet 10-way (1-shot)Prototypical NetworksAccuracy32.9—Unverified
Mini-Imagenet 10-way (1-shot)Prototypical Networks (Higher Way)Accuracy34.6—Unverified
Mini-Imagenet 10-way (5-shot)Prototypical NetworksAccuracy49.3—Unverified
Mini-Imagenet 10-way (5-shot)Prototypical Networks (Higher Way)Accuracy50.1—Unverified
Mini-Imagenet 5-way (10-shot)Prototypical NetworksAccuracy74.3—Unverified
Mini-Imagenet 5-way (1-shot)Prototypical NetworksAccuracy49.42—Unverified
Mini-Imagenet 5-way (5-shot)Prototypical NetworksAccuracy68.2—Unverified
Mini-ImageNet-CUB 5-way (1-shot)ProtoNet (Snell et al., 2017)Accuracy45.31—Unverified
OMNIGLOT - 1-Shot, 20-wayPrototypical NetworksAccuracy96—Unverified
OMNIGLOT - 1-Shot, 5-wayPrototypical NetworksAccuracy98.8—Unverified
OMNIGLOT - 5-Shot, 20-wayPrototypical NetworksAccuracy98.9—Unverified
OMNIGLOT - 5-Shot, 5-wayPrototypical NetworksAccuracy99.7—Unverified
Stanford Cars 5-way (1-shot)Prototypical Nets++Accuracy40.9—Unverified
Stanford Cars 5-way (5-shot)Prototypical Nets++Accuracy52.93—Unverified
Stanford Dogs 5-way (5-shot)Prototypical Nets++Accuracy48.19—Unverified
Tiered ImageNet 10-way (1-shot)Prototypical Networks (Higher Way)Accuracy38.6—Unverified
Tiered ImageNet 10-way (1-shot)Prototypical NetworksAccuracy37.3—Unverified
Tiered ImageNet 10-way (5-shot)Prototypical NetworksAccuracy57.8—Unverified
Tiered ImageNet 10-way (5-shot)Prototypical Networks (Higher Way)Accuracy58.3—Unverified

Reproductions