SOTAVerified

Extended Few-Shot Learning: Exploiting Existing Resources for Novel Tasks

2020-12-13Code Available1· sign in to hype

Reza Esfandiarpoor, Amy Pu, Mohsen Hajabdollahi, Stephen H. Bach

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

In many practical few-shot learning problems, even though labeled examples are scarce, there are abundant auxiliary datasets that potentially contain useful information. We propose the problem of extended few-shot learning to study these scenarios. We then introduce a framework to address the challenges of efficiently selecting and effectively using auxiliary data in few-shot image classification. Given a large auxiliary dataset and a notion of semantic similarity among classes, we automatically select pseudo shots, which are labeled examples from other classes related to the target task. We show that naive approaches, such as (1) modeling these additional examples the same as the target task examples or (2) using them to learn features via transfer learning, only increase accuracy by a modest amount. Instead, we propose a masking module that adjusts the features of auxiliary data to be more similar to those of the target classes. We show that this masking module performs better than naively modeling the support examples and transfer learning by 4.68 and 6.03 percentage points, respectively.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
CIFAR-FS - 1-Shot Learningpseudo-shotsAccuracy81.87Unverified
CIFAR-FS - 5-Shot Learningpseudo-shotsAccuracy89.12Unverified
CIFAR-FS 5-way (1-shot)pseudo-shotsAccuracy81.87Unverified
CIFAR-FS 5-way (5-shot)pseudo-shotsAccuracy89.12Unverified
FC100 5-way (1-shot)pseudo-shotsAccuracy50.57Unverified
FC100 5-way (5-shot)pseudo-shotsAccuracy61.58Unverified
Fewshot-CIFAR100 - 1-Shot Learningpseudo-shotsAccuracy50.57Unverified
Fewshot-CIFAR100 - 5-Shot Learningpseudo-shotsAccuracy61.58Unverified
Mini-Imagenet 5-way (1-shot)pseudo-shotsAccuracy73.35Unverified
Mini-Imagenet 5-way (5-shot)pseudo-shotsAccuracy82.51Unverified
Tiered ImageNet 5-way (1-shot)pseudo-shotsAccuracy76.55Unverified
Tiered ImageNet 5-way (5-shot)pseudo-shotsAccuracy86.82Unverified

Reproductions