SOTAVerified

A Closer Look at Few-shot Classification

2019-04-08ICLR 2019Code Available1· sign in to hype

Wei-Yu Chen, Yen-Cheng Liu, Zsolt Kira, Yu-Chiang Frank Wang, Jia-Bin Huang

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Few-shot classification aims to learn a classifier to recognize unseen classes during training with limited labeled examples. While significant progress has been made, the growing complexity of network designs, meta-learning algorithms, and differences in implementation details make a fair comparison difficult. In this paper, we present 1) a consistent comparative analysis of several representative few-shot classification algorithms, with results showing that deeper backbones significantly reduce the performance differences among methods on datasets with limited domain differences, 2) a modified baseline method that surprisingly achieves competitive performance when compared with the state-of-the-art on both the and the CUB datasets, and 3) a new experimental setting for evaluating the cross-domain generalization ability for few-shot classification algorithms. Our results reveal that reducing intra-class variation is an important factor when the feature backbone is shallow, but not as critical when using deeper backbones. In a realistic cross-domain evaluation setting, we show that a baseline method with a standard fine-tuning practice compares favorably against other state-of-the-art few-shot learning algorithms.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
Dirichlet CUB-200 (5-way, 1-shot)Baseline++1:1 Accuracy69.4Unverified
Dirichlet CUB-200 (5-way, 5-shot)Baseline++1:1 Accuracy87.5Unverified
Dirichlet Mini-Imagenet (5-way, 1-shot)Baseline ++1:1 Accuracy60.4Unverified
Dirichlet Mini-Imagenet (5-way, 5-shot)Baseline++1:1 Accuracy79.7Unverified
Dirichlet Tiered-Imagenet (5-way, 1-shot)Baseline++1:1 Accuracy68Unverified
Dirichlet Tiered-Imagenet (5-way, 5-shot)Baseline++1:1 Accuracy84.2Unverified
Mini-ImageNet-CUB 5-way (1-shot)Baseline++ (Chen et al., 2019)Accuracy33.04Unverified
Mini-ImageNet-CUB 5-way (5-shot)Baseline++ (Chen et al., 2019)Accuracy62.04Unverified

Reproductions