SOTAVerified

Complementing Representation Deficiency in Few-shot Image Classification: A Meta-Learning Approach

2020-07-21Code Available0· sign in to hype

Xian Zhong, Cheng Gu, Wenxin Huang, Lin Li, Shuqin Chen, Chia-Wen Lin

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Few-shot learning is a challenging problem that has attracted more and more attention recently since abundant training samples are difficult to obtain in practical applications. Meta-learning has been proposed to address this issue, which focuses on quickly adapting a predictor as a base-learner to new tasks, given limited labeled samples. However, a critical challenge for meta-learning is the representation deficiency since it is hard to discover common information from a small number of training samples or even one, as is the representation of key features from such little information. As a result, a meta-learner cannot be trained well in a high-dimensional parameter space to generalize to new tasks. Existing methods mostly resort to extracting less expressive features so as to avoid the representation deficiency. Aiming at learning better representations, we propose a meta-learning approach with complemented representations network (MCRNet) for few-shot image classification. In particular, we embed a latent space, where latent codes are reconstructed with extra representation information to complement the representation deficiency. Furthermore, the latent space is established with variational inference, collaborating well with different base-learners, and can be extended to other models. Finally, our end-to-end framework achieves the state-of-the-art performance in image classification on three standard few-shot learning datasets.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
CIFAR-FS 5-way (1-shot)MCRNet-SVMAccuracy74.7Unverified
CIFAR-FS 5-way (1-shot)MCRNet-RRAccuracy73.8Unverified
CIFAR-FS 5-way (5-shot)MCRNet-RRAccuracy85.2Unverified
CIFAR-FS 5-way (5-shot)MCRNet-SVMAccuracy86.8Unverified
FC100 5-way (1-shot)MCRNet-SVMAccuracy41Unverified
FC100 5-way (1-shot)MCRNet-RRAccuracy40.7Unverified
FC100 5-way (5-shot)MCRNet-SVMAccuracy57.8Unverified
FC100 5-way (5-shot)MCRNet-RRAccuracy56.6Unverified
Mini-Imagenet 5-way (1-shot)MCRNet-SVMAccuracy62.53Unverified
Mini-Imagenet 5-way (1-shot)MCRNet-RRAccuracy61.32Unverified
Mini-Imagenet 5-way (5-shot)MCRNet-SVMAccuracy80.34Unverified
Mini-Imagenet 5-way (5-shot)MCRNet-RRAccuracy78.16Unverified

Reproductions