SOTAVerified

Meta Pseudo Labels

2020-03-23CVPR 2021Code Available1· sign in to hype

Hieu Pham, Zihang Dai, Qizhe Xie, Minh-Thang Luong, Quoc V. Le

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

We present Meta Pseudo Labels, a semi-supervised learning method that achieves a new state-of-the-art top-1 accuracy of 90.2% on ImageNet, which is 1.6% better than the existing state-of-the-art. Like Pseudo Labels, Meta Pseudo Labels has a teacher network to generate pseudo labels on unlabeled data to teach a student network. However, unlike Pseudo Labels where the teacher is fixed, the teacher in Meta Pseudo Labels is constantly adapted by the feedback of the student's performance on the labeled dataset. As a result, the teacher generates better pseudo labels to teach the student. Our code will be available at https://github.com/google-research/google-research/tree/master/meta_pseudo_labels.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
ImageNetMeta Pseudo Labels (EfficientNet-L2)Top 1 Accuracy90.2Unverified
ImageNetMeta Pseudo Labels (EfficientNet-B6-Wide)Top 1 Accuracy90Unverified
ImageNetMeta Pseudo Labels (ResNet-50)Top 1 Accuracy83.2Unverified
ImageNet ReaLMeta Pseudo Labels (EfficientNet-B6-Wide)Accuracy91.12Unverified
ImageNet ReaLMeta Pseudo Labels (EfficientNet-L2)Accuracy91.02Unverified

Reproductions