SOTAVerified

Semi-Supervised Learning with Deep Generative Models

2014-06-20NeurIPS 2014Code Available1· sign in to hype

Diederik P. Kingma, Danilo J. Rezende, Shakir Mohamed, Max Welling

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

The ever-increasing size of modern data sets combined with the difficulty of obtaining label information has made semi-supervised learning one of the problems of significant practical importance in modern data analysis. We revisit the approach to semi-supervised learning with generative models and develop new models that allow for effective generalisation from small labelled data sets to large unlabelled ones. Generative approaches have thus far been either inflexible, inefficient or non-scalable. We show that deep generative models and approximate Bayesian inference exploiting recent advances in variational methods can be used to provide significant improvements, making generative approaches highly competitive for semi-supervised learning.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
SVHNM1+M2Percentage error36.02Unverified
SVHNDGNPercentage error36.02Unverified
SVHNM1+TSVMPercentage error54.33Unverified
SVHNM1+KNNPercentage error65.63Unverified

Reproductions