Semi-supervised learning with ladder networks

A Rasmus, M Berglund, M Honkala… - Advances in neural …, 2015 - proceedings.neurips.cc
Advances in neural information processing systems, 2015proceedings.neurips.cc
We combine supervised learning with unsupervised learning in deep neural networks. The
proposed model is trained to simultaneously minimize the sum of supervised and
unsupervised cost functions by backpropagation, avoiding the need for layer-wise pre-
training. Our work builds on top of the Ladder network proposed by Valpola (2015) which we
extend by combining the model with supervision. We show that the resulting model reaches
state-of-the-art performance in semi-supervised MNIST and CIFAR-10 classification in …
Abstract
We combine supervised learning with unsupervised learning in deep neural networks. The proposed model is trained to simultaneously minimize the sum of supervised and unsupervised cost functions by backpropagation, avoiding the need for layer-wise pre-training. Our work builds on top of the Ladder network proposed by Valpola (2015) which we extend by combining the model with supervision. We show that the resulting model reaches state-of-the-art performance in semi-supervised MNIST and CIFAR-10 classification in addition to permutation-invariant MNIST classification with all labels.
proceedings.neurips.cc
Showing the best result for this search. See all results