Efficiency Evaluation of Character-level RNN Training Schedules
2016-05-09Code Available0· sign in to hype
Cedric De Boom, Sam Leroux, Steven Bohez, Pieter Simoens, Thomas Demeester, Bart Dhoedt
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/cedricdeboom/CharRNNOfficialIn papernone★ 0
Abstract
We present four training and prediction schedules from the same character-level recurrent neural network. The efficiency of these schedules is tested in terms of model effectiveness as a function of training time and amount of training data seen. We show that the choice of training and prediction schedule potentially has a considerable impact on the prediction effectiveness for a given training budget.