SOTAVerified

SampleRNN: An Unconditional End-to-End Neural Audio Generation Model

2016-12-22Code Available0· sign in to hype

Soroush Mehri, Kundan Kumar, Ishaan Gulrajani, Rithesh Kumar, Shubham Jain, Jose Sotelo, Aaron Courville, Yoshua Bengio

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

In this paper we propose a novel model for unconditional audio generation based on generating one audio sample at a time. We show that our model, which profits from combining memory-less modules, namely autoregressive multilayer perceptrons, and stateful recurrent neural networks in a hierarchical structure is able to capture underlying sources of variations in the temporal sequences over very long time spans, on three datasets of different nature. Human evaluation on the generated samples indicate that our model is preferred over competing models. We also show how each component of the model contributes to the exhibited performance.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
Blizzard Challenge 2013SampleRNN (3-tier)NLL1.39Unverified
Blizzard Challenge 2013SampleRNN (2-tier)NLL1.39Unverified

Reproductions