Improved Deep Learning Baselines for Ubuntu Corpus Dialogs
2015-10-13Unverified0· sign in to hype
Rudolf Kadlec, Martin Schmid, Jan Kleindienst
Unverified — Be the first to reproduce this paper.
ReproduceAbstract
This paper presents results of our experiments for the next utterance ranking on the Ubuntu Dialog Corpus -- the largest publicly available multi-turn dialog corpus. First, we use an in-house implementation of previously reported models to do an independent evaluation using the same data. Second, we evaluate the performances of various LSTMs, Bi-LSTMs and CNNs on the dataset. Third, we create an ensemble by averaging predictions of multiple models. The ensemble further improves the performance and it achieves a state-of-the-art result for the next utterance ranking on this dataset. Finally, we discuss our future plans using this corpus.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| Ubuntu Dialogue (v1, Ranking) | Dual-BiLSTM | R10@1 | 0.63 | — | Unverified |