SOTAVerified

Improved Deep Learning Baselines for Ubuntu Corpus Dialogs

2015-10-13Unverified0· sign in to hype

Rudolf Kadlec, Martin Schmid, Jan Kleindienst

Unverified — Be the first to reproduce this paper.

Reproduce

Abstract

This paper presents results of our experiments for the next utterance ranking on the Ubuntu Dialog Corpus -- the largest publicly available multi-turn dialog corpus. First, we use an in-house implementation of previously reported models to do an independent evaluation using the same data. Second, we evaluate the performances of various LSTMs, Bi-LSTMs and CNNs on the dataset. Third, we create an ensemble by averaging predictions of multiple models. The ensemble further improves the performance and it achieves a state-of-the-art result for the next utterance ranking on this dataset. Finally, we discuss our future plans using this corpus.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
Ubuntu Dialogue (v1, Ranking)Dual-BiLSTMR10@10.63Unverified

Reproductions