Measuring Conversational Fluidity in Automated Dialogue Agents
2019-10-25Code Available0· sign in to hype
Keith Vella, Massimo Poesio, Michael Sigamani, Cihan Dogan, Aimore Dutra, Dimitrios Dimakopoulos, Alfredo Gemma, Ella Walters
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/ConstellationAI/DialogueFluidityOfficialIn papernone★ 0
Abstract
We present an automated evaluation method to measure fluidity in conversational dialogue systems. The method combines various state of the art Natural Language tools into a classifier, and human ratings on these dialogues to train an automated judgment model. Our experiments show that the results are an improvement on existing metrics for measuring fluidity.