SOTAVerified

Template Guided Text Generation for Task-Oriented Dialogue

2020-04-30EMNLP 2020Unverified0· sign in to hype

Mihir Kale, Abhinav Rastogi

Unverified — Be the first to reproduce this paper.

Reproduce

Abstract

Virtual assistants such as Google Assistant, Amazon Alexa, and Apple Siri enable users to interact with a large number of services and APIs on the web using natural language. In this work, we investigate two methods for Natural Language Generation (NLG) using a single domain-independent model across a large number of APIs. First, we propose a schema-guided approach which conditions the generation on a schema describing the API in natural language. Our second method investigates the use of a small number of templates, growing linearly in number of slots, to convey the semantics of the API. To generate utterances for an arbitrary slot combination, a few simple templates are first concatenated to give a semantically correct, but possibly incoherent and ungrammatical utterance. A pre-trained language model is subsequently employed to rewrite it into coherent, natural sounding text. Through automatic metrics and human evaluation, we show that our method improves over strong baselines, is robust to out-of-domain inputs and shows improved sample efficiency.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
MULTIWOZ 2.1T5-smallBLEU34.96Unverified
MULTIWOZ 2.1T2G2BLEU34.91Unverified

Reproductions