SARG: A Novel Semi Autoregressive Generator for Multi-turn Incomplete Utterance Restoration
Mengzuo Huang, Feng Li, Wuhe Zou, Weidong Zhang
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/NetEase-GameAI/SARGOfficialpytorch★ 49
Abstract
Dialogue systems in open domain have achieved great success due to the easily obtained single-turn corpus and the development of deep learning, but the multi-turn scenario is still a challenge because of the frequent coreference and information omission. In this paper, we investigate the incomplete utterance restoration which has brought general improvement over multi-turn dialogue systems in recent studies. Meanwhile, jointly inspired by the autoregression for text generation and the sequence labeling for text editing, we propose a novel semi autoregressive generator (SARG) with the high efficiency and flexibility. Moreover, experiments on two benchmarks show that our proposed model significantly outperforms the state-of-the-art models in terms of quality and inference speed.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| CANARD | SARG | BLEU | 54.8 | — | Unverified |
| Multi-Rewrite | SARG (n_beam=5) | Rewriting F3 | 46.4 | — | Unverified |
| Multi-Rewrite | SARG (greedy) | BLEU-1 | 92.2 | — | Unverified |