SOTAVerified

Interpreting Answers to Yes-No Questions in Dialogues from Multiple Domains

2024-04-25Code Available0· sign in to hype

Zijie Wang, Farzana Rashid, Eduardo Blanco

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

People often answer yes-no questions without explicitly saying yes, no, or similar polar keywords. Figuring out the meaning of indirect answers is challenging, even for large language models. In this paper, we investigate this problem working with dialogues from multiple domains. We present new benchmarks in three diverse domains: movie scripts, tennis interviews, and airline customer service. We present an approach grounded on distant supervision and blended training to quickly adapt to a new dialogue domain. Experimental results show that our approach is never detrimental and yields F1 improvements as high as 11-34%.

Reproductions