SOTAVerified

Personal Information Leakage Detection in Conversations

2020-11-01EMNLP 2020Code Available0· sign in to hype

Qiongkai Xu, Lizhen Qu, Zeyu Gao, Gholamreza Haffari

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

The global market size of conversational assistants (chatbots) is expected to grow to USD 9.4 billion by 2024, according to MarketsandMarkets. Despite the wide use of chatbots, leakage of personal information through chatbots poses serious privacy concerns for their users. In this work, we propose to protect personal information by warning users of detected suspicious sentences generated by conversational assistants. The detection task is formulated as an alignment optimization problem and a new dataset PERSONA-LEAKAGE is collected for evaluation. In this paper, we propose two novel constrained alignment models, which consistently outperform baseline methods on Moreover, we conduct analysis on the behavior of recently proposed personalized chit-chat dialogue systems. The empirical results show that those systems suffer more from personal information disclosure than the widely used Seq2Seq model and the language model. In those cases, a significant number of information leaking utterances can be detected by our models with high precision.

Tasks

Reproductions