SOTAVerified

Recognition of They/Them as Singular Personal Pronouns in Coreference Resolution

2022-07-01NAACL 2022Code Available0· sign in to hype

Connor Baumler, Rachel Rudinger

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

As using they/them as personal pronouns becomes increasingly common in English, it is important that coreference resolution systems work as well for individuals who use personal “they” as they do for those who use gendered personal pronouns. We introduce a new benchmark for coreference resolution systems which evaluates singular personal “they” recognition. Using these WinoNB schemas, we evaluate a number of publicly available coreference resolution systems and confirm their bias toward resolving “they” pronouns as plural.

Tasks

Reproductions