Gender Bias in Coreference Resolution

Code

• github.com/rudinger/winogender-schemas
  OfficialIn papernone★ 0
• github.com/anthropics/evals
  none★ 338
• github.com/mapmeld/disambiguation_q
  none★ 0
• github.com/uclanlp/socialbias-dataset-construction-biases
  none★ 0

Abstract

We present an empirical study of gender bias in coreference resolution systems. We first introduce a novel, Winograd schema-style set of minimal pair sentences that differ only by pronoun gender. With these "Winogender schemas," we evaluate and confirm systematic gender bias in three publicly-available coreference resolution systems, and correlate this bias with real-world and textual gender statistics.

Tasks

Reproductions