One Word, Two Sides: Traces of Stance in Contextualized Word Representations

Code

• github.com/ainagari/1word2sides
  OfficialIn papertf★ 0

Abstract

The way we use words is influenced by our opinion. We investigate whether this is reflected in contextualized word embeddings. For example, is the representation of “animal” different between people who would abolish zoos and those who would not? We explore this question from a Lexical Semantic Change standpoint. Our experiments with BERT embeddings derived from datasets with stance annotations reveal small but significant differences in word representations between opposing stances.

Tasks

Reproductions