SOTAVerified

Obtaining Reliable Human Ratings of Valence, Arousal, and Dominance for 20,000 English Words

2018-07-01ACL 2018Unverified0· sign in to hype

Saif Mohammad

Unverified — Be the first to reproduce this paper.

Reproduce

Abstract

Words play a central role in language and thought. Factor analysis studies have shown that the primary dimensions of meaning are valence, arousal, and dominance (VAD). We present the NRC VAD Lexicon, which has human ratings of valence, arousal, and dominance for more than 20,000 English words. We use Best--Worst Scaling to obtain fine-grained scores and address issues of annotation consistency that plague traditional rating scale methods of annotation. We show that the ratings obtained are vastly more reliable than those in existing lexicons. We also show that there exist statistically significant differences in the shared understanding of valence, arousal, and dominance across demographic variables such as age, gender, and personality.

Tasks

Reproductions