Elucidating Conceptual Properties from Word Embeddings

Abstract

In this paper, we introduce a method of identifying the components (i.e. dimensions) of word embeddings that strongly signifies properties of a word. By elucidating such properties hidden in word embeddings, we could make word embeddings more interpretable, and also could perform property-based meaning comparison. With the capability, we can answer questions like ``To what degree a given word has the property cuteness?'' or ``In what perspective two words are similar?''. We verify our method by examining how the strength of property-signifying components correlates with the degree of prototypicality of a target word.

Tasks

Reproductions