Czech Dataset for Semantic Similarity and Relatedness
Miloslav Konop{\'\i}k, Ond{\v{r}}ej Pra{\v{z}}{\'a}k, David Steinberger
Unverified — Be the first to reproduce this paper.
ReproduceAbstract
This paper introduces a Czech dataset for semantic similarity and semantic relatedness. The dataset contains word pairs with hand annotated scores that indicate the semantic similarity and semantic relatedness of the words. The dataset contains 953 word pairs compiled from 9 different sources. It contains words and their contexts taken from real text corpora including extra examples when the words are ambiguous. The dataset is annotated by 5 independent annotators. The average Spearman correlation coefficient of the annotation agreement is r = 0.81. We provide reference evaluation experiments with several methods for computing semantic similarity and relatedness.