Uralic Language Identification (ULI) 2020 shared task dataset and the Wanca 2017 corpus
2020-08-27Unverified0· sign in to hype
Tommi Jauhiainen, Heidi Jauhiainen, Niko Partanen, Krister Lindén
Unverified — Be the first to reproduce this paper.
ReproduceAbstract
This article introduces the Wanca 2017 corpus of texts crawled from the internet from which the sentences in rare Uralic languages for the use of the Uralic Language Identification (ULI) 2020 shared task were collected. We describe the ULI dataset and how it was constructed using the Wanca 2017 corpus and texts in different languages from the Leipzig corpora collection. We also provide baseline language identification experiments conducted using the ULI 2020 dataset.