NorBench -- A Benchmark for Norwegian Language Models
2023-05-06Code Available1· sign in to hype
David Samuel, Andrey Kutuzov, Samia Touileb, Erik Velldal, Lilja Øvrelid, Egil Rønningstad, Elina Sigdel, Anna Palatkina
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/ltgoslo/norbenchOfficialIn paperpytorch★ 14
Abstract
We present NorBench: a streamlined suite of NLP tasks and probes for evaluating Norwegian language models (LMs) on standardized data splits and evaluation metrics. We also introduce a range of new Norwegian language models (both encoder and encoder-decoder based). Finally, we compare and analyze their performance, along with other existing LMs, across the different benchmark tests of NorBench.