SOTAVerified

Lemmatization

Lemmatization is a process of determining a base or dictionary form (lemma) for a given surface form. Especially for languages with rich morphology it is important to be able to normalize words into their base forms to better support for example search engines and linguistic studies. Main difficulties in Lemmatization arise from encountering previously unseen words during inference time as well as disambiguating ambiguous surface forms which can be inflected variants of several different base forms depending on the context.

Source: Universal Lemmatizer: A Sequence to Sequence Model for Lemmatizing Universal Dependencies Treebanks

Papers

Showing 231240 of 351 papers

TitleStatusHype
Morphological Reinflection via Discriminative String Transduction0
Predicting the Compositionality of Nominal Compounds: Giving Word Embeddings a Hard Time0
English-French Document Alignment Based on Keywords and Statistical Translation0
Dealing with word-internal modification and spelling variation in data-driven lemmatization0
UdS-(retrain|distributional|surface): Improving POS Tagging for OOV Words in German CMC and Web Data0
SoMaJo: State-of-the-art tokenization for German web and social media textsCode0
Using longest common subsequence and character models to predict word forms0
The Kyoto University Cross-Lingual Pronoun Translation System0
The GW/UMD CLPsych 2016 Shared Task System0
Leveraging Data-Driven Methods in Word-Level Language Identification for a Multilingual Alpine Heritage Corpus0
Show:102550
← PrevPage 24 of 36Next →

No leaderboard results yet.