SOTAVerified

Lemmatization

Lemmatization is a process of determining a base or dictionary form (lemma) for a given surface form. Especially for languages with rich morphology it is important to be able to normalize words into their base forms to better support for example search engines and linguistic studies. Main difficulties in Lemmatization arise from encountering previously unseen words during inference time as well as disambiguating ambiguous surface forms which can be inflected variants of several different base forms depending on the context.

Source: Universal Lemmatizer: A Sequence to Sequence Model for Lemmatizing Universal Dependencies Treebanks

Papers

Showing 125 of 351 papers

TitleStatusHype
Open-Source Web Service with Morphological Dictionary-Supplemented Deep Learning for Morphosyntactic Analysis of CzechCode3
Top2Vec: Distributed Representations of TopicsCode2
DadmaTools: Natural Language Processing Toolkit for Persian LanguageCode2
Exploring Large Language Models for Classical PhilologyCode1
TopicModel4J: A Java Package for Topic ModelsCode1
Opera Graeca Adnotata: Building a 34M+ Token Multilayer Corpus for Ancient GreekCode1
Stanza: A Python Natural Language Processing Toolkit for Many Human LanguagesCode1
KLPT – Kurdish Language Processing ToolkitCode1
Neural Morphology Dataset and Models for Multiple Languages, from the Large to the EndangeredCode1
Sentence Embedding Models for Ancient Greek Using Multilingual Knowledge DistillationCode1
A State-of-the-Art Morphosyntactic Parser and Lemmatizer for Ancient GreekCode1
Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language ProcessingCode1
Advancing Hungarian Text Processing with HuSpaCy: Efficient and Accurate NLP PipelinesCode1
ParsiPy: NLP Toolkit for Historical Persian Texts in PythonCode1
One Model is All You Need: ByT5-Sanskrit, a Unified Model for Sanskrit NLP TasksCode1
ELIT: Emory Language and Information ToolkitCode1
HuSpaCy: an industrial-strength Hungarian natural language processing toolkitCode1
Hybrid lemmatization in HuSpaCyCode1
Lemmatization of Historical Old Literary Finnish Texts in Modern OrthographyCode1
From Text to Lexicon: Bridging the Gap between Word Embeddings and Lexical ResourcesCode0
Transformers on Multilingual Clause-Level MorphologyCode0
Grammatical gender associations outweigh topical gender bias in crosslinguistic word embeddingsCode0
Evaluating Shortest Edit Script Methods for Contextual LemmatizationCode0
An Automated Text Categorization Framework based on Hyperparameter OptimizationCode0
Enhancing Sequence-to-Sequence Neural Lemmatization with External ResourcesCode0
Show:102550
← PrevPage 1 of 15Next →

No leaderboard results yet.