SOTAVerified

Lemmatization

Lemmatization is a process of determining a base or dictionary form (lemma) for a given surface form. Especially for languages with rich morphology it is important to be able to normalize words into their base forms to better support for example search engines and linguistic studies. Main difficulties in Lemmatization arise from encountering previously unseen words during inference time as well as disambiguating ambiguous surface forms which can be inflected variants of several different base forms depending on the context.

Source: Universal Lemmatizer: A Sequence to Sequence Model for Lemmatizing Universal Dependencies Treebanks

Papers

Showing 2650 of 351 papers

TitleStatusHype
Lexicon and Rule-based Word Lemmatization Approach for the Somali LanguageCode0
Vacaspati: A Diverse Corpus of Bangla Literature0
Hybrid lemmatization in HuSpaCyCode1
Exploring Large Language Models for Classical PhilologyCode1
Advancing Full-Text Search Lemmatization Techniques with Paradigm Retrieval from OpenCorpora0
LatinCy: Synthetic Trained Pipelines for Latin NLP0
BRENT: Bidirectional Retrieval Enhanced Norwegian TransformerCode0
Exploring the Use of Foundation Models for Named Entity Recognition and Lemmatization Tasks in Slavic Languages0
On the Role of Morphological Information for Contextual Lemmatization0
Automated Identification of Disaster News For Crisis Management Using Machine Learning0
H2-Golden-Retriever: Methodology and Tool for an Evidence-Based Hydrogen Research Grantsmanship0
Transformers on Multilingual Clause-Level MorphologyCode0
Development of a rule-based lemmatization algorithm through Finite State Machine for Uzbek language0
Arabic Word-level Readability Visualization for Assisted Text Simplification0
Social Media Personal Event Notifier Using NLP and Machine Learning0
Evaluating Diversity of Multiword Expressions in Annotated Text0
Knowledge Authoring with Factual EnglishCode0
Context based lemmatizer for Polish language0
TArC: Tunisian Arabish Corpus First complete release0
DadmaTools: Natural Language Processing Toolkit for Persian LanguageCode2
Stylistic Fingerprints, POS-tags and Inflected Languages: A Case Study in PolishCode0
Diachronic Parsing of Pre-Standard Irish0
Transformer-based Part-of-Speech Tagging and Lemmatization for Latin0
AGILe: The First Lemmatizer for Ancient Greek Inscriptions0
An ELECTRA Model for Latin Token Tagging Tasks0
Show:102550
← PrevPage 2 of 15Next →

No leaderboard results yet.