SOTAVerified

Lemmatization

Lemmatization is a process of determining a base or dictionary form (lemma) for a given surface form. Especially for languages with rich morphology it is important to be able to normalize words into their base forms to better support for example search engines and linguistic studies. Main difficulties in Lemmatization arise from encountering previously unseen words during inference time as well as disambiguating ambiguous surface forms which can be inflected variants of several different base forms depending on the context.

Source: Universal Lemmatizer: A Sequence to Sequence Model for Lemmatizing Universal Dependencies Treebanks

Papers

Showing 125 of 351 papers

TitleStatusHype
NeoN: A Tool for Automated Detection, Linguistic and LLM-Driven Analysis of Neologisms in Polish0
ParsiPy: NLP Toolkit for Historical Persian Texts in PythonCode1
Breaking the Fake News Barrier: Deep Learning Approaches in Bangla Language0
Context Aware Lemmatization and Morphological Tagging Method in Turkish0
GliLem: Leveraging GliNER for Contextualized Lemmatization in Estonian0
SinaTools: Open Source Toolkit for Arabic Natural Language Processing0
A State-of-the-Art Morphosyntactic Parser and Lemmatizer for Ancient GreekCode1
A Comparative Study of Hybrid Models in Health Misinformation Text Classification0
One Model is All You Need: ByT5-Sanskrit, a Unified Model for Sanskrit NLP TasksCode1
ACE-2005-PT: Corpus for Event Extraction in Portuguese0
eFontes. Part of Speech Tagging and Lemmatization of Medieval Latin Texts.A Cross-Genre Survey0
Open-Source Web Service with Morphological Dictionary-Supplemented Deep Learning for Morphosyntactic Analysis of CzechCode3
Recent advancements in computational morphology : A comprehensive survey0
Heidelberg-Boston @ SIGTYP 2024 Shared Task: Enhancing Low-Resource Language Analysis With Character-Aware Hierarchical TransformersCode0
Joint Lemmatization and Morphological Tagging with LEMMING0
Comparison of Current Approaches to Lemmatization: A Case Study in Estonian0
TartuNLP @ SIGTYP 2024 Shared Task: Adapting XLM-RoBERTa for Ancient and Historical Languages0
Opera Graeca Adnotata: Building a 34M+ Token Multilayer Corpus for Ancient GreekCode1
Cross-lingual Named Entity Corpus for Slavic LanguagesCode0
ZAEBUC-Spoken: A Multilingual Multidialectal Arabic-English Speech Corpus0
Evaluating Shortest Edit Script Methods for Contextual LemmatizationCode0
BanLemma: A Word Formation Dependent Rule and Dictionary Based Bangla LemmatizerCode0
The effect of stemming and lemmatization on Portuguese fake news text classification0
Sentence Embedding Models for Ancient Greek Using Multilingual Knowledge DistillationCode1
Advancing Hungarian Text Processing with HuSpaCy: Efficient and Accurate NLP PipelinesCode1
Show:102550
← PrevPage 1 of 15Next →

No leaderboard results yet.