SOTAVerified

Lemmatization

Lemmatization is a process of determining a base or dictionary form (lemma) for a given surface form. Especially for languages with rich morphology it is important to be able to normalize words into their base forms to better support for example search engines and linguistic studies. Main difficulties in Lemmatization arise from encountering previously unseen words during inference time as well as disambiguating ambiguous surface forms which can be inflected variants of several different base forms depending on the context.

Source: Universal Lemmatizer: A Sequence to Sequence Model for Lemmatizing Universal Dependencies Treebanks

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 351 papers

TitleStatusHype
Open-Source Web Service with Morphological Dictionary-Supplemented Deep Learning for Morphosyntactic Analysis of CzechCode3
DadmaTools: Natural Language Processing Toolkit for Persian LanguageCode2
Top2Vec: Distributed Representations of TopicsCode2
ParsiPy: NLP Toolkit for Historical Persian Texts in PythonCode1
A State-of-the-Art Morphosyntactic Parser and Lemmatizer for Ancient GreekCode1
One Model is All You Need: ByT5-Sanskrit, a Unified Model for Sanskrit NLP TasksCode1
Opera Graeca Adnotata: Building a 34M+ Token Multilayer Corpus for Ancient GreekCode1
Advancing Hungarian Text Processing with HuSpaCy: Efficient and Accurate NLP PipelinesCode1
Sentence Embedding Models for Ancient Greek Using Multilingual Knowledge DistillationCode1
Hybrid lemmatization in HuSpaCyCode1
Exploring Large Language Models for Classical PhilologyCode1
HuSpaCy: an industrial-strength Hungarian natural language processing toolkitCode1
ELIT: Emory Language and Information ToolkitCode1
Lemmatization of Historical Old Literary Finnish Texts in Modern OrthographyCode1
Neural Morphology Dataset and Models for Multiple Languages, from the Large to the EndangeredCode1
Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language ProcessingCode1
KLPT – Kurdish Language Processing ToolkitCode1
TopicModel4J: A Java Package for Topic ModelsCode1
Stanza: A Python Natural Language Processing Toolkit for Many Human LanguagesCode1
NeoN: A Tool for Automated Detection, Linguistic and LLM-Driven Analysis of Neologisms in Polish—0
Breaking the Fake News Barrier: Deep Learning Approaches in Bangla Language—0
Context Aware Lemmatization and Morphological Tagging Method in Turkish—0
GliLem: Leveraging GliNER for Contextualized Lemmatization in Estonian—0
SinaTools: Open Source Toolkit for Arabic Natural Language Processing—0
A Comparative Study of Hybrid Models in Health Misinformation Text Classification—0
ACE-2005-PT: Corpus for Event Extraction in Portuguese—0
eFontes. Part of Speech Tagging and Lemmatization of Medieval Latin Texts.A Cross-Genre Survey—0
Recent advancements in computational morphology : A comprehensive survey—0
Heidelberg-Boston @ SIGTYP 2024 Shared Task: Enhancing Low-Resource Language Analysis With Character-Aware Hierarchical TransformersCode0
Joint Lemmatization and Morphological Tagging with LEMMING—0
Comparison of Current Approaches to Lemmatization: A Case Study in Estonian—0
TartuNLP @ SIGTYP 2024 Shared Task: Adapting XLM-RoBERTa for Ancient and Historical Languages—0
Cross-lingual Named Entity Corpus for Slavic LanguagesCode0
ZAEBUC-Spoken: A Multilingual Multidialectal Arabic-English Speech Corpus—0
Evaluating Shortest Edit Script Methods for Contextual LemmatizationCode0
BanLemma: A Word Formation Dependent Rule and Dictionary Based Bangla LemmatizerCode0
The effect of stemming and lemmatization on Portuguese fake news text classification—0
Lexicon and Rule-based Word Lemmatization Approach for the Somali LanguageCode0
Vacaspati: A Diverse Corpus of Bangla Literature—0
Advancing Full-Text Search Lemmatization Techniques with Paradigm Retrieval from OpenCorpora—0
LatinCy: Synthetic Trained Pipelines for Latin NLP—0
BRENT: Bidirectional Retrieval Enhanced Norwegian TransformerCode0
Exploring the Use of Foundation Models for Named Entity Recognition and Lemmatization Tasks in Slavic Languages—0
On the Role of Morphological Information for Contextual Lemmatization—0
Automated Identification of Disaster News For Crisis Management Using Machine Learning—0
H2-Golden-Retriever: Methodology and Tool for an Evidence-Based Hydrogen Research Grantsmanship—0
Transformers on Multilingual Clause-Level MorphologyCode0
Development of a rule-based lemmatization algorithm through Finite State Machine for Uzbek language—0
Arabic Word-level Readability Visualization for Assisted Text Simplification—0
Social Media Personal Event Notifier Using NLP and Machine Learning—0
Show:102550
← PrevPage 1 of 8Next →

No leaderboard results yet.