SOTAVerified

Lemmatization

Lemmatization is a process of determining a base or dictionary form (lemma) for a given surface form. Especially for languages with rich morphology it is important to be able to normalize words into their base forms to better support for example search engines and linguistic studies. Main difficulties in Lemmatization arise from encountering previously unseen words during inference time as well as disambiguating ambiguous surface forms which can be inflected variants of several different base forms depending on the context.

Source: Universal Lemmatizer: A Sequence to Sequence Model for Lemmatizing Universal Dependencies Treebanks

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 351 papers

TitleStatusHype
Open-Source Web Service with Morphological Dictionary-Supplemented Deep Learning for Morphosyntactic Analysis of CzechCode3
DadmaTools: Natural Language Processing Toolkit for Persian LanguageCode2
Top2Vec: Distributed Representations of TopicsCode2
Advancing Hungarian Text Processing with HuSpaCy: Efficient and Accurate NLP PipelinesCode1
Exploring Large Language Models for Classical PhilologyCode1
A State-of-the-Art Morphosyntactic Parser and Lemmatizer for Ancient GreekCode1
Neural Morphology Dataset and Models for Multiple Languages, from the Large to the EndangeredCode1
Sentence Embedding Models for Ancient Greek Using Multilingual Knowledge DistillationCode1
TopicModel4J: A Java Package for Topic ModelsCode1
Opera Graeca Adnotata: Building a 34M+ Token Multilayer Corpus for Ancient GreekCode1
HuSpaCy: an industrial-strength Hungarian natural language processing toolkitCode1
ELIT: Emory Language and Information ToolkitCode1
KLPT – Kurdish Language Processing ToolkitCode1
Stanza: A Python Natural Language Processing Toolkit for Many Human LanguagesCode1
One Model is All You Need: ByT5-Sanskrit, a Unified Model for Sanskrit NLP TasksCode1
Hybrid lemmatization in HuSpaCyCode1
Lemmatization of Historical Old Literary Finnish Texts in Modern OrthographyCode1
ParsiPy: NLP Toolkit for Historical Persian Texts in PythonCode1
Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language ProcessingCode1
AI-KU: Using Co-Occurrence Modeling for Semantic Similarity—0
A Gradient Boosting-Seq2Seq System for Latin POS Tagging and Lemmatization—0
Adapting and evaluating a generic term extraction tool—0
An ELECTRA Model for Latin Token Tagging Tasks—0
AGILe: The First Lemmatizer for Ancient Greek Inscriptions—0
Acquisition of semantic relations between terms: how far can we get with standard NLP tools?—0
A Neural Lemmatizer for Bengali—0
An Evaluation of Lexicon-based Sentiment Analysis Techniques for the Plays of Gotthold Ephraim Lessing—0
An extended morphological analyzer of German handling verbal forms with separated separable particles (Un analyseur morphologique \'etendu de l'allemand traitant les formes verbales \`a particule s\'epar\'ee) [in French]—0
An Extensible Multilingual Open Source Lemmatizer—0
ANNLOR: A Na\" Notation-system for Lexical Outputs Ranking—0
Automatic Translation of English Text to Indian Sign Language Synthetic Animations—0
A Case Study of Spanish Text Transformations for Twitter Sentiment Analysis—0
Biaffine Dependency and Semantic Graph Parsing for EnhancedUniversal Dependencies—0
BioRo: The Biomedical Corpus for the Romanian Language—0
An annotated English child language database—0
Advancing Full-Text Search Lemmatization Techniques with Paradigm Retrieval from OpenCorpora—0
A Comparative Study of Hybrid Models in Health Misinformation Text Classification—0
A unified lexical processing framework based on the Margin Infused Relaxed Algorithm. A case study on the Romanian Language—0
Analyzing and Aligning German compound nouns—0
Attention-free encoder decoder for morphological processing—0
An Analysis of Lemmatization on Topic Models of Morphologically Rich Language—0
Authorship Attribution Based on Life-Like Network Automata—0
Automated Identification of Disaster News For Crisis Management Using Machine Learning—0
Automatically Acquired Lexical Knowledge Improves Japanese Joint Morphological and Dependency Analysis—0
Automatic Categorization of Tagalog Documents Using Support Vector Machines—0
Automatic Extraction of Synonyms for German Particle Verbs from Parallel Data with Distributional Similarity as a Re-Ranking Feature—0
A data-driven approach to verbal multiword expression detection. PARSEME Shared Task system description paper—0
BabyFST - Towards a Finite-State Based Computational Model of Ancient Babylonian—0
An efficient language independent toolkit for complete morphological disambiguation—0
ACE-2005-PT: Corpus for Event Extraction in Portuguese—0
Show:102550
← PrevPage 1 of 8Next →

No leaderboard results yet.