SOTAVerified

Lemmatization

Lemmatization is a process of determining a base or dictionary form (lemma) for a given surface form. Especially for languages with rich morphology it is important to be able to normalize words into their base forms to better support for example search engines and linguistic studies. Main difficulties in Lemmatization arise from encountering previously unseen words during inference time as well as disambiguating ambiguous surface forms which can be inflected variants of several different base forms depending on the context.

Source: Universal Lemmatizer: A Sequence to Sequence Model for Lemmatizing Universal Dependencies Treebanks

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 201–250 of 351 papers

TitleStatusHype
RACAI's Natural Language Processing pipeline for Universal Dependencies—0
Realignment from Finer-grained Alignment to Coarser-grained Alignment to Enhance Mongolian-Chinese SMT—0
Recent advancements in computational morphology : A comprehensive survey—0
Recycling and Comparing Morphological Annotation Models for Armenian Diachronic-Variational Corpus Processing—0
Robustness of sentence length measures in written texts—0
ROMBAC: The Romanian Balanced Annotated Corpus—0
Rule-based Automatic Multi-word Term Extraction and Lemmatization—0
SAMAR: A System for Subjectivity and Sentiment Analysis of Arabic Social Media—0
SentiArabic: A Sentiment Analyzer for Standard Arabic—0
Services for text simplification and analysis—0
Sharing Cultural Heritage: the Clavius on the Web Project—0
Sigmorphon 2019 Task 2 system description paper: Morphological analysis in context for many languages, with supervision from only a few—0
Simultaneous Word-Morpheme Alignment for Statistical Machine Translation—0
SinaTools: Open Source Toolkit for Arabic Natural Language Processing—0
Social Media Personal Event Notifier Using NLP and Machine Learning—0
Spelling Correction for Morphologically Rich Language: a Case Study of Russian—0
SSA-UO: Unsupervised Sentiment Analysis in Twitter—0
Statistical Parsing of Spanish and Data Driven Lemmatization—0
Still not there? Comparing Traditional Sequence-to-Sequence Models to Encoder-Decoder Neural Networks on Monotone String Translation Tasks—0
Supervised and Unsupervised Categorization of an Imbalanced Italian Crime News Dataset—0
SU-RUG at the CoNLL-SIGMORPHON 2017 shared task: Morphological Inflection with Attentional Sequence-to-Sequence Models—0
Synergistic Union of Word2Vec and Lexicon for Domain Specific Semantic Similarity—0
TArC: Tunisian Arabish Corpus First complete release—0
TArC: Tunisian Arabish Corpus, First complete release—0
TartuNLP @ SIGTYP 2024 Shared Task: Adapting XLM-RoBERTa for Ancient and Historical Languages—0
The 2021 Urdu Fake News Detection Task using Supervised Machine Learning and Feature Combinations—0
The annotation of the C-ORAL-BRASIL oral through the implementation of the Palavras Parser—0
The CMU Machine Translation Systems at WMT 2014—0
The COPLE2 corpus: a learner corpus for Portuguese—0
The effect of stemming and lemmatization on Portuguese fake news text classification—0
The Effects of Syntactic Features in Automatic Prediction of Morphology—0
The First Cross-Lingual Challenge on Recognition, Normalization, and Matching of Named Entities in Slavic Languages—0
The Floating Arabic Dictionary: An Automatic Method for Updating a Lexical Database through the Detection and Lemmatization of Unknown Words—0
The goo300k corpus of historical Slovene—0
The GW/UMD CLPsych 2016 Shared Task System—0
The impact of simple feature engineering in multilingual medical NER—0
The IPR-cleared Corpus of Contemporary Written and Spoken Romanian Language—0
The Kyoto University Cross-Lingual Pronoun Translation System—0
The Netlog Corpus. A Resource for the Study of Flemish Dutch Internet Language—0
The Political Speech Corpus of Bulgarian—0
The Power of Language Music: Arabic Lemmatization through Patterns—0
The Reading Machine: A Versatile Framework for Studying Incremental Parsing Strategies—0
The SETimes.HR Linguistically Annotated Corpus of Croatian—0
The SIGMORPHON 2019 Shared Task: Morphological Analysis in Context and Cross-Lingual Transfer for Inflection—0
The SYN-series corpora of written Czech—0
The Use of Text Alignment in Semi-Automatic Error Analysis: Use Case in the Development of the Corpus of the Latvian Language Learners—0
Tokenizing, POS Tagging, Lemmatizing and Parsing UD 2.0 with UDPipe—0
To lemmatize or not to lemmatize: how word normalisation affects ELMo performance in word sense disambiguation—0
Tolerant BLEU: a Submission to the WMT14 Metrics Task—0
Towards an automatic identification of chiasmus of words (Vers une identification automatique du chiasme de mots) [in French]—0
Show:102550
← PrevPage 5 of 8Next →

No leaderboard results yet.