SOTAVerified

Lemmatization

Lemmatization is a process of determining a base or dictionary form (lemma) for a given surface form. Especially for languages with rich morphology it is important to be able to normalize words into their base forms to better support for example search engines and linguistic studies. Main difficulties in Lemmatization arise from encountering previously unseen words during inference time as well as disambiguating ambiguous surface forms which can be inflected variants of several different base forms depending on the context.

Source: Universal Lemmatizer: A Sequence to Sequence Model for Lemmatizing Universal Dependencies Treebanks

Papers

Showing 151200 of 351 papers

TitleStatusHype
Leveraging Inflection Tables for Stemming and Lemmatization.0
Lexical Categories for Improved Parsing of Web Data0
Lexical Correction of Polish Twitter Political Data0
Lexicon-assisted tagging and lemmatization in Latin: A comparison of six taggers and two lemmatization methods0
Linguistic Analysis Processing Line for Bulgarian0
Linguistic change and historical periodization of Old Literary Finnish0
Local String Transduction as Sequence Labeling0
[LVIC-LIMSI]: Using Syntactic Features and Multi-polarity Words for Sentiment Analysis in Twitter0
Machine Learning and Deep Neural Network-Based Lemmatization and Morphosyntactic Tagging for Serbian0
MADAMIRA: A Fast, Comprehensive Tool for Morphological Analysis and Disambiguation of Arabic0
Material Philology Meets Digital Onomastic Lexicography: The NordiCon Database of Medieval Nordic Personal Names in Continental Sources0
Merging Data Resources for Inflectional and Derivational Morphology in Czech0
Mining wisdom0
Modernizing historical Slovene words with character-based SMT0
Morphological Analysis and Disambiguation for Dialectal Arabic0
Morphological Analysis Corpus Construction of Uyghur0
Morphological Analysis for Unsegmented Languages using Recurrent Neural Network Language Model0
Morphological Reinflection via Discriminative String Transduction0
Moving TIGER beyond Sentence-Level0
Multilevel Text Normalization with Sequence-to-Sequence Networks and Multisource Learning0
Multilingwis ^2 -- Explore Your Parallel Corpus0
Multiple Many-to-Many Sequence Alignment for Combining String-Valued Variables: A G2P Experiment0
Multi-Team: A Multi-attention, Multi-decoder Approach to Morphological Analysis.0
Named Entity Recognition and Linking Augmented with Large-Scale Structured Data0
Nefnir: A high accuracy lemmatizer for Icelandic0
NeoN: A Tool for Automated Detection, Linguistic and LLM-Driven Analysis of Neologisms in Polish0
NeoTag: a POS Tagger for Grammatical Neologism Detection0
Neural Lemmatization of Multiword Expressions0
Neural Polysynthetic Language Modelling0
N-Gramas de Caractere como T\'ecnica de Normaliza \~ao Morfol\'ogica para L\' Portuguesa: Um Estudo em Categoriza \~ao de Textos (Character N-grams as a Morphological Normalization Technique for Portuguese Language: A Study in Text Categorization)0
Non-Standard Words as Features for Text Categorization0
NRC: A Machine Translation Approach to Cross-Lingual Word Sense Disambiguation (SemEval-2013 Task 10)0
NRC Russian-English Machine Translation System for WMT 20160
On the Effectiveness of Dataset Embeddings in Mono-lingual,Multi-lingual and Zero-shot Conditions0
On the Role of Morphological Information for Contextual Lemmatization0
Open-Source Tools for Morphology, Lemmatization, POS Tagging and Named Entity Recognition0
Optimizing a Distributional Semantic Model for the Prediction of German Particle Verb Compositionality0
Overview of the EvaLatin 2020 Evaluation Campaign0
Overview of the EvaLatin 2022 Evaluation Campaign0
Oxford at SemEval-2017 Task 9: Neural AMR Parsing with Pointer-Augmented Attention0
Parser combinators for Tigrinya and Oromo morphology0
Persian Sentiment Analyzer: A Framework based on a Novel Feature Selection Method0
Polish Coreference Corpus in Numbers0
POS tagging, lemmatization and dependency parsing of West Frisian0
Predicting the Compositionality of Nominal Compounds: Giving Word Embeddings a Hard Time0
Probabilistic Lexical Generalization for French Dependency Parsing0
Processing and Normalizing Hashtags0
Producing Corpora of Medieval and Premodern Occitan0
PurePos 2.0: a hybrid tool for morphological disambiguation0
QLUT at SemEval-2017 Task 1: Semantic Textual Similarity Based on Word Embeddings0
Show:102550
← PrevPage 4 of 8Next →

No leaderboard results yet.