SOTAVerified

Lemmatization

Lemmatization is a process of determining a base or dictionary form (lemma) for a given surface form. Especially for languages with rich morphology it is important to be able to normalize words into their base forms to better support for example search engines and linguistic studies. Main difficulties in Lemmatization arise from encountering previously unseen words during inference time as well as disambiguating ambiguous surface forms which can be inflected variants of several different base forms depending on the context.

Source: Universal Lemmatizer: A Sequence to Sequence Model for Lemmatizing Universal Dependencies Treebanks

Papers

Showing 51100 of 351 papers

TitleStatusHype
Abusive and Threatening Language Detection in Urdu using Supervised Machine Learning and Feature Combinations0
Biaffine Dependency and Semantic Graph Parsing for EnhancedUniversal Dependencies0
BioRo: The Biomedical Corpus for the Romanian Language0
bleu2vec: the Painfully Familiar Metric on Continuous Vector Space Steroids0
Breaking the Fake News Barrier: Deep Learning Approaches in Bangla Language0
An Evaluation of Lexicon-based Sentiment Analysis Techniques for the Plays of Gotthold Ephraim Lessing0
Build Fast and Accurate Lemmatization for Arabic0
Building a Lemmatizer and a Spell-checker for Sorani Kurdish0
Building a multilingual parallel corpus for human users0
Building Large Monolingual Dictionaries at the Leipzig Corpora Collection: From 100 to 200 Languages0
CBNU System for SIGMORPHON 2019 Shared Task 2: a Pipeline Model0
CELI: An Experiment with Cross Language Textual Entailment0
DKPro Similarity: An Open Source Framework for Text Similarity0
eFontes. Part of Speech Tagging and Lemmatization of Medieval Latin Texts.A Cross-Genre Survey0
Corpora and Processing Tools for Non-standard Contemporary and Diachronic Balkan Slavic0
ASOBEK at SemEval-2016 Task 1: Sentence Representation with Character N-gram Embeddings for Semantic Textual Similarity0
Analysing cross-lingual transfer in lemmatisation for Indian languages0
A Simple Joint Model for Improved Contextual Neural Lemmatization0
Context based lemmatizer for Polish language0
Context Aware Lemmatization and Morphological Tagging Method in Turkish0
A set of open source tools for Turkish natural language processing0
Analyse Automatique de l’Ancien Arménien. Évaluation d’une méthode hybride « dictionnaire » et « réseau de neurones » sur un Extrait de l’Adversus Haereses d’Irénée de Lyon0
Context Sensitive Lemmatization Using Two Successive Bidirectional Gated Recurrent Networks0
Context Sensitive Neural Lemmatization with Lematus0
Coreference Resolution in FreeLing 4.00
CoRoLa --- The Reference Corpus of Contemporary Romanian Language0
Adapting the TTL Romanian POS Tagger to the Biomedical Domain0
Counting What Counts: Decompounding for Keyphrase Extraction0
CroDeriV: a new resource for processing Croatian morphology0
Cross-Language Plagiarism Detection Methods0
Attention-free encoder decoder for morphological processing0
A data-driven approach to verbal multiword expression detection. PARSEME Shared Task system description paper0
CUNI--Malta system at SIGMORPHON 2019 Shared Task on Morphological Analysis and Lemmatization in context: Operation-based word formation0
CURE: Collection for Urdu Information Retrieval Evaluation and Ranking0
Czech Text Processing with Contextual Embeddings: POS Tagging, Lemmatization, Parsing and NER0
Constraint 2021: Machine Learning Models for COVID-19 Fake News Detection Shared Task0
Automated Identification of Disaster News For Crisis Management Using Machine Learning0
Data-Driven Morphological Analysis for Uralic Languages0
Automatically Acquired Lexical Knowledge Improves Japanese Joint Morphological and Dependency Analysis0
Dealing with word-internal modification and spelling variation in data-driven lemmatization0
DerivBase.hr: A High-Coverage Derivational Morphology Resource for Croatian0
Describing Language Variation in the Colophons of Armenian Manuscripts0
Developing New Linguistic Resources and Tools for the Galician Language0
Automatic Extraction of Synonyms for German Particle Verbs from Parallel Data with Distributional Similarity as a Re-Ranking Feature0
Compounds and distributional thesauri0
Development of email classifier in Brazilian Portuguese using feature selection for automatic response0
Diachronic Parsing of Pre-Standard Irish0
Distant Reading in Digital Humanities: Case Study on the Serbian Part of the ELTeC Collection0
Distributional regularities of verbs and verbal adjectives: Treebank evidence and broader implications0
A Resource for Studying Chatino Verbal Morphology0
Show:102550
← PrevPage 2 of 8Next →

No leaderboard results yet.