SOTAVerified

Lemmatization

Lemmatization is a process of determining a base or dictionary form (lemma) for a given surface form. Especially for languages with rich morphology it is important to be able to normalize words into their base forms to better support for example search engines and linguistic studies. Main difficulties in Lemmatization arise from encountering previously unseen words during inference time as well as disambiguating ambiguous surface forms which can be inflected variants of several different base forms depending on the context.

Source: Universal Lemmatizer: A Sequence to Sequence Model for Lemmatizing Universal Dependencies Treebanks

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 351 papers

TitleStatusHype
Describing Language Variation in the Colophons of Armenian Manuscripts—0
Analyse Automatique de l’Ancien Arménien. Évaluation d’une méthode hybride « dictionnaire » et « réseau de neurones » sur un Extrait de l’Adversus Haereses d’Irénée de Lyon—0
Overview of the EvaLatin 2022 Evaluation Campaign—0
Towards the Creation of a Diachronic Corpus for Italian: A Case Study on the GDLI Quotations—0
Distant Reading in Digital Humanities: Case Study on the Serbian Part of the ELTeC Collection—0
TArC: Tunisian Arabish Corpus, First complete release—0
ZAEBUC: An Annotated Arabic-English Bilingual Writer Corpus—0
The 2021 Urdu Fake News Detection Task using Supervised Machine Learning and Feature Combinations—0
Abusive and Threatening Language Detection in Urdu using Supervised Machine Learning and Feature Combinations—0
Supervised and Unsupervised Categorization of an Imbalanced Italian Crime News Dataset—0
HuSpaCy: an industrial-strength Hungarian natural language processing toolkitCode1
ELIT: Emory Language and Information ToolkitCode1
Morphological Analysis Corpus Construction of Uyghur—0
Linguistic change and historical periodization of Old Literary Finnish—0
End-to-end mBERT based Seq2seq Enhanced Dependency Parser with Linguistic Typology knowledge—0
Biaffine Dependency and Semantic Graph Parsing for EnhancedUniversal Dependencies—0
The Reading Machine: A Versatile Framework for Studying Incremental Parsing Strategies—0
POS tagging, lemmatization and dependency parsing of West Frisian—0
Lemmatization of Historical Old Literary Finnish Texts in Modern OrthographyCode1
A Case Study of Spanish Text Transformations for Twitter Sentiment Analysis—0
Évaluation de méthodes et d’outils pour la lemmatisation automatique du français médiéval (Evaluation of methods and tools for automatic lemmatization in Old French)—0
How low is too low? A monolingual take on lemmatisation in Indian languages—0
Neural Morphology Dataset and Models for Multiple Languages, from the Large to the EndangeredCode1
Learning to Lemmatize in the Word Representation Space—0
Named Entity Recognition and Linking Augmented with Large-Scale Structured Data—0
On the Effectiveness of Dataset Embeddings in Mono-lingual,Multi-lingual and Zero-shot Conditions—0
Enhancing Sequence-to-Sequence Neural Lemmatization with External ResourcesCode0
DBTagger: Multi-Task Learning for Keyword Mapping in NLIDBs Using Bi-Directional Recurrent Neural NetworksCode0
Constraint 2021: Machine Learning Models for COVID-19 Fake News Detection Shared Task—0
Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language ProcessingCode1
The Role of Interpretable Patterns in Deep Learning for MorphologyCode0
Recycling and Comparing Morphological Annotation Models for Armenian Diachronic-Variational Corpus Processing—0
Utilizing Subword Entities in Character-Level Sequence-to-Sequence Lemmatization Models—0
Analysing cross-lingual transfer in lemmatisation for Indian languages—0
KLPT – Kurdish Language Processing ToolkitCode1
CURE: Collection for Urdu Information Retrieval Evaluation and Ranking—0
TopicModel4J: A Java Package for Topic ModelsCode1
LemMED: Fast and Effective Neural Morphological Analysis with Short Context Windows—0
Top2Vec: Distributed Representations of TopicsCode2
A Study of fastText Word Embedding Effects in Document Classification in Bangla LanguageCode0
Turku Enhanced Parser Pipeline: From Raw Text to Enhanced Graphs in the IWPT 2020 Shared Task—0
Tagging and parsing of multidomain collectionsCode0
UDPipe at EvaLatin 2020: Contextualized Embeddings and Treebank Embeddings—0
The Frankfurt Latin Lexicon: From Morphological Expansion and Word Embeddings to SemioGraphsCode0
Grammatical gender associations outweigh topical gender bias in crosslinguistic word embeddingsCode0
Neural Polysynthetic Language Modelling—0
EmpiriST Corpus 2.0: Adding Manual Normalization, Lemmatization and Semantic Tagging to a German Web and CMC Corpus—0
Machine Learning and Deep Neural Network-Based Lemmatization and Morphosyntactic Tagging for Serbian—0
Better Together: Modern Methods Plus Traditional Thinking in NP Alignment—0
BabyFST - Towards a Finite-State Based Computational Model of Ancient Babylonian—0
Show:102550
← PrevPage 2 of 8Next →

No leaderboard results yet.