SOTAVerified

Lemmatization

Lemmatization is a process of determining a base or dictionary form (lemma) for a given surface form. Especially for languages with rich morphology it is important to be able to normalize words into their base forms to better support for example search engines and linguistic studies. Main difficulties in Lemmatization arise from encountering previously unseen words during inference time as well as disambiguating ambiguous surface forms which can be inflected variants of several different base forms depending on the context.

Source: Universal Lemmatizer: A Sequence to Sequence Model for Lemmatizing Universal Dependencies Treebanks

Papers

Showing 2650 of 351 papers

TitleStatusHype
Morphological parsing of low‑resource languagesCode0
An Automated Text Categorization Framework based on Hyperparameter OptimizationCode0
NLP-Cube: End-to-End Raw Text Processing With Neural NetworksCode0
LemmaTag: Jointly Tagging and Lemmatizing for Morphologically Rich Languages with BRNNsCode0
Lexicon and Rule-based Word Lemmatization Approach for the Somali LanguageCode0
Joint Learning of POS and Dependencies for Multilingual Universal Dependency ParsingCode0
Analyzing Pre-processing Settings for Urdu Single-document Extractive SummarizationCode0
Improving Lemmatization of Non-Standard Languages with Joint LearningCode0
Grammatical gender associations outweigh topical gender bias in crosslinguistic word embeddingsCode0
A Study of fastText Word Embedding Effects in Document Classification in Bangla LanguageCode0
From Text to Lexicon: Bridging the Gap between Word Embeddings and Lexical ResourcesCode0
Knowledge Authoring with Factual EnglishCode0
Enhancing Sequence-to-Sequence Neural Lemmatization with External ResourcesCode0
DBTagger: Multi-Task Learning for Keyword Mapping in NLIDBs Using Bi-Directional Recurrent Neural NetworksCode0
Transformers on Multilingual Clause-Level MorphologyCode0
Training Data Augmentation for Context-Sensitive Neural Lemmatization Using Inflection Tables and Raw TextCode0
Heidelberg-Boston @ SIGTYP 2024 Shared Task: Enhancing Low-Resource Language Analysis With Character-Aware Hierarchical TransformersCode0
Development of a Hindi LemmatizerCode0
Imitation Learning for Neural Morphological String TransductionCode0
Integrated Sequence Tagging for Medieval Latin Using Deep Representation LearningCode0
IUCM at SemEval-2018 Task 11: Similar-Topic Texts as a Comprehension Knowledge SourceCode0
Evaluating Shortest Edit Script Methods for Contextual LemmatizationCode0
Cross-Lingual Lemmatization and Morphology Tagging with Two-Stage Multilingual BERT Fine-TuningCode0
CMU-01 at the SIGMORPHON 2019 Shared Task on Crosslinguality and Context in MorphologyCode0
Cross-lingual Named Entity Corpus for Slavic LanguagesCode0
Show:102550
← PrevPage 2 of 15Next →

No leaderboard results yet.