SOTAVerified

Lemmatization

Lemmatization is a process of determining a base or dictionary form (lemma) for a given surface form. Especially for languages with rich morphology it is important to be able to normalize words into their base forms to better support for example search engines and linguistic studies. Main difficulties in Lemmatization arise from encountering previously unseen words during inference time as well as disambiguating ambiguous surface forms which can be inflected variants of several different base forms depending on the context.

Source: Universal Lemmatizer: A Sequence to Sequence Model for Lemmatizing Universal Dependencies Treebanks

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 351 papers

TitleStatusHype
Open-Source Web Service with Morphological Dictionary-Supplemented Deep Learning for Morphosyntactic Analysis of CzechCode3
Top2Vec: Distributed Representations of TopicsCode2
DadmaTools: Natural Language Processing Toolkit for Persian LanguageCode2
ELIT: Emory Language and Information ToolkitCode1
ParsiPy: NLP Toolkit for Historical Persian Texts in PythonCode1
Sentence Embedding Models for Ancient Greek Using Multilingual Knowledge DistillationCode1
Lemmatization of Historical Old Literary Finnish Texts in Modern OrthographyCode1
HuSpaCy: an industrial-strength Hungarian natural language processing toolkitCode1
A State-of-the-Art Morphosyntactic Parser and Lemmatizer for Ancient GreekCode1
Stanza: A Python Natural Language Processing Toolkit for Many Human LanguagesCode1
Opera Graeca Adnotata: Building a 34M+ Token Multilayer Corpus for Ancient GreekCode1
Exploring Large Language Models for Classical PhilologyCode1
Neural Morphology Dataset and Models for Multiple Languages, from the Large to the EndangeredCode1
Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language ProcessingCode1
Hybrid lemmatization in HuSpaCyCode1
TopicModel4J: A Java Package for Topic ModelsCode1
Advancing Hungarian Text Processing with HuSpaCy: Efficient and Accurate NLP PipelinesCode1
KLPT – Kurdish Language Processing ToolkitCode1
One Model is All You Need: ByT5-Sanskrit, a Unified Model for Sanskrit NLP TasksCode1
Resource-Size matters: Improving Neural Named Entity Recognition with Optimized Large CorporaCode0
Neural Transition-based String Transduction for Limited-Resource Setting in MorphologyCode0
Revisiting NMT for Normalization of Early English LettersCode0
Morpheus: A Neural Network for Jointly Learning Contextual Lemmatization and Morphological TaggingCode0
Morphological Tagging and Lemmatization of Albanian: A Manually Annotated Corpus and Neural ModelsCode0
BanLemma: A Word Formation Dependent Rule and Dictionary Based Bangla LemmatizerCode0
Morphological parsing of low‑resource languagesCode0
An Automated Text Categorization Framework based on Hyperparameter OptimizationCode0
NLP-Cube: End-to-End Raw Text Processing With Neural NetworksCode0
LemmaTag: Jointly Tagging and Lemmatizing for Morphologically Rich Languages with BRNNsCode0
Lexicon and Rule-based Word Lemmatization Approach for the Somali LanguageCode0
Joint Learning of POS and Dependencies for Multilingual Universal Dependency ParsingCode0
Analyzing Pre-processing Settings for Urdu Single-document Extractive SummarizationCode0
Improving Lemmatization of Non-Standard Languages with Joint LearningCode0
Grammatical gender associations outweigh topical gender bias in crosslinguistic word embeddingsCode0
A Study of fastText Word Embedding Effects in Document Classification in Bangla LanguageCode0
From Text to Lexicon: Bridging the Gap between Word Embeddings and Lexical ResourcesCode0
Knowledge Authoring with Factual EnglishCode0
Enhancing Sequence-to-Sequence Neural Lemmatization with External ResourcesCode0
DBTagger: Multi-Task Learning for Keyword Mapping in NLIDBs Using Bi-Directional Recurrent Neural NetworksCode0
Transformers on Multilingual Clause-Level MorphologyCode0
Training Data Augmentation for Context-Sensitive Neural Lemmatization Using Inflection Tables and Raw TextCode0
Heidelberg-Boston @ SIGTYP 2024 Shared Task: Enhancing Low-Resource Language Analysis With Character-Aware Hierarchical TransformersCode0
Development of a Hindi LemmatizerCode0
Imitation Learning for Neural Morphological String TransductionCode0
Integrated Sequence Tagging for Medieval Latin Using Deep Representation LearningCode0
IUCM at SemEval-2018 Task 11: Similar-Topic Texts as a Comprehension Knowledge SourceCode0
Evaluating Shortest Edit Script Methods for Contextual LemmatizationCode0
Cross-Lingual Lemmatization and Morphology Tagging with Two-Stage Multilingual BERT Fine-TuningCode0
CMU-01 at the SIGMORPHON 2019 Shared Task on Crosslinguality and Context in MorphologyCode0
Cross-lingual Named Entity Corpus for Slavic LanguagesCode0
Show:102550
← PrevPage 1 of 8Next →

No leaderboard results yet.