SOTAVerified

Lemmatization

Lemmatization is a process of determining a base or dictionary form (lemma) for a given surface form. Especially for languages with rich morphology it is important to be able to normalize words into their base forms to better support for example search engines and linguistic studies. Main difficulties in Lemmatization arise from encountering previously unseen words during inference time as well as disambiguating ambiguous surface forms which can be inflected variants of several different base forms depending on the context.

Source: Universal Lemmatizer: A Sequence to Sequence Model for Lemmatizing Universal Dependencies Treebanks

Papers

Showing 251300 of 351 papers

TitleStatusHype
Merging Data Resources for Inflectional and Derivational Morphology in Czech0
A Neural Lemmatizer for Bengali0
The COPLE2 corpus: a learner corpus for Portuguese0
The IPR-cleared Corpus of Contemporary Written and Spoken Romanian Language0
Rule-based Automatic Multi-word Term Extraction and Lemmatization0
Integrated Sequence Tagging for Medieval Latin Using Deep Representation LearningCode0
N-Gramas de Caractere como T\'ecnica de Normaliza \~ao Morfol\'ogica para L\' Portuguesa: Um Estudo em Categoriza \~ao de Textos (Character N-grams as a Morphological Normalization Technique for Portuguese Language: A Study in Text Categorization)0
Realignment from Finer-grained Alignment to Coarser-grained Alignment to Enhance Mongolian-Chinese SMT0
Processing and Normalizing Hashtags0
E-law Module Supporting Lawyers in the Process of Knowledge Discovery from Legal Documents0
Do we need bigram alignment models? On the effect of alignment quality on transduction accuracy in G2P0
Morphological Analysis for Unsegmented Languages using Recurrent Neural Network Language Model0
Counting What Counts: Decompounding for Keyphrase Extraction0
Lexicon-assisted tagging and lemmatization in Latin: A comparison of six taggers and two lemmatization methods0
Learning Representations for Text-level Discourse Parsing0
IWNLP: Inverse Wiktionary for Natural Language Processing0
Multiple Many-to-Many Sequence Alignment for Combining String-Valued Variables: A G2P Experiment0
A Publicly Available Cross-Platform Lemmatizer for Bulgarian0
Evaluation of the Accuracy of the BGLemmatizer0
JAIST: Combining multiple features for Answer Selection in Community Question Answering0
Enhancing Sumerian Lemmatization by Unsupervised Named-Entity Recognition0
Persian Sentiment Analyzer: A Framework based on a Novel Feature Selection Method0
Non-Standard Words as Features for Text Categorization0
Towards Semantic Validation of a Derivational Lexicon0
Illinois-LH: A Denotational and Distributional Approach to Semantics0
AI-KU: Using Co-Occurrence Modeling for Semantic Similarity0
Tolerant BLEU: a Submission to the WMT14 Metrics Task0
The CMU Machine Translation Systems at WMT 20140
DKPro Keyphrases: Flexible and Reusable Keyphrase Extraction Experiments0
Open-Source Tools for Morphology, Lemmatization, POS Tagging and Named Entity Recognition0
Optimizing a Distributional Semantic Model for the Prediction of German Particle Verb Compositionality0
A set of open source tools for Turkish natural language processing0
MADAMIRA: A Fast, Comprehensive Tool for Morphological Analysis and Disambiguation of Arabic0
Compounds and distributional thesauri0
CoRoLa --- The Reference Corpus of Contemporary Romanian Language0
Two-Step Machine Translation with Lattices0
An efficient language independent toolkit for complete morphological disambiguation0
Automatic Extraction of Synonyms for German Particle Verbs from Parallel Data with Distributional Similarity as a Re-Ranking Feature0
Word-Formation Network for Czech0
Sharing Cultural Heritage: the Clavius on the Web Project0
The SETimes.HR Linguistically Annotated Corpus of Croatian0
The SYN-series corpora of written Czech0
Evaluating Lemmatization Models for Machine-Assisted Corpus-Dictionary Linkage0
DerivBase.hr: A High-Coverage Derivational Morphology Resource for Croatian0
Using Resource-Rich Languages to Improve Morphological Analysis of Under-Resourced Languages0
CroDeriV: a new resource for processing Croatian morphology0
Polish Coreference Corpus in Numbers0
Facilitating Multi-Lingual Sense Annotation: Human Mediated Lemmatizer0
The Effects of Syntactic Features in Automatic Prediction of Morphology0
PurePos 2.0: a hybrid tool for morphological disambiguation0
Show:102550
← PrevPage 6 of 8Next →

No leaderboard results yet.