Language Identification

Language identification is the task of determining the language of a text.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 51–75 of 794 papers

Title	Date	Tasks	Status	Score
HeLI, a Word-Based Backoff Method for Language Identification	Dec 1, 2016	Language IdentificationPosition	CodeCode Available	5
Hate-Alert@DravidianLangTech-EACL2021: Ensembling strategies for Transformer-based Offensive language Detection	Feb 19, 2021	Language IdentificationPosition	CodeCode Available	5
Aggressive Language Identification Using Word Embeddings and Sentiment Features	Aug 1, 2018	Aggression IdentificationBIG-bench Machine Learning	CodeCode Available	5
IIITK@DravidianLangTech-EACL2021: Offensive Language Identification and Meme Classification in Tamil, Malayalam and Kannada	Apr 17, 2021	ClassificationLanguage Identification	CodeCode Available	5
Hierarchical Character-Word Models for Language Identification	Aug 10, 2016	Language Identification	CodeCode Available	5
Improving Multilingual ASR in the Wild Using Simple N-best Re-ranking	Sep 27, 2024	Automatic Speech RecognitionAutomatic Speech Recognition (ASR)	CodeCode Available	5
Language Identification for Austronesian Languages	Jun 9, 2022	Language Identification	CodeCode Available	5
Approaches to Corpus Creation for Low-Resource Language Technology: the Case of Southern Kurdish and Laki	Apr 3, 2023	Language Identification	CodeCode Available	5
Geographic Adaptation of Pretrained Language Models	Mar 16, 2022	Language IdentificationLanguage Modeling	CodeCode Available	5
Joint UD Parsing of Norwegian Bokm and Nynorsk	May 1, 2017	Language IdentificationMachine Translation	CodeCode Available	5
Geographically-Informed Language Identification	Mar 14, 2024	Language Identification	CodeCode Available	5
From N-grams to Pre-trained Multilingual Models For Language Identification	Oct 11, 2024	Language IdentificationXLM-R	CodeCode Available	5
From English to Code-Switching: Transfer Learning with Strong Morphological Clues	Sep 11, 2019	Language IdentificationNamed Entity Recognition (NER)	CodeCode Available	5
GeezSwitch: Language Identification in Typologically Related Low-resourced East African Languages	Jun 1, 2022	Language IdentificationMachine Translation	CodeCode Available	5
Ghmerti at SemEval-2019 Task 6: A Deep Word- and Character-based Approach to Offensive Language Identification	Sep 22, 2020	Language Identification	CodeCode Available	5
Finding Structure in Text, Genome and Other Symbolic Sequences	Jul 8, 2012	Information RetrievalLanguage Identification	CodeCode Available	5
FBK-DH at SemEval-2020 Task 12: Using Multi-channel BERT for Multilingual Offensive Language Detection	Dec 1, 2020	Language IdentificationMachine Translation	CodeCode Available	5
FLEURS: Few-shot Learning Evaluation of Universal Representations of Speech	May 25, 2022	Automatic Speech RecognitionAutomatic Speech Recognition (ASR)	CodeCode Available	5
Enhance Language Identification using Dual-mode Model with Knowledge Distillation	Mar 7, 2022	Knowledge DistillationLanguage Identification	CodeCode Available	5
Advancing Uto-Aztecan Language Technologies: A Case Study on the Endangered Comanche Language	May 10, 2025	Language IdentificationSynthetic Data Generation	CodeCode Available	5
Fleurs-SLU: A Massively Multilingual Benchmark for Spoken Language Understanding	Jan 10, 2025	Automatic Speech RecognitionClassification	CodeCode Available	5
DOSA: Dravidian Code-Mixed Offensive Span Identification Dataset	Apr 1, 2021	Language Identification	CodeCode Available	5
Embeddia at SemEval-2019 Task 6: Detecting Hate with Neural Network and Transfer Learning Approaches	Jun 1, 2019	Language IdentificationTransfer Learning	CodeCode Available	5
Discriminating Between Similar Nordic Languages	Dec 11, 2020	BIG-bench Machine LearningLanguage Identification	CodeCode Available	5
Discriminating between Similar Languages using Weighted Subword Features	Apr 1, 2017	Language IdentificationText Categorization	CodeCode Available	5

Show:10 25 50

← PrevPage 3 of 32Next →

All datasets VOXLINGUA107 GlotLID-C Nordic Language Identification OpenSubtitles Universal Dependencies VoxForge

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	wav2vec 2.0 LV-60K	Error rate	7.2	—	Unverified
2	XLS-R	Error rate	5.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GlotLID	Macro F1	0.98	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	FastText	Accuracy	0.97	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Apple bi-LSTM	Accuracy	91.37	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Apple bi-LSTM	Accuracy	86.93	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ConformerG-P	Accuracy	99.8	—	Unverified