Language Identification

Language identification is the task of determining the language of a text.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 726–750 of 794 papers

Title	Date	Tasks	Status
Measuring language distance among historical varieties using perplexity. Application to European Portuguese.	Aug 1, 2018	Language AcquisitionLanguage Identification	CodeCode Available
MERLIon CCS Challenge: A English-Mandarin code-switching child-directed speech corpus for language identification and diarization	May 30, 2023	Language Identification	CodeCode Available
MERLIon CCS Challenge Evaluation Plan	May 31, 2023	Language IdentificationTask 2	CodeCode Available
Hierarchical Character-Word Models for Language Identification	Aug 10, 2016	Language Identification	CodeCode Available
STIL -- Simultaneous Slot Filling, Translation, Intent Classification, and Language Identification: Initial Results using mBART on MultiATIS++	Oct 2, 2020	ClassificationGeneral Classification	CodeCode Available
Language Identification for Austronesian Languages	Jun 9, 2022	Language Identification	CodeCode Available
problemConquero at SemEval-2020 Task 12: Transformer and Soft label-based approaches	Jul 21, 2020	Language Identification	CodeCode Available
STIL - Simultaneous Slot Filling, Translation, Intent Classification, and Language Identification: Initial Results using mBART on MultiATIS++	Dec 1, 2020	Classificationintent-classification	CodeCode Available
Short Text Language Identification for Under Resourced Languages	Nov 18, 2019	Language Identification	CodeCode Available
Pretrained Transformers for Offensive Language Identification in Tanglish	Oct 6, 2021	Language IdentificationText Classification	CodeCode Available
English Please: Evaluating Machine Translation with Large Language Models for Multilingual Bug Reports	Feb 20, 2025	Domain AdaptationLanguage Identification	CodeCode Available
Topics to Avoid: Demoting Latent Confounds in Text Classification	Sep 1, 2019	ClassificationGeneral Classification	CodeCode Available
The Curious Case of Logistic Regression for Italian Languages and Dialects Identification	Oct 1, 2022	Language IdentificationMachine Translation	CodeCode Available
Offensive Language Identification in Greek	Mar 16, 2020	Language Identification	CodeCode Available
Offensive Language Identification in Low-resourced Code-mixed Dravidian languages using Pseudo-labeling	Aug 27, 2021	Language IdentificationMarketing	CodeCode Available
A study of N-gram and Embedding Representations for Native Language Identification	Sep 1, 2017	Feature EngineeringLanguage Acquisition	CodeCode Available
Language Identification Using Deep Convolutional Recurrent Neural Networks	Aug 16, 2017	Automatic Speech RecognitionAutomatic Speech Recognition (ASR)	CodeCode Available
IIITK@DravidianLangTech-EACL2021: Offensive Language Identification and Meme Classification in Tamil, Malayalam and Kannada	Apr 17, 2021	ClassificationLanguage Identification	CodeCode Available
IIITT@DravidianLangTech-EACL2021: Transfer Learning for Offensive Language Detection in Dravidian Languages	Apr 1, 2021	DiversityLanguage Identification	CodeCode Available
Language Identification with a Reciprocal Rank Classifier	Sep 20, 2021	Domain AdaptationLanguage Identification	CodeCode Available
OffMix-3L: A Novel Code-Mixed Dataset in Bangla-English-Hindi for Offensive Language Identification	Oct 27, 2023	Language Identification	CodeCode Available
Discriminating between Similar Languages using Weighted Subword Features	Apr 1, 2017	Language IdentificationText Categorization	CodeCode Available
Multi-label Scandinavian Language Identification (SLIDE)	Feb 10, 2025	Language IdentificationSentence	CodeCode Available
Improved Text Language Identification for the South African Languages	Nov 1, 2017	Language Identification	CodeCode Available
Universal Dependency Parsing for Hindi-English Code-switching	Apr 16, 2018	Dependency ParsingLanguage Identification	CodeCode Available

Show:10 25 50

← PrevPage 30 of 32Next →

All datasets VOXLINGUA107 GlotLID-C Nordic Language Identification OpenSubtitles Universal Dependencies VoxForge

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	wav2vec 2.0 LV-60K	Error rate	7.2	—	Unverified
2	XLS-R	Error rate	5.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GlotLID	Macro F1	0.98	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	FastText	Accuracy	0.97	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Apple bi-LSTM	Accuracy	91.37	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Apple bi-LSTM	Accuracy	86.93	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ConformerG-P	Accuracy	99.8	—	Unverified