SOTAVerified

Cross-Lingual Transfer

Cross-lingual transfer refers to transfer learning using data and models available for one language for which ample such resources are available (e.g., English) to solve tasks in another, commonly more low-resource, language.

Papers

Showing 150 of 782 papers

TitleStatusHype
T-FREE: Subword Tokenizer-Free Generative LLMs via Sparse Representations for Memory-Efficient EmbeddingsCode2
MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual TransferCode2
mGPT: Few-Shot Learners Go MultilingualCode2
Crosslingual Generalization through Multitask FinetuningCode2
MIND Your Language: A Multilingual Dataset for Cross-lingual News RecommendationCode2
Overcoming Catastrophic Forgetting in Zero-Shot Cross-Lingual GenerationCode2
The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language VariantsCode2
Model and Data Transfer for Cross-Lingual Sequence Labelling in Zero-Resource SettingsCode2
Learning Disentangled Semantic Representations for Zero-Shot Cross-Lingual Transfer in Multilingual Machine Reading ComprehensionCode1
Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOMCode1
It's All in the Heads: Using Attention Heads as a Baseline for Cross-Lingual Transfer in Commonsense ReasoningCode1
IRCoder: Intermediate Representations Make Language Models Robust Multilingual Code GeneratorsCode1
It’s All in the Heads: Using Attention Heads as a Baseline for Cross-Lingual Transfer in Commonsense ReasoningCode1
Learning Compact Metrics for MTCode1
Learning Domain-Specialised Representations for Cross-Lingual Biomedical Entity LinkingCode1
GreenPLM: Cross-Lingual Transfer of Monolingual Pre-Trained Language Models at Almost No CostCode1
Efficient Test Time Adapter Ensembling for Low-resource Language VarietiesCode1
Few-Shot Cross-lingual Transfer for Coarse-grained De-identification of Code-Mixed Clinical TextsCode1
IndicXNLI: Evaluating Multilingual Inference for Indian LanguagesCode1
Enhancing Cross-lingual Transfer by Manifold MixupCode1
Finding Universal Grammatical Relations in Multilingual BERTCode1
Gender Bias in Multilingual Embeddings and Cross-Lingual TransferCode1
Choosing Transfer Languages for Cross-Lingual LearningCode1
Investigating Cultural Alignment of Large Language ModelsCode1
ALIGN-MLM: Word Embedding Alignment is Crucial for Multilingual Pre-trainingCode1
Investigating Transfer Learning in Multilingual Pre-trained Language Models through Chinese Natural Language InferenceCode1
Bridging the Gap: Enhancing LLM Performance for Low-Resource African Languages with New Benchmarks, Fine-Tuning, and Cultural AdjustmentsCode1
Allophant: Cross-lingual Phoneme Recognition with Articulatory AttributesCode1
KINNEWS and KIRNEWS: Benchmarking Cross-Lingual Text Classification for Kinyarwanda and KirundiCode1
K-Wav2vec 2.0: Automatic Speech Recognition based on Joint Decoding of Graphemes and SyllablesCode1
Cross-Lingual Word Embedding Refinement by _1 Norm OptimisationCode1
Cross-Lingual Natural Language Generation via Pre-TrainingCode1
Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-trainingCode1
ColBERT-XM: A Modular Multi-Vector Representation Model for Zero-Shot Multilingual Information RetrievalCode1
Code-Mixing on Sesame Street: Dawn of the Adversarial PolyglotsCode1
Cross-lingual Aspect-based Sentiment Analysis with Aspect Term Code-SwitchingCode1
Cross-lingual Transfer for Text Classification with Dictionary-based Heterogeneous GraphCode1
Cross-Lingual Word Embedding Refinement by _1 Norm OptimisationCode1
An Empirical Study of Pre-trained Transformers for Arabic Information ExtractionCode1
Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERTCode1
A cost-benefit analysis of cross-lingual transfer methodsCode1
End-to-End Slot Alignment and Recognition for Cross-Lingual NLUCode1
Few-shot Learning with Multilingual Language ModelsCode1
FILTER: An Enhanced Fusion Method for Cross-lingual Language UnderstandingCode1
From One to Many: Expanding the Scope of Toxicity Mitigation in Language ModelsCode1
Frustratingly Easy Label Projection for Cross-lingual TransferCode1
An Empirical Study on Cross-X Transfer for Legal Judgment PredictionCode1
AdaMergeX: Cross-Lingual Transfer with Large Language Models via Adaptive Adapter MergingCode1
InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-TrainingCode1
Composable Sparse Fine-Tuning for Cross-Lingual TransferCode1
Show:102550
← PrevPage 1 of 16Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot)Accuracy94.4Unverified
2mT0-13BAccuracy84.45Unverified
3RoBERTa Large (translate test)Accuracy76.05Unverified
4BLOOMZAccuracy75.5Unverified
5MAD-X BaseAccuracy60.94Unverified
6mGPTAccuracy55.5Unverified