| DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing | Nov 18, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 2 |
| Combining static and contextualised multilingual embeddings | Nov 16, 2021 | RetrievalXLM-R | —Unverified | 0 |
| Prix-LM: Pretraining for Multilingual Knowledge Base Construction | Nov 16, 2021 | Bilingual Lexicon InductionCausal Language Modeling | —Unverified | 0 |
| Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity Matching | Nov 16, 2021 | Contrastive LearningKnowledge Distillation | —Unverified | 0 |
| Gradient Sparsification For Masked Fine-Tuning of Transformers | Nov 16, 2021 | Transfer LearningXLM-R | —Unverified | 0 |
| NICT Kyoto Submission for the WMT’21 Quality Estimation Task: Multimetric Multilingual Pretraining for Critical Error Detection | Nov 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Saliency-based Multi-View Mixed Language Training for Zero-shot Cross-lingual Classification | Nov 1, 2021 | Cross-Lingual Sentiment ClassificationDialogue State Tracking | —Unverified | 0 |
| IndoNLI: A Natural Language Inference Dataset for Indonesian | Oct 27, 2021 | Natural Language InferenceSentence | CodeCode Available | 1 |
| Towards Making the Most of Multilingual Pretraining for Zero-Shot Neural Machine Translation | Oct 16, 2021 | Abstractive Text SummarizationCross-Lingual Abstractive Summarization | CodeCode Available | 1 |
| Prix-LM: Pretraining for Multilingual Knowledge Base Construction | Oct 16, 2021 | Bilingual Lexicon InductionCausal Language Modeling | CodeCode Available | 0 |
