| FinEst BERT and CroSloEngual BERT: less is more in multilingual models | Jun 14, 2020 | Dependency ParsingNER | —Unverified | 0 |
| English Intermediate-Task Training Improves Zero-Shot Cross-Lingual Transfer Too | Jun 3, 2020 | Cross-Lingual TransferQuestion Answering | —Unverified | 0 |
| English Intermediate-Task Training Improves Zero-Shot Cross-Lingual Transfer Too | May 26, 2020 | Cross-Lingual TransferHellaSwag | —Unverified | 0 |
| BERTweet: A pre-trained language model for English Tweets | May 20, 2020 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| From Zero to Hero: On the Limitations of Zero-Shot Cross-Lingual Transfer with Multilingual Transformers | May 1, 2020 | Cross-Lingual TransferCross-Lingual Word Embeddings | —Unverified | 0 |
| MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfer | Apr 30, 2020 | Cross-Lingual Transfernamed-entity-recognition | CodeCode Available | 2 |
| Don't Use English Dev: On the Zero-Shot Cross-Lingual Evaluation of Contextual Embeddings | Apr 30, 2020 | Cross-Lingual TransferModel Selection | —Unverified | 0 |
| Testing pre-trained Transformer models for Lithuanian news clustering | Apr 3, 2020 | ClusteringXLM-R | —Unverified | 0 |
| XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation | Apr 3, 2020 | Natural Language UnderstandingXLM-R | CodeCode Available | 1 |
| PhoBERT: Pre-trained language models for Vietnamese | Mar 2, 2020 | Dependency Parsingnamed-entity-recognition | CodeCode Available | 1 |
