| Retrieval Augmented Language Model Pre-Training | Jan 1, 2020 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Pre-Training of Deep Bidirectional Protein Sequence Representations with Structural Information | Nov 25, 2019 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Distilling Knowledge Learned in BERT for Text Generation | Nov 10, 2019 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Contextual Grounding of Natural Language Entities in Images | Nov 5, 2019 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Emerging Cross-lingual Structure in Pretrained Language Models | Nov 4, 2019 | Cross-Lingual TransferLanguage Modeling | —Unverified | 0 |
| On the Cross-lingual Transferability of Monolingual Representations | Oct 25, 2019 | Cross-Lingual Question AnsweringLanguage Modeling | CodeCode Available | 0 |
| UNITER: Learning UNiversal Image-TExt Representations | Sep 25, 2019 | Image-text matchingImage-text Retrieval | —Unverified | 0 |
| AllenNLP Interpret: A Framework for Explaining Predictions of NLP Models | Sep 19, 2019 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Specializing Unsupervised Pretraining Models for Word-Level Semantic Similarity | Sep 5, 2019 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives | Sep 3, 2019 | Language ModelingLanguage Modelling | —Unverified | 0 |
