| ST-BERT: Cross-modal Language Model Pre-training For End-to-end Spoken Language Understanding | Oct 23, 2020 | cross-modal alignmentLanguage Modeling | —Unverified | 0 |
| ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding | Oct 23, 2020 | Language ModelingLanguage Modelling | CodeCode Available | 3 |
| Cold-start Active Learning through Self-supervised Language Modeling | Oct 19, 2020 | Active LearningClassification | CodeCode Available | 1 |
| Corruption Is Not All Bad: Incorporating Discourse Structure into Pre-training via Corruption for Essay Scoring | Oct 13, 2020 | AllAutomated Essay Scoring | —Unverified | 0 |
| Cross-Thought for Sentence Encoder Pre-training | Oct 7, 2020 | Information RetrievalLanguage Modeling | CodeCode Available | 1 |
| SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding | Oct 5, 2020 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| XDA: Accurate, Robust Disassembly with Transfer Learning | Oct 2, 2020 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsing | Sep 29, 2020 | Inductive BiasLanguage Modeling | CodeCode Available | 1 |
| VECO: Variable Encoder-decoder Pre-training for Cross-lingual Understanding and Generation | Sep 28, 2020 | DecoderLanguage Modeling | —Unverified | 0 |
| Deep Transformers with Latent Depth | Sep 28, 2020 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
