| A Multilingual Bag-of-Entities Model for Zero-Shot Cross-Lingual Text Classification | Oct 15, 2021 | ClassificationEntity Typing | —Unverified | 0 |
| DS-TOD: Efficient Domain Specialization for Task Oriented Dialog | Oct 15, 2021 | dialog state trackingLanguage Modeling | CodeCode Available | 0 |
| Generated Knowledge Prompting for Commonsense Reasoning | Oct 15, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Coherence boosting: When your pretrained language model is not paying enough attention | Oct 15, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Control Prefixes for Parameter-Efficient Text Generation | Oct 15, 2021 | Abstractive Text SummarizationAttribute | CodeCode Available | 1 |
| Kronecker Decomposition for GPT Compression | Oct 15, 2021 | Knowledge DistillationLanguage Modeling | —Unverified | 0 |
| mLUKE: The Power of Entity Representations in Multilingual Pretrained Language Models | Oct 15, 2021 | Cross-Lingual Question AnsweringCross-Lingual Transfer | CodeCode Available | 1 |
| The World of an Octopus: How Reporting Bias Influences a Language Model's Perception of Color | Oct 15, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Meta-learning via Language Model In-context Tuning | Oct 15, 2021 | In-Context LearningInductive Bias | CodeCode Available | 1 |
| Tracing Origins: Coreference-aware Machine Reading Comprehension | Oct 15, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Sparks: Inspiration for Science Writing using Language Models | Oct 14, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| MIMICause: Representation and automatic extraction of causal relation types from clinical notes | Oct 14, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Spoken ObjectNet: A Bias-Controlled Spoken Caption Dataset | Oct 14, 2021 | Image RetrievalLanguage Modeling | CodeCode Available | 0 |
| Symbolic Knowledge Distillation: from General Language Models to Commonsense Models | Oct 14, 2021 | Knowledge DistillationKnowledge Graphs | CodeCode Available | 1 |
| P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks | Oct 14, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 2 |
| UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning | Oct 14, 2021 | DiversityLanguage Modeling | CodeCode Available | 1 |
| Composable Sparse Fine-Tuning for Cross-Lingual Transfer | Oct 14, 2021 | Cross-Lingual TransferLanguage Modeling | CodeCode Available | 1 |
| bert2BERT: Towards Reusable Pretrained Language Models | Oct 14, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Dict-BERT: Enhancing Language Model Pre-training with Dictionary | Oct 13, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| On Language Model Integration for RNN Transducer based Speech Recognition | Oct 13, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Maximizing Efficiency of Language Model Pre-training for Learning Representation | Oct 13, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Deep Learning for Bias Detection: From Inception to Deployment | Oct 12, 2021 | Bias DetectionDeep Learning | —Unverified | 0 |
| Multi-Modal Pre-Training for Automated Speech Recognition | Oct 12, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Småprat: DialoGPT for Natural Language Generation of Swedish Dialogue by Transfer Learning | Oct 12, 2021 | ChatbotLanguage Modeling | —Unverified | 0 |
| Time Masking for Temporal Language Models | Oct 12, 2021 | Change DetectionLanguage Modeling | CodeCode Available | 1 |
