| AdaPrompt: Adaptive Model Training for Prompt-based NLP | Feb 10, 2022 | Continual PretrainingLanguage Modeling | —Unverified | 0 |
| Fortunately, Discourse Markers Can Enhance Language Models for Sentiment Analysis | Jan 6, 2022 | Continual PretrainingSentiment Analysis | CodeCode Available | 0 |
| On the Robustness of Reading Comprehension Models to Entity Renaming | Nov 16, 2021 | Continual PretrainingMachine Reading Comprehension | —Unverified | 0 |
| Is Domain Adaptation Worth Your Investment? Comparing BERT and FinBERT on Financial Tasks | Nov 1, 2021 | Continual PretrainingDomain Adaptation | —Unverified | 0 |
| Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora | Oct 16, 2021 | Continual LearningContinual Pretraining | —Unverified | 0 |
| On the Robustness of Reading Comprehension Models to Entity Renaming | Oct 16, 2021 | Continual PretrainingMachine Reading Comprehension | CodeCode Available | 1 |
| Efficient Contrastive Learning via Novel Data Augmentation and Curriculum Learning | Sep 10, 2021 | Continual PretrainingContrastive Learning | CodeCode Available | 1 |
| Revisiting Pretraining with Adapters | Aug 1, 2021 | Continual PretrainingTransfer Learning | —Unverified | 0 |
| ECONET: Effective Continual Pretraining of Language Models for Event Temporal Reasoning | Dec 30, 2020 | Continual PretrainingLanguage Modelling | CodeCode Available | 1 |
| Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing | Jul 31, 2020 | Continual Pretraining | CodeCode Available | 0 |