| Breaking the Stage Barrier: A Novel Single-Stage Approach to Long Context Extension for Large Language Models | Dec 10, 2024 | Continual PretrainingLanguage Modeling | —Unverified | 0 |
| Revisiting Pretraining with Adapters | Aug 1, 2021 | Continual PretrainingTransfer Learning | —Unverified | 0 |
| AfroXLMR-Social: Adapting Pre-trained Language Models for African Languages Social Media Text | Mar 24, 2025 | Continual PretrainingEmotion Classification | —Unverified | 0 |
| The Construction of Instruction-tuned LLMs for Finance without Instruction Data Using Continual Pretraining and Model Merging | Sep 30, 2024 | Continual Pretraining | —Unverified | 0 |
| AdaPrompt: Adaptive Model Training for Prompt-based NLP | Feb 10, 2022 | Continual PretrainingLanguage Modeling | —Unverified | 0 |
| BAMBINO-LM: (Bilingual-)Human-Inspired Continual Pretraining of BabyLM | Jun 17, 2024 | Continual Pretrainingzero-shot-classification | —Unverified | 0 |
| Bilingual Adaptation of Monolingual Foundation Models | Jul 13, 2024 | Continual PretrainingCross-Lingual Transfer | —Unverified | 0 |
| Biomed-Enriched: A Biomedical Dataset Enriched with LLMs for Pretraining and Extracting Rare and Hidden Content | Jun 25, 2025 | ArticlesContinual Pretraining | —Unverified | 0 |
| Investigating Continual Pretraining in Large Language Models: Insights and Implications | Feb 27, 2024 | Continual LearningContinual Pretraining | —Unverified | 0 |
| Is Domain Adaptation Worth Your Investment? Comparing BERT and FinBERT on Financial Tasks | Nov 1, 2021 | Continual PretrainingDomain Adaptation | —Unverified | 0 |