| Towards Lifelong Learning of Large Language Models: A Survey | Jun 10, 2024 | Continual PretrainingIncremental Learning | CodeCode Available | 2 | 5 |
| Continual Pre-training of Language Models | Feb 7, 2023 | Continual LearningContinual Pretraining | CodeCode Available | 2 | 5 |
| On the Robustness of Reading Comprehension Models to Entity Renaming | Oct 16, 2021 | Continual PretrainingMachine Reading Comprehension | CodeCode Available | 1 | 5 |
| Towards Geospatial Foundation Models via Continual Pretraining | Feb 9, 2023 | Change DetectionContinual Pretraining | CodeCode Available | 1 | 5 |
| Efficient Contrastive Learning via Novel Data Augmentation and Curriculum Learning | Sep 10, 2021 | Continual PretrainingContrastive Learning | CodeCode Available | 1 | 5 |
| ECONET: Effective Continual Pretraining of Language Models for Event Temporal Reasoning | Dec 30, 2020 | Continual PretrainingLanguage Modelling | CodeCode Available | 1 | 5 |
| Demystifying Domain-adaptive Post-training for Financial LLMs | Jan 9, 2025 | Continual PretrainingDomain Adaptation | CodeCode Available | 1 | 5 |
| Multi-Label Guided Soft Contrastive Learning for Efficient Earth Observation Pretraining | May 30, 2024 | Continual PretrainingContrastive Learning | CodeCode Available | 1 | 5 |
| Continual Pre-Training Mitigates Forgetting in Language and Vision | May 19, 2022 | Continual LearningContinual Pretraining | CodeCode Available | 1 | 5 |
| CTP: Towards Vision-Language Continual Pretraining via Compatible Momentum Contrast and Topology Preservation | Aug 14, 2023 | Continual LearningContinual Pretraining | CodeCode Available | 1 | 5 |
