| Continual Pre-training of Language Models | Feb 7, 2023 | Continual LearningContinual Pretraining | CodeCode Available | 2 |
| Towards Lifelong Learning of Large Language Models: A Survey | Jun 10, 2024 | Continual PretrainingIncremental Learning | CodeCode Available | 2 |
| On the Robustness of Reading Comprehension Models to Entity Renaming | Oct 16, 2021 | Continual PretrainingMachine Reading Comprehension | CodeCode Available | 1 |
| NyayaAnumana & INLegalLlama: The Largest Indian Legal Judgment Prediction Dataset and Specialized Language Model for Enhanced Decision Analysis | Dec 11, 2024 | Continual PretrainingLanguage Modeling | CodeCode Available | 1 |
| CTP:Towards Vision-Language Continual Pretraining via Compatible Momentum Contrast and Topology Preservation | Jan 1, 2023 | Continual LearningContinual Pretraining | CodeCode Available | 1 |
| Multi-Label Guided Soft Contrastive Learning for Efficient Earth Observation Pretraining | May 30, 2024 | Continual PretrainingContrastive Learning | CodeCode Available | 1 |
| Efficient Contrastive Learning via Novel Data Augmentation and Curriculum Learning | Sep 10, 2021 | Continual PretrainingContrastive Learning | CodeCode Available | 1 |
| Demystifying Domain-adaptive Post-training for Financial LLMs | Jan 9, 2025 | Continual PretrainingDomain Adaptation | CodeCode Available | 1 |
| Towards Geospatial Foundation Models via Continual Pretraining | Feb 9, 2023 | Change DetectionContinual Pretraining | CodeCode Available | 1 |
| Continual Pre-Training Mitigates Forgetting in Language and Vision | May 19, 2022 | Continual LearningContinual Pretraining | CodeCode Available | 1 |
