SOTAVerified

Continual Pretraining

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–70 of 70 papers

TitleStatusHype
Understanding the RoPE Extensions of Long-Context LLMs: An Attention Perspective—0
Cross-sensor self-supervised training and alignment for remote sensing—0
Aurora-M: Open Source Continual Pre-training for Multilingual Language and Code—0
DD-TIG at Constraint@ACL2022: Multimodal Understanding and Reasoning for Role Labeling of Entities in Hateful Memes—0
DoPAMine: Domain-specific Pre-training Adaptation from seed-guided data Mining—0
Efficient Domain-adaptive Continual Pretraining for the Process Industry in the German Language—0
Enhance Mobile Agents Thinking Process Via Iterative Preference Learning—0
Enhancing Domain-Specific Encoder Models with LLM-Generated Data: How to Leverage Ontologies, and How to Do Without Them—0
Investigating Continual Pretraining in Large Language Models: Insights and Implications—0
Is Domain Adaptation Worth Your Investment? Comparing BERT and FinBERT on Financial Tasks—0
CEM: A Data-Efficient Method for Large Language Models to Continue Evolving From Mistakes—0
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora—0
LLaVA-c: Continual Improved Visual Instruction Tuning—0
LongSkywork: A Training Recipe for Efficiently Extending Context Length in Large Language Models—0
Mining Hidden Thoughts from Texts: Evaluating Continual Pretraining with Synthetic Data for LLM Reasoning—0
AstroMLab 2: AstroLLaMA-2-70B Model and Benchmarking Specialised LLMs for Astronomy—0
Multilingual Machine Translation with Open Large Language Models at Practical Scale: An Empirical Study—0
On the Robustness of Reading Comprehension Models to Entity Renaming—0
Open Generative Large Language Models for Galician—0
Overcoming Vocabulary Mismatch: Vocabulary-agnostic Teacher Guided Language Modeling—0
Show:102550
← PrevPage 2 of 2Next →
All datasetsACL ARCAG NewsSciERC

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DASF1 (macro)0.69—Unverified
#ModelMetricClaimedVerifiedStatus
1CPTF1 - macro63.77—Unverified
#ModelMetricClaimedVerifiedStatus
1DASF1 (macro)0.71—Unverified