SOTAVerified

Continual Pretraining

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–70 of 70 papers

TitleStatusHype
CEM: A Data-Efficient Method for Large Language Models to Continue Evolving From Mistakes—0
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora—0
LLaVA-c: Continual Improved Visual Instruction Tuning—0
LongSkywork: A Training Recipe for Efficiently Extending Context Length in Large Language Models—0
Mining Hidden Thoughts from Texts: Evaluating Continual Pretraining with Synthetic Data for LLM Reasoning—0
AstroMLab 2: AstroLLaMA-2-70B Model and Benchmarking Specialised LLMs for Astronomy—0
Multilingual Machine Translation with Open Large Language Models at Practical Scale: An Empirical Study—0
Hierarchical Label-wise Attention Transformer Model for Explainable ICD CodingCode0
Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingCode0
Towards Democratizing Multilingual Large Language Models For Medicine Through A Two-Stage Instruction Fine-tuning ApproachCode0
LangSAMP: Language-Script Aware Multilingual PretrainingCode0
A Japanese Language Model and Three New Evaluation Benchmarks for Pharmaceutical NLPCode0
Robust Data Watermarking in Language Models by Injecting Fictitious KnowledgeCode0
RomanSetu: Efficiently unlocking multilingual capabilities of Large Language Models via RomanizationCode0
PECoP: Parameter Efficient Continual Pretraining for Action Quality AssessmentCode0
AF Adapter: Continual Pretraining for Building Chinese Biomedical Language ModelCode0
Simulating Training Data Leakage in Multiple-Choice Benchmarks for LLM EvaluationCode0
Fortunately, Discourse Markers Can Enhance Language Models for Sentiment AnalysisCode0
Alchemy: Amplifying Theorem-Proving Capability through Symbolic MutationCode0
Unsupervised Domain Adaptation for Sparse Retrieval by Filling Vocabulary and Word Frequency GapsCode0
Show:102550
← PrevPage 3 of 3Next →
All datasetsACL ARCAG NewsSciERC

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DASF1 (macro)0.69—Unverified
#ModelMetricClaimedVerifiedStatus
1CPTF1 - macro63.77—Unverified
#ModelMetricClaimedVerifiedStatus
1DASF1 (macro)0.71—Unverified