SOTAVerified

Continual Pretraining

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 26–50 of 70 papers

TitleStatusHype
Robust Data Watermarking in Language Models by Injecting Fictitious KnowledgeCode0
RomanSetu: Efficiently unlocking multilingual capabilities of Large Language Models via RomanizationCode0
Towards Democratizing Multilingual Large Language Models For Medicine Through A Two-Stage Instruction Fine-tuning ApproachCode0
Fortunately, Discourse Markers Can Enhance Language Models for Sentiment AnalysisCode0
Simulating Training Data Leakage in Multiple-Choice Benchmarks for LLM EvaluationCode0
Hierarchical Label-wise Attention Transformer Model for Explainable ICD CodingCode0
Unsupervised Domain Adaptation for Sparse Retrieval by Filling Vocabulary and Word Frequency GapsCode0
PECoP: Parameter Efficient Continual Pretraining for Action Quality AssessmentCode0
AF Adapter: Continual Pretraining for Building Chinese Biomedical Language ModelCode0
LangSAMP: Language-Script Aware Multilingual PretrainingCode0
Alchemy: Amplifying Theorem-Proving Capability through Symbolic MutationCode0
PARAMANU-AYN: Pretrain from scratch or Continual Pretraining of LLMs for Legal Domain Adaptation?—0
Pretraining and Updates of Domain-Specific LLM: A Case Study in the Japanese Business Domain—0
RedWhale: An Adapted Korean LLM Through Efficient Continual Pretraining—0
Revisiting Pretraining with Adapters—0
AfroXLMR-Social: Adapting Pre-trained Language Models for African Languages Social Media Text—0
The Construction of Instruction-tuned LLMs for Finance without Instruction Data Using Continual Pretraining and Model Merging—0
AdaPrompt: Adaptive Model Training for Prompt-based NLP—0
BAMBINO-LM: (Bilingual-)Human-Inspired Continual Pretraining of BabyLM—0
Bilingual Adaptation of Monolingual Foundation Models—0
Breaking the Stage Barrier: A Novel Single-Stage Approach to Long Context Extension for Large Language Models—0
Biomed-Enriched: A Biomedical Dataset Enriched with LLMs for Pretraining and Extracting Rare and Hidden Content—0
ChuXin: 1.6B Technical Report—0
Continual Learning for Large Language Models: A Survey—0
70B-parameter large language models in Japanese medical question-answering—0
Show:102550
← PrevPage 2 of 3Next →
All datasetsACL ARCAG NewsSciERC

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DASF1 (macro)0.69—Unverified
#ModelMetricClaimedVerifiedStatus
1CPTF1 - macro63.77—Unverified
#ModelMetricClaimedVerifiedStatus
1DASF1 (macro)0.71—Unverified