SOTAVerified

Continual Pretraining

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–70 of 70 papers

TitleStatusHype
ChuXin: 1.6B Technical Report—0
Pretraining and Updates of Domain-Specific LLM: A Case Study in the Japanese Business Domain—0
CEM: A Data-Efficient Method for Large Language Models to Continue Evolving From Mistakes—0
Aurora-M: Open Source Continual Pre-training for Multilingual Language and Code—0
PARAMANU-AYN: Pretrain from scratch or Continual Pretraining of LLMs for Legal Domain Adaptation?—0
Investigating Continual Pretraining in Large Language Models: Insights and Implications—0
Continual Learning for Large Language Models: A Survey—0
RomanSetu: Efficiently unlocking multilingual capabilities of Large Language Models via RomanizationCode0
PECoP: Parameter Efficient Continual Pretraining for Action Quality AssessmentCode0
AF Adapter: Continual Pretraining for Building Chinese Biomedical Language ModelCode0
Unsupervised Domain Adaptation for Sparse Retrieval by Filling Vocabulary and Word Frequency GapsCode0
DD-TIG at Constraint@ACL2022: Multimodal Understanding and Reasoning for Role Labeling of Entities in Hateful Memes—0
Hierarchical Label-wise Attention Transformer Model for Explainable ICD CodingCode0
AdaPrompt: Adaptive Model Training for Prompt-based NLP—0
Fortunately, Discourse Markers Can Enhance Language Models for Sentiment AnalysisCode0
On the Robustness of Reading Comprehension Models to Entity Renaming—0
Is Domain Adaptation Worth Your Investment? Comparing BERT and FinBERT on Financial Tasks—0
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora—0
Revisiting Pretraining with Adapters—0
Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingCode0
Show:102550
← PrevPage 3 of 3Next →
All datasetsACL ARCAG NewsSciERC

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DASF1 (macro)0.69—Unverified
#ModelMetricClaimedVerifiedStatus
1CPTF1 - macro63.77—Unverified
#ModelMetricClaimedVerifiedStatus
1DASF1 (macro)0.71—Unverified