SOTAVerified

Continual Pretraining

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–70 of 70 papers

TitleStatusHype
CTP: Towards Vision-Language Continual Pretraining via Compatible Momentum Contrast and Topology PreservationCode1
Towards Geospatial Foundation Models via Continual PretrainingCode1
Continual Pre-training of Language ModelsCode2
CTP:Towards Vision-Language Continual Pretraining via Compatible Momentum Contrast and Topology PreservationCode1
AF Adapter: Continual Pretraining for Building Chinese Biomedical Language ModelCode0
Unsupervised Domain Adaptation for Sparse Retrieval by Filling Vocabulary and Word Frequency GapsCode0
Continual Training of Language Models for Few-Shot LearningCode2
Continual Pre-Training Mitigates Forgetting in Language and VisionCode1
DD-TIG at Constraint@ACL2022: Multimodal Understanding and Reasoning for Role Labeling of Entities in Hateful Memes—0
Hierarchical Label-wise Attention Transformer Model for Explainable ICD CodingCode0
AdaPrompt: Adaptive Model Training for Prompt-based NLP—0
Fortunately, Discourse Markers Can Enhance Language Models for Sentiment AnalysisCode0
On the Robustness of Reading Comprehension Models to Entity Renaming—0
Is Domain Adaptation Worth Your Investment? Comparing BERT and FinBERT on Financial Tasks—0
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora—0
On the Robustness of Reading Comprehension Models to Entity RenamingCode1
Efficient Contrastive Learning via Novel Data Augmentation and Curriculum LearningCode1
Revisiting Pretraining with Adapters—0
ECONET: Effective Continual Pretraining of Language Models for Event Temporal ReasoningCode1
Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingCode0
Show:102550
← PrevPage 2 of 2Next →
All datasetsACL ARCAG NewsSciERC

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DASF1 (macro)0.69—Unverified
#ModelMetricClaimedVerifiedStatus
1CPTF1 - macro63.77—Unverified
#ModelMetricClaimedVerifiedStatus
1DASF1 (macro)0.71—Unverified