Continual Learning

Continual Learning (also known as Incremental Learning, Life-long Learning) is a concept to learn a model for a large number of tasks sequentially without forgetting knowledge obtained from the preceding tasks, where the data in the old tasks are not available anymore during training new ones.
If not mentioned, the benchmarks here are Task-CL, where task-id is provided on validation.

Source:
Continual Learning by Asymmetric Loss Approximation with Single-Side Overestimation
Three scenarios for continual learning
Lifelong Machine Learning
Continual lifelong learning with neural networks: A review

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 2001–2050 of 2644 papers

Title	Date	Tasks	Status
Towards Differentiable Multilevel Optimization: A Gradient-Based Approach	Oct 15, 2024	Continual Learning	—Unverified
The Need for a Big World Simulator: A Scientific Challenge for Continual Learning	Aug 6, 2024	Continual Learning	—Unverified
Activation by Interval-wise Dropout: A Simple Way to Prevent Neural Networks from Plasticity Loss	Feb 3, 2025	Atari GamesContinual Learning	—Unverified
Preparing for Black Swans: The Antifragility Imperative for Machine Learning	May 18, 2024	Continual LearningDecision Making	—Unverified
A Theory for Knowledge Transfer in Continual Learning	Aug 14, 2022	Continual LearningTransfer Learning	—Unverified
A Survey on Deep Industrial Transfer Learning in Fault Prognostics	Jan 4, 2023	Continual LearningSurvey	—Unverified
Preserving Cross-Linguality of Pre-trained Models via Continual Learning	Aug 1, 2021	Continual Learningnamed-entity-recognition	—Unverified
Preserving Earlier Knowledge in Continual Learning with the Help of All Previous Feature Extractors	Apr 28, 2021	AllContinual Learning	—Unverified
A Survey on Dataset Distillation: Approaches, Applications and Future Directions	May 3, 2023	Continual LearningDataset Distillation	—Unverified
Preserving Plasticity in Continual Learning with Adaptive Linearity Injection	May 14, 2025	class-incremental learningClass Incremental Learning	—Unverified
Pretrained Language Model in Continual Learning: A Comparative Study	Sep 29, 2021	Continual LearningLanguage Modeling	—Unverified
Preventing Catastrophic Forgetting in Continual Learning of New Natural Language Tasks	Feb 22, 2023	Continual LearningMulti-Task Learning	—Unverified
A Survey of Continual Reinforcement Learning	Jun 27, 2025	Continual LearningDecision Making	—Unverified
Primal Dual Continual Learning: Balancing Stability and Plasticity through Adaptive Memory Allocation	Sep 29, 2023	Continual LearningSensitivity	—Unverified
Principal Gradient Direction and Confidence Reservoir Sampling for Continual Learning	Aug 21, 2021	Continual Learning	—Unverified
Towards Experience Replay for Class-Incremental Learning in Fully-Binary Networks	Mar 10, 2025	class-incremental learningClass Incremental Learning	—Unverified
Prior-free Balanced Replay: Uncertainty-guided Reservoir Sampling for Long-Tailed Continual Learning	Aug 27, 2024	class-incremental learningClass Incremental Learning	—Unverified
Towards Fair Affective Robotics: Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition	Mar 15, 2021	Continual LearningFacial Expression Recognition	—Unverified
Towards General Industrial Intelligence: A Survey of Continual Large Models in Industrial IoT	Sep 2, 2024	Cloud ComputingContinual Learning	—Unverified
Towards Generalized and Incremental Few-Shot Object Detection	Sep 23, 2021	Autonomous DrivingContinual Learning	—Unverified
Probabilistic Bilevel Coreset Selection	Jan 24, 2023	Bilevel OptimizationContinual Learning	—Unverified
Probabilistic Metaplasticity for Continual Learning with Memristors	Mar 13, 2024	Continual Learning	—Unverified
Probing Representation Forgetting in Supervised and Unsupervised Continual Learning	Mar 24, 2022	Continual LearningContrastive Learning	—Unverified
Towards General Purpose Medical AI: Continual Learning Medical Foundation Model	Mar 12, 2023	Continual Learning	—Unverified
A Survey of AI for Materials Science: Foundation Models, LLM Agents, Datasets, and Tools	Jun 25, 2025	Continual LearningDomain Generalization	—Unverified
Progressive Latent Replay for efficient Generative Rehearsal	Jul 4, 2022	Continual Learning	—Unverified
Progressive Learning without Forgetting	Nov 28, 2022	Continual Learning	—Unverified
A study on the plasticity of neural networks	May 31, 2021	Continual LearningTransfer Learning	—Unverified
A Study on Efficiency in Continual Learning Inspired by Human Learning	Oct 28, 2020	Continual Learning	—Unverified
Continual Learning Under Language Shift	Nov 2, 2023	Continual LearningLanguage Modeling	—Unverified
Towards guarantees for parameter isolation in continual learning	Oct 2, 2023	Continual Learning	—Unverified
Towards Learning to Remember in Meta Learning of Sequential Domains	Jan 1, 2021	Continual LearningMeta-Learning	—Unverified
Prompt Augmented Generative Replay via Supervised Contrastive Learning for Lifelong Intent Detection	Jul 1, 2022	Continual LearningContrastive Learning	—Unverified
A Study of Continual Learning Methods for Q-Learning	Jun 8, 2022	Continual LearningQ-Learning	—Unverified
Wake-Sleep Consolidated Learning	Dec 6, 2023	Continual LearningHippocampus	—Unverified
Towards LifeSpan Cognitive Systems	Sep 20, 2024	Continual Learning	—Unverified
Distribution-Level Memory Recall for Continual Learning: Preserving Knowledge and Avoiding Confusion	Aug 4, 2024	Continual Learning	—Unverified
PromptDSI: Prompt-based Rehearsal-free Instance-wise Incremental Learning for Document Retrieval	Jun 18, 2024	Continual LearningIncremental Learning	—Unverified
Towards Open-World Gesture Recognition	Jan 20, 2024	Continual LearningGesture Recognition	—Unverified
Towards Practical Tool Usage for Continually Learning LLMs	Apr 14, 2024	Continual Learning	—Unverified
A Statistical Theory of Regularization-Based Continual Learning	Jun 10, 2024	Continual Learningregression	—Unverified
ProQA: Structural Prompt-based Pre-training for Unified Question Answering	Jan 16, 2022	Continual LearningFew-Shot Learning	—Unverified
Assurance for Deployed Continual Learning Systems	Nov 16, 2023	Continual Learningimage-classification	—Unverified
Prospective Learning: Principled Extrapolation to the Future	Jan 19, 2022	Continual LearningDecision Making	—Unverified
ProtoDepth: Unsupervised Continual Depth Completion with Prototypes	Mar 17, 2025	3D ReconstructionContinual Learning	—Unverified
Prototype Augmented Hypernetworks for Continual Learning	May 12, 2025	Continual Learning	—Unverified
Prototype-Based Continual Learning with Label-free Replay Buffer and Cluster Preservation Loss	Apr 9, 2025	Continual Learning	—Unverified
Prototype Recalls for Continual Learning	Sep 25, 2019	Continual LearningMetric Learning	—Unverified
WIKITIDE: A Wikipedia-Based Timestamped Definition Pairs Dataset	Aug 7, 2023	Continual Learningparameter-efficient fine-tuning	—Unverified
Association: Remind Your GAN not to Forget	Nov 27, 2020	Continual LearningImage Reconstruction	—Unverified

Show:10 25 50

← PrevPage 41 of 53Next →

All datasets ASC (19 tasks)visual domain decathlon (10 tasks)Cifar100 (20 tasks)Tiny-ImageNet (10tasks)F-CelebA (10 tasks)20Newsgroup (10 tasks)CUBS (Fine-grained 6 Tasks)DSC (10 tasks)Flowers (Fine-grained 6 Tasks)ImageNet (Fine-grained 6 Tasks)Sketch (Fine-grained 6 Tasks)Stanford Cars (Fine-grained 6 Tasks)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Multi-task Learning (MTL; Upper Bound)	F1 - macro	0.88	—	Unverified
2	CTR	F1 - macro	0.84	—	Unverified
3	B-CL	F1 - macro	0.81	—	Unverified
4	LAMOL	F1 - macro	0.81	—	Unverified
5	OWM	F1 - macro	0.79	—	Unverified
6	A-GEM	F1 - macro	0.78	—	Unverified
7	HAT	F1 - macro	0.78	—	Unverified
8	Independent Learning (ONE)	F1 - macro	0.78	—	Unverified
9	KAN	F1 - macro	0.77	—	Unverified
10	Naive Continual Learning (NCL)	F1 - macro	0.77	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NetTailor	decathlon discipline (Score)	3,744	—	Unverified
2	Depthwise Soft Sharing	decathlon discipline (Score)	3,507	—	Unverified
3	Parallel Res. adapt.	decathlon discipline (Score)	3,412	—	Unverified
4	Depthwise Sharing	decathlon discipline (Score)	3,234	—	Unverified
5	Series Res. adapt.	decathlon discipline (Score)	3,159	—	Unverified
6	Res. adapt. (large)	decathlon discipline (Score)	3,131	—	Unverified
7	DAN	decathlon discipline (Score)	2,851	—	Unverified
8	Piggyback	decathlon discipline (Score)	2,838	—	Unverified
9	Res. adapt. finetune all	decathlon discipline (Score)	2,643	—	Unverified
10	Res. adapt. decay	decathlon discipline (Score)	2,621	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Model Zoo-Continual	Average Accuracy	94.99	—	Unverified
2	ALTA	Average Accuracy	92.98	—	Unverified
3	kNN-CLIP	Average Accuracy	90.8	—	Unverified
4	RMN	Average Accuracy	81	—	Unverified
5	CPG	Average Accuracy	80.9	—	Unverified
6	CondConvContinual	Average Accuracy	77.4	—	Unverified
7	PAENet	Average Accuracy	77.1	—	Unverified
8	CPG-light	Average Accuracy	77	—	Unverified
9	PackNet	Average Accuracy	67.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ALTA-ViTB/16	Average Accuracy	89.8	—	Unverified
2	ALTA-RN50x4	Average Accuracy	84.73	—	Unverified
3	ALTA-RN101	Average Accuracy	83.35	—	Unverified
4	ALTA-RN50	Average Accuracy	81.07	—	Unverified
5	SNCL	Average Accuracy	52.85	—	Unverified
6	DER [buzzega2020dark]	Average Accuracy	51.78	—	Unverified
7	ER[riemer2018learning]	Average Accuracy	48.64	—	Unverified
8	iCaRL [rebuffi2017icarl]	Average Accuracy	31.55	—	Unverified
9	A-GEM [chaudhry2018efficient]	Average Accuracy	25.33	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CAT (CNN backbone)	Acc	0.76	—	Unverified
2	CAT (MLP backbone)	Acc	0.69	—	Unverified
3	EWC	Acc	0.65	—	Unverified
4	HyperNet	Acc	0.6	—	Unverified
5	PathNet	Acc	0.58	—	Unverified
6	HAT	Acc	0.57	—	Unverified
7	RPSNet	Acc	0.55	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CTR	F1 - macro	0.95	—	Unverified
2	HAT	F1 - macro	0.95	—	Unverified
3	CAT	F1 - macro	0.95	—	Unverified
4	B-CL	F1 - macro	0.95	—	Unverified
5	EWC	F1 - macro	0.92	—	Unverified
6	LAMOL	F1 - macro	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	84.26	—	Unverified
2	H$^{2}$	Accuracy	84.1	—	Unverified
3	CPG	Accuracy	83.59	—	Unverified
4	Piggyback	Accuracy	80.5	—	Unverified
5	PackNet	Accuracy	80.41	—	Unverified
6	ProgressiveNet	Accuracy	78.94	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CTR	F1 - macro	0.89	—	Unverified
2	CAT	F1 - macro	0.87	—	Unverified
3	HAT	F1 - macro	0.86	—	Unverified
4	KAN	F1 - macro	0.81	—	Unverified
5	B-CL	F1 - macro	0.77	—	Unverified
6	EWC	F1 - macro	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	97.16	—	Unverified
2	CPG	Accuracy	96.62	—	Unverified
3	H$^{2}$	Accuracy	94.9	—	Unverified
4	Piggyback	Accuracy	94.77	—	Unverified
5	ProgressiveNet	Accuracy	93.41	—	Unverified
6	PackNet	Accuracy	93.04	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Piggyback	Accuracy	76.16	—	Unverified
2	ProgressiveNet	Accuracy	76.16	—	Unverified
3	CondConvContinual	Accuracy	76.16	—	Unverified
4	CPG	Accuracy	75.81	—	Unverified
5	PackNet	Accuracy	75.71	—	Unverified
6	H$^{2}$	Accuracy	75.71	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	80.77	—	Unverified
2	CPG	Accuracy	80.33	—	Unverified
3	Piggyback	Accuracy	79.91	—	Unverified
4	ProgressiveNet	Accuracy	76.35	—	Unverified
5	H$^{2}$	Accuracy	76.2	—	Unverified
6	PackNet	Accuracy	76.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CPG	Accuracy	92.8	—	Unverified
2	CondConvContinual	Accuracy	92.61	—	Unverified
3	H$^{2}$	Accuracy	90.6	—	Unverified
4	Piggyback	Accuracy	89.62	—	Unverified
5	ProgressiveNet	Accuracy	89.21	—	Unverified
6	PackNet	Accuracy	86.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	78.32	—	Unverified
2	CPG	Accuracy	77.15	—	Unverified
3	H$^{2}$	Accuracy	75.1	—	Unverified
4	ProgressiveNet	Accuracy	74.94	—	Unverified
5	Piggyback	Accuracy	71.33	—	Unverified
6	PackNet	Accuracy	69.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ALTA-ViTB/16	Average Accuracy	92.85	—	Unverified
2	ALTA-RN50x4	Average Accuracy	84.91	—	Unverified
3	RMN (Resnet)	Average Accuracy	84.9	—	Unverified
4	ALTA-RN101	Average Accuracy	84.77	—	Unverified
5	ALTA-RN50	Average Accuracy	83.87	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RMN	Accuracy	68.1	—	Unverified
2	CondConvContinual	Accuracy	61.32	—	Unverified
3	CCGN	Accuracy	35.24	—	Unverified
4	DGMw	Accuracy	17.82	—	Unverified
5	DGMa	Accuracy	15.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RMN	Average Accuracy	97.99	—	Unverified
2	Model Zoo-Continual	Average Accuracy	97.71	—	Unverified
3	CODE-CL	Average Accuracy	96.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Accuracy	62.59	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CODE-CL	Average Accuracy	93.32	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TEST	1:3 Accuracy	2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Average Accuracy	62.79	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	82.69	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	88.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Model Zoo-Continual	Average Accuracy	84.27	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Accuracy	61.58	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CODE-CL	Average Accuracy	68.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Accuracy	57.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	53.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MRM	Acc	78.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Model Zoo-Continual	Average Accuracy	99.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CODE-CL	Average Accuracy	77.21	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	H$^{2}$	Top 1 Accuracy %	97.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	H$^{2}$	Top 1 Accuracy %	99.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	52.38	—	Unverified