Continual Learning

Continual Learning (also known as Incremental Learning, Life-long Learning) is a concept to learn a model for a large number of tasks sequentially without forgetting knowledge obtained from the preceding tasks, where the data in the old tasks are not available anymore during training new ones.
If not mentioned, the benchmarks here are Task-CL, where task-id is provided on validation.

Source:
Continual Learning by Asymmetric Loss Approximation with Single-Side Overestimation
Three scenarios for continual learning
Lifelong Machine Learning
Continual lifelong learning with neural networks: A review

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1601–1650 of 2644 papers

Title	Date	Tasks	Status
Center Loss Regularization for Continual Learning	Oct 21, 2021	Continual LearningDomain Adaptation	—Unverified
Linked Adapters: Linking Past and Future to Present for Effective Continual Learning	Dec 14, 2024	Continual Learningimage-classification	—Unverified
Liquid Ensemble Selection for Continual Learning	May 12, 2024	Continual Learning	—Unverified
LISPR: An Options Framework for Policy Reuse with Reinforcement Learning	Dec 29, 2020	Continual Learningreinforcement-learning	—Unverified
Listen, Analyze, and Adapt to Learn New Attacks: An Exemplar-Free Class Incremental Learning Method for Audio Deepfake Source Tracing	May 20, 2025	class-incremental learningClass Incremental Learning	—Unverified
Little By Little: Continual Learning via Self-Activated Sparse Mixture-of-Rank Adaptive Learning	Jun 26, 2025	Continual LearningMixture-of-Experts	—Unverified
Live and Learn: Continual Action Clustering with Incremental Views	Mar 23, 2024	ClusteringContinual Learning	—Unverified
LLaVA-c: Continual Improved Visual Instruction Tuning	Jun 10, 2025	Continual LearningContinual Pretraining	—Unverified
Technical Report for ICCV 2021 Challenge SSLAD-Track3B: Transformers Are Better Continual Learners	Jan 13, 2022	Continual LearningKnowledge Distillation	—Unverified
CD-NGP: A Fast Scalable Continual Representation for Dynamic Scenes	Sep 8, 2024	3D ReconstructionContinual Learning	—Unverified
Natural Mitigation of Catastrophic Interference: Continual Learning in Power-Law Learning Environments	Jan 18, 2024	Continual Learning	—Unverified
LM-PUB-QUIZ: A Comprehensive Framework for Zero-Shot Evaluation of Relational Knowledge in Language Models	Aug 28, 2024	Continual LearningKnowledge Probing	—Unverified
Locality Sensitive Sparse Encoding for Learning World Models Online	Jan 23, 2024	Continual LearningModel-based Reinforcement Learning	—Unverified
Localizing Catastrophic Forgetting in Neural Networks	Jun 6, 2019	Continual Learning	—Unverified
Local vs Global continual learning	Jul 23, 2024	Continual Learning	—Unverified
Logarithmic Continual Learning	Jan 17, 2022	Continual Learning	—Unverified
Long-Tailed Continual Learning For Visual Food Recognition	Jul 1, 2023	Continual LearningData Augmentation	—Unverified
Catastrophic Forgetting in LLMs: A Comparative Analysis Across Language Tasks	Apr 1, 2025	CoLAContinual Learning	—Unverified
Technical Report for ICCV 2023 Visual Continual Learning Challenge: Continuous Test-time Adaptation for Semantic Segmentation	Oct 20, 2023	Continual LearningSemantic Segmentation	—Unverified
The Latent Space Hypothesis: Toward Universal Medical Representation Learning	Jun 4, 2025	Continual LearningRepresentation Learning	—Unverified
VeriMedi: Pill Identification using Proxy-based Deep Metric Learning and Exact Solution	Apr 22, 2021	Continual LearningFine-Grained Visual Categorization	—Unverified
VERSE: Virtual-Gradient Aware Streaming Lifelong Learning with Anytime Inference	Sep 15, 2023	AI AgentContinual Learning	—Unverified
Can Similarity-Based Domain-Ordering Reduce Catastrophic Forgetting for Intent Recognition?	Feb 21, 2024	Continual LearningIntent Recognition	—Unverified
Spatio-Temporal Event Segmentation and Localization for Wildlife Extended Videos	May 5, 2020	Action DetectionActivity Detection	—Unverified
Can Sequential Bayesian Inference Solve Continual Learning?	Nov 22, 2021	Bayesian InferenceContinual Learning	—Unverified
Loss of Plasticity in Continual Deep Reinforcement Learning	Mar 13, 2023	Atari GamesContinual Learning	—Unverified
Low-Complexity Inference in Continual Learning via Compressed Knowledge Transfer	May 13, 2025	class-incremental learningClass Incremental Learning	—Unverified
TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models	Jan 16, 2022	Continual Learning	—Unverified
Low-Rank Mixture-of-Experts for Continual Medical Image Segmentation	Jun 19, 2024	Continual LearningImage Segmentation	—Unverified
Can Continual Learning Improve Long-Tailed Recognition? Toward a Unified Framework	Jun 23, 2023	Continual Learning	—Unverified
Incremental Few-Shot Object Detection for Robotics	May 6, 2020	ClassificationContinual Learning	—Unverified
LPC: A Logits and Parameter Calibration Framework on Continual Learning	Dec 17, 2021	Continual Learning	—Unverified
lpSpikeCon: Enabling Low-Precision Spiking Neural Network Processing for Efficient Unsupervised Continual Learning on Autonomous Agents	May 24, 2022	Continual Learning	—Unverified
LSEBMCL: A Latent Space Energy-Based Model for Continual Learning	Jan 9, 2025	Continual Learning	—Unverified
LT3 at SemEval-2020 Task 8: Multi-Modal Multi-Task Learning for Memotion Analysis	Dec 1, 2020	Continual LearningMulti-Task Learning	—Unverified
LVP-CLIP:Revisiting CLIP for Continual Learning with Label Vector Pool	Dec 8, 2024	Continual LearningIncremental Learning	—Unverified
Adaptive Memory Replay for Continual Learning	Apr 18, 2024	Continual Learning	—Unverified
MAC-Gaze: Motion-Aware Continual Calibration for Mobile Gaze Tracking	May 28, 2025	Activity RecognitionContinual Learning	—Unverified
Machine Learning for the Detection and Identification of Internet of Things (IoT) Devices: A Survey	Jan 25, 2021	Anomaly DetectionBIG-bench Machine Learning	—Unverified
MADRaS : Multi Agent Driving Simulator	Oct 2, 2020	Autonomous DrivingCar Racing	—Unverified
Maelstrom Networks	Aug 29, 2024	Continual LearningInductive Bias	—Unverified
CALM: Continuous Adaptive Learning for Language Modeling	Apr 8, 2020	Continual LearningLanguage Modeling	—Unverified
MaintaAvatar: A Maintainable Avatar Based on Neural Radiance Fields by Continual Learning	Feb 4, 2025	Continual LearningNeRF	—Unverified
Maintaining Adversarial Robustness in Continuous Learning	Feb 17, 2024	Adversarial RobustnessContinual Learning	—Unverified
CafeBoost: Causal Feature Boost To Eliminate Task-Induced Bias for Class Incremental Learning	Jan 1, 2023	class-incremental learningClass Incremental Learning	—Unverified
Maintaining Plasticity in Continual Learning via Regenerative Regularization	Aug 23, 2023	Continual LearningL2 Regularization	—Unverified
Incremental Multi-Scene Modeling via Continual Neural Graphics Primitives	Nov 29, 2024	Continual LearningNeRF	—Unverified
Making Good on LSTMs' Unfulfilled Promise	Nov 11, 2019	Continual LearningDecision Making	—Unverified
Mako: Semi-supervised continual learning with minimal labeled data via data programming	Sep 29, 2021	Continual Learningimage-classification	—Unverified
C^2INet: Realizing Incremental Trajectory Prediction with Prior-Aware Continual Causal Intervention	Nov 19, 2024	Autonomous DrivingContinual Learning	—Unverified

Show:10 25 50

← PrevPage 33 of 53Next →

All datasets ASC (19 tasks)visual domain decathlon (10 tasks)Cifar100 (20 tasks)Tiny-ImageNet (10tasks)F-CelebA (10 tasks)20Newsgroup (10 tasks)CUBS (Fine-grained 6 Tasks)DSC (10 tasks)Flowers (Fine-grained 6 Tasks)ImageNet (Fine-grained 6 Tasks)Sketch (Fine-grained 6 Tasks)Stanford Cars (Fine-grained 6 Tasks)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Multi-task Learning (MTL; Upper Bound)	F1 - macro	0.88	—	Unverified
2	CTR	F1 - macro	0.84	—	Unverified
3	B-CL	F1 - macro	0.81	—	Unverified
4	LAMOL	F1 - macro	0.81	—	Unverified
5	OWM	F1 - macro	0.79	—	Unverified
6	A-GEM	F1 - macro	0.78	—	Unverified
7	HAT	F1 - macro	0.78	—	Unverified
8	Independent Learning (ONE)	F1 - macro	0.78	—	Unverified
9	KAN	F1 - macro	0.77	—	Unverified
10	Naive Continual Learning (NCL)	F1 - macro	0.77	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NetTailor	decathlon discipline (Score)	3,744	—	Unverified
2	Depthwise Soft Sharing	decathlon discipline (Score)	3,507	—	Unverified
3	Parallel Res. adapt.	decathlon discipline (Score)	3,412	—	Unverified
4	Depthwise Sharing	decathlon discipline (Score)	3,234	—	Unverified
5	Series Res. adapt.	decathlon discipline (Score)	3,159	—	Unverified
6	Res. adapt. (large)	decathlon discipline (Score)	3,131	—	Unverified
7	DAN	decathlon discipline (Score)	2,851	—	Unverified
8	Piggyback	decathlon discipline (Score)	2,838	—	Unverified
9	Res. adapt. finetune all	decathlon discipline (Score)	2,643	—	Unverified
10	Res. adapt. decay	decathlon discipline (Score)	2,621	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Model Zoo-Continual	Average Accuracy	94.99	—	Unverified
2	ALTA	Average Accuracy	92.98	—	Unverified
3	kNN-CLIP	Average Accuracy	90.8	—	Unverified
4	RMN	Average Accuracy	81	—	Unverified
5	CPG	Average Accuracy	80.9	—	Unverified
6	CondConvContinual	Average Accuracy	77.4	—	Unverified
7	PAENet	Average Accuracy	77.1	—	Unverified
8	CPG-light	Average Accuracy	77	—	Unverified
9	PackNet	Average Accuracy	67.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ALTA-ViTB/16	Average Accuracy	89.8	—	Unverified
2	ALTA-RN50x4	Average Accuracy	84.73	—	Unverified
3	ALTA-RN101	Average Accuracy	83.35	—	Unverified
4	ALTA-RN50	Average Accuracy	81.07	—	Unverified
5	SNCL	Average Accuracy	52.85	—	Unverified
6	DER [buzzega2020dark]	Average Accuracy	51.78	—	Unverified
7	ER[riemer2018learning]	Average Accuracy	48.64	—	Unverified
8	iCaRL [rebuffi2017icarl]	Average Accuracy	31.55	—	Unverified
9	A-GEM [chaudhry2018efficient]	Average Accuracy	25.33	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CAT (CNN backbone)	Acc	0.76	—	Unverified
2	CAT (MLP backbone)	Acc	0.69	—	Unverified
3	EWC	Acc	0.65	—	Unverified
4	HyperNet	Acc	0.6	—	Unverified
5	PathNet	Acc	0.58	—	Unverified
6	HAT	Acc	0.57	—	Unverified
7	RPSNet	Acc	0.55	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CTR	F1 - macro	0.95	—	Unverified
2	HAT	F1 - macro	0.95	—	Unverified
3	CAT	F1 - macro	0.95	—	Unverified
4	B-CL	F1 - macro	0.95	—	Unverified
5	EWC	F1 - macro	0.92	—	Unverified
6	LAMOL	F1 - macro	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	84.26	—	Unverified
2	H$^{2}$	Accuracy	84.1	—	Unverified
3	CPG	Accuracy	83.59	—	Unverified
4	Piggyback	Accuracy	80.5	—	Unverified
5	PackNet	Accuracy	80.41	—	Unverified
6	ProgressiveNet	Accuracy	78.94	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CTR	F1 - macro	0.89	—	Unverified
2	CAT	F1 - macro	0.87	—	Unverified
3	HAT	F1 - macro	0.86	—	Unverified
4	KAN	F1 - macro	0.81	—	Unverified
5	B-CL	F1 - macro	0.77	—	Unverified
6	EWC	F1 - macro	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	97.16	—	Unverified
2	CPG	Accuracy	96.62	—	Unverified
3	H$^{2}$	Accuracy	94.9	—	Unverified
4	Piggyback	Accuracy	94.77	—	Unverified
5	ProgressiveNet	Accuracy	93.41	—	Unverified
6	PackNet	Accuracy	93.04	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Piggyback	Accuracy	76.16	—	Unverified
2	ProgressiveNet	Accuracy	76.16	—	Unverified
3	CondConvContinual	Accuracy	76.16	—	Unverified
4	CPG	Accuracy	75.81	—	Unverified
5	PackNet	Accuracy	75.71	—	Unverified
6	H$^{2}$	Accuracy	75.71	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	80.77	—	Unverified
2	CPG	Accuracy	80.33	—	Unverified
3	Piggyback	Accuracy	79.91	—	Unverified
4	ProgressiveNet	Accuracy	76.35	—	Unverified
5	H$^{2}$	Accuracy	76.2	—	Unverified
6	PackNet	Accuracy	76.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CPG	Accuracy	92.8	—	Unverified
2	CondConvContinual	Accuracy	92.61	—	Unverified
3	H$^{2}$	Accuracy	90.6	—	Unverified
4	Piggyback	Accuracy	89.62	—	Unverified
5	ProgressiveNet	Accuracy	89.21	—	Unverified
6	PackNet	Accuracy	86.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	78.32	—	Unverified
2	CPG	Accuracy	77.15	—	Unverified
3	H$^{2}$	Accuracy	75.1	—	Unverified
4	ProgressiveNet	Accuracy	74.94	—	Unverified
5	Piggyback	Accuracy	71.33	—	Unverified
6	PackNet	Accuracy	69.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ALTA-ViTB/16	Average Accuracy	92.85	—	Unverified
2	ALTA-RN50x4	Average Accuracy	84.91	—	Unverified
3	RMN (Resnet)	Average Accuracy	84.9	—	Unverified
4	ALTA-RN101	Average Accuracy	84.77	—	Unverified
5	ALTA-RN50	Average Accuracy	83.87	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RMN	Accuracy	68.1	—	Unverified
2	CondConvContinual	Accuracy	61.32	—	Unverified
3	CCGN	Accuracy	35.24	—	Unverified
4	DGMw	Accuracy	17.82	—	Unverified
5	DGMa	Accuracy	15.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RMN	Average Accuracy	97.99	—	Unverified
2	Model Zoo-Continual	Average Accuracy	97.71	—	Unverified
3	CODE-CL	Average Accuracy	96.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Accuracy	62.59	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CODE-CL	Average Accuracy	93.32	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TEST	1:3 Accuracy	2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Average Accuracy	62.79	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	82.69	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	88.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Model Zoo-Continual	Average Accuracy	84.27	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Accuracy	61.58	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CODE-CL	Average Accuracy	68.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Accuracy	57.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	53.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MRM	Acc	78.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Model Zoo-Continual	Average Accuracy	99.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CODE-CL	Average Accuracy	77.21	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	H$^{2}$	Top 1 Accuracy %	97.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	H$^{2}$	Top 1 Accuracy %	99.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	52.38	—	Unverified