Continual Learning

Continual Learning (also known as Incremental Learning, Life-long Learning) is a concept to learn a model for a large number of tasks sequentially without forgetting knowledge obtained from the preceding tasks, where the data in the old tasks are not available anymore during training new ones.
If not mentioned, the benchmarks here are Task-CL, where task-id is provided on validation.

Source:
Continual Learning by Asymmetric Loss Approximation with Single-Side Overestimation
Three scenarios for continual learning
Lifelong Machine Learning
Continual lifelong learning with neural networks: A review

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1351–1400 of 2644 papers

Title	Date	Tasks	Status
Localizing Catastrophic Forgetting in Neural Networks	Jun 6, 2019	Continual Learning	—Unverified
Local vs Global continual learning	Jul 23, 2024	Continual Learning	—Unverified
Logarithmic Continual Learning	Jan 17, 2022	Continual Learning	—Unverified
Long-Tailed Continual Learning For Visual Food Recognition	Jul 1, 2023	Continual LearningData Augmentation	—Unverified
Loss of Plasticity in Continual Deep Reinforcement Learning	Mar 13, 2023	Atari GamesContinual Learning	—Unverified
Low-Complexity Inference in Continual Learning via Compressed Knowledge Transfer	May 13, 2025	class-incremental learningClass Incremental Learning	—Unverified
Low-Rank Mixture-of-Experts for Continual Medical Image Segmentation	Jun 19, 2024	Continual LearningImage Segmentation	—Unverified
Incremental Few-Shot Object Detection for Robotics	May 6, 2020	ClassificationContinual Learning	—Unverified
LPC: A Logits and Parameter Calibration Framework on Continual Learning	Dec 17, 2021	Continual Learning	—Unverified
lpSpikeCon: Enabling Low-Precision Spiking Neural Network Processing for Efficient Unsupervised Continual Learning on Autonomous Agents	May 24, 2022	Continual Learning	—Unverified
LSEBMCL: A Latent Space Energy-Based Model for Continual Learning	Jan 9, 2025	Continual Learning	—Unverified
LT3 at SemEval-2020 Task 8: Multi-Modal Multi-Task Learning for Memotion Analysis	Dec 1, 2020	Continual LearningMulti-Task Learning	—Unverified
LVP-CLIP:Revisiting CLIP for Continual Learning with Label Vector Pool	Dec 8, 2024	Continual LearningIncremental Learning	—Unverified
MAC-Gaze: Motion-Aware Continual Calibration for Mobile Gaze Tracking	May 28, 2025	Activity RecognitionContinual Learning	—Unverified
Machine Learning for the Detection and Identification of Internet of Things (IoT) Devices: A Survey	Jan 25, 2021	Anomaly DetectionBIG-bench Machine Learning	—Unverified
MADRaS : Multi Agent Driving Simulator	Oct 2, 2020	Autonomous DrivingCar Racing	—Unverified
Maelstrom Networks	Aug 29, 2024	Continual LearningInductive Bias	—Unverified
MaintaAvatar: A Maintainable Avatar Based on Neural Radiance Fields by Continual Learning	Feb 4, 2025	Continual LearningNeRF	—Unverified
Maintaining Adversarial Robustness in Continuous Learning	Feb 17, 2024	Adversarial RobustnessContinual Learning	—Unverified
Maintaining Plasticity in Continual Learning via Regenerative Regularization	Aug 23, 2023	Continual LearningL2 Regularization	—Unverified
Making Good on LSTMs' Unfulfilled Promise	Nov 11, 2019	Continual LearningDecision Making	—Unverified
Mako: Semi-supervised continual learning with minimal labeled data via data programming	Sep 29, 2021	Continual Learningimage-classification	—Unverified
Mamba-CL: Optimizing Selective State Space Model in Null Space for Continual Learning	Nov 23, 2024	Continual LearningMamba	—Unverified
Managing the unknown: a survey on Open Set Recognition and tangential areas	Dec 14, 2023	Continual LearningNovelty Detection	—Unverified
Marginal Replay vs Conditional Replay for Continual Learning	Oct 29, 2018	ClassificationContinual Learning	—Unverified
MASIL: Towards Maximum Separable Class Representation for Few Shot Class Incremental Learning	Apr 8, 2023	class-incremental learningClass Incremental Learning	—Unverified
#maskUp: Selective Attribute Encryption for Sensitive Vocalization for English language on Social Media Platforms	Nov 16, 2022	AttributeContinual Learning	—Unverified
Matching options to tasks using Option-Indexed Hierarchical Reinforcement Learning	Jun 12, 2022	Continual LearningHierarchical Reinforcement Learning	—Unverified
Generative Feature-driven Image Replay for Continual Learning	Jun 9, 2021	Class Incremental LearningContinual Learning	—Unverified
MaxEntropy Pursuit Variational Inference	May 20, 2019	Continual LearningVariational Inference	—Unverified
Maxwell's Demon at Work: Efficient Pruning by Leveraging Saturation of Neurons	Mar 12, 2024	Continual LearningModel Compression	—Unverified
May the Forgetting Be with You: Alternate Replay for Learning with Noisy Labels	Aug 26, 2024	Continual LearningLearning with noisy labels	—Unverified
Measuring Asymmetric Gradient Discrepancy in Parallel Continual Learning	Jan 1, 2023	Continual Learning	—Unverified
Measuring Information Transfer in Neural Networks	Sep 16, 2020	Continual LearningTransfer Learning	—Unverified
Measuring Representational Shifts in Continual Learning: A Linear Transformation Perspective	May 27, 2025	Continual Learning	—Unverified
MEGA: Second-Order Gradient Alignment for Catastrophic Forgetting Mitigation in GFSCIL	Apr 18, 2025	class-incremental learningClass Incremental Learning	—Unverified
Memory Bounds for Continual Learning	Apr 22, 2022	Continual LearningLifelong learning	—Unverified
Memory Efficient Continual Learning with Transformers	Mar 9, 2022	ClassificationContinual Learning	—Unverified
Memory Efficient Continual Learning for Edge-Based Visual Anomaly Detection	Mar 4, 2025	Anomaly DetectionContinual Learning	—Unverified
Memory-Efficient Continual Learning Object Segmentation for Long Video	Sep 26, 2023	Continual LearningObject	—Unverified
Memory-efficient Continual Learning with Neural Collapse Contrastive	Dec 3, 2024	Continual LearningContrastive Learning	—Unverified
Memory-Statistics Tradeoff in Continual Learning with Structural Regularization	Apr 5, 2025	Continual Learning	—Unverified
Merge then Realign: Simple and Effective Modality-Incremental Continual Learning for Multimodal LLMs	Mar 8, 2025	Continual Learning	—Unverified
MetaCLBench: Meta Continual Learning Benchmark on Resource-Constrained Edge Devices	Mar 31, 2025	Continual Learning	—Unverified
Meta Continual Learning	Jun 11, 2018	Continual Learning	—Unverified
Meta-Continual Learning of Neural Fields	Apr 8, 2025	Continual LearningMeta-Learning	—Unverified
Meta-Continual Learning Via Dynamic Programming	Jan 1, 2021	Continual Learning	—Unverified
Meta-Learning Strategies through Value Maximization in Neural Networks	Oct 30, 2023	Continual LearningMeta-Learning	—Unverified
MetaMix: Towards Corruption-Robust Continual Learning With Temporally Self-Adaptive Data Transformation	Jan 1, 2023	Continual LearningData Augmentation	—Unverified
Metaplasticity in Multistate Memristor Synaptic Networks	Feb 26, 2020	Continual Learning	—Unverified

Show:10 25 50

← PrevPage 28 of 53Next →

All datasets ASC (19 tasks)visual domain decathlon (10 tasks)Cifar100 (20 tasks)Tiny-ImageNet (10tasks)F-CelebA (10 tasks)20Newsgroup (10 tasks)CUBS (Fine-grained 6 Tasks)DSC (10 tasks)Flowers (Fine-grained 6 Tasks)ImageNet (Fine-grained 6 Tasks)Sketch (Fine-grained 6 Tasks)Stanford Cars (Fine-grained 6 Tasks)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Multi-task Learning (MTL; Upper Bound)	F1 - macro	0.88	—	Unverified
2	CTR	F1 - macro	0.84	—	Unverified
3	B-CL	F1 - macro	0.81	—	Unverified
4	LAMOL	F1 - macro	0.81	—	Unverified
5	OWM	F1 - macro	0.79	—	Unverified
6	A-GEM	F1 - macro	0.78	—	Unverified
7	HAT	F1 - macro	0.78	—	Unverified
8	Independent Learning (ONE)	F1 - macro	0.78	—	Unverified
9	KAN	F1 - macro	0.77	—	Unverified
10	Naive Continual Learning (NCL)	F1 - macro	0.77	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NetTailor	decathlon discipline (Score)	3,744	—	Unverified
2	Depthwise Soft Sharing	decathlon discipline (Score)	3,507	—	Unverified
3	Parallel Res. adapt.	decathlon discipline (Score)	3,412	—	Unverified
4	Depthwise Sharing	decathlon discipline (Score)	3,234	—	Unverified
5	Series Res. adapt.	decathlon discipline (Score)	3,159	—	Unverified
6	Res. adapt. (large)	decathlon discipline (Score)	3,131	—	Unverified
7	DAN	decathlon discipline (Score)	2,851	—	Unverified
8	Piggyback	decathlon discipline (Score)	2,838	—	Unverified
9	Res. adapt. finetune all	decathlon discipline (Score)	2,643	—	Unverified
10	Res. adapt. decay	decathlon discipline (Score)	2,621	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Model Zoo-Continual	Average Accuracy	94.99	—	Unverified
2	ALTA	Average Accuracy	92.98	—	Unverified
3	kNN-CLIP	Average Accuracy	90.8	—	Unverified
4	RMN	Average Accuracy	81	—	Unverified
5	CPG	Average Accuracy	80.9	—	Unverified
6	CondConvContinual	Average Accuracy	77.4	—	Unverified
7	PAENet	Average Accuracy	77.1	—	Unverified
8	CPG-light	Average Accuracy	77	—	Unverified
9	PackNet	Average Accuracy	67.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ALTA-ViTB/16	Average Accuracy	89.8	—	Unverified
2	ALTA-RN50x4	Average Accuracy	84.73	—	Unverified
3	ALTA-RN101	Average Accuracy	83.35	—	Unverified
4	ALTA-RN50	Average Accuracy	81.07	—	Unverified
5	SNCL	Average Accuracy	52.85	—	Unverified
6	DER [buzzega2020dark]	Average Accuracy	51.78	—	Unverified
7	ER[riemer2018learning]	Average Accuracy	48.64	—	Unverified
8	iCaRL [rebuffi2017icarl]	Average Accuracy	31.55	—	Unverified
9	A-GEM [chaudhry2018efficient]	Average Accuracy	25.33	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CAT (CNN backbone)	Acc	0.76	—	Unverified
2	CAT (MLP backbone)	Acc	0.69	—	Unverified
3	EWC	Acc	0.65	—	Unverified
4	HyperNet	Acc	0.6	—	Unverified
5	PathNet	Acc	0.58	—	Unverified
6	HAT	Acc	0.57	—	Unverified
7	RPSNet	Acc	0.55	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CTR	F1 - macro	0.95	—	Unverified
2	HAT	F1 - macro	0.95	—	Unverified
3	CAT	F1 - macro	0.95	—	Unverified
4	B-CL	F1 - macro	0.95	—	Unverified
5	EWC	F1 - macro	0.92	—	Unverified
6	LAMOL	F1 - macro	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	84.26	—	Unverified
2	H$^{2}$	Accuracy	84.1	—	Unverified
3	CPG	Accuracy	83.59	—	Unverified
4	Piggyback	Accuracy	80.5	—	Unverified
5	PackNet	Accuracy	80.41	—	Unverified
6	ProgressiveNet	Accuracy	78.94	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CTR	F1 - macro	0.89	—	Unverified
2	CAT	F1 - macro	0.87	—	Unverified
3	HAT	F1 - macro	0.86	—	Unverified
4	KAN	F1 - macro	0.81	—	Unverified
5	B-CL	F1 - macro	0.77	—	Unverified
6	EWC	F1 - macro	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	97.16	—	Unverified
2	CPG	Accuracy	96.62	—	Unverified
3	H$^{2}$	Accuracy	94.9	—	Unverified
4	Piggyback	Accuracy	94.77	—	Unverified
5	ProgressiveNet	Accuracy	93.41	—	Unverified
6	PackNet	Accuracy	93.04	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Piggyback	Accuracy	76.16	—	Unverified
2	ProgressiveNet	Accuracy	76.16	—	Unverified
3	CondConvContinual	Accuracy	76.16	—	Unverified
4	CPG	Accuracy	75.81	—	Unverified
5	PackNet	Accuracy	75.71	—	Unverified
6	H$^{2}$	Accuracy	75.71	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	80.77	—	Unverified
2	CPG	Accuracy	80.33	—	Unverified
3	Piggyback	Accuracy	79.91	—	Unverified
4	ProgressiveNet	Accuracy	76.35	—	Unverified
5	H$^{2}$	Accuracy	76.2	—	Unverified
6	PackNet	Accuracy	76.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CPG	Accuracy	92.8	—	Unverified
2	CondConvContinual	Accuracy	92.61	—	Unverified
3	H$^{2}$	Accuracy	90.6	—	Unverified
4	Piggyback	Accuracy	89.62	—	Unverified
5	ProgressiveNet	Accuracy	89.21	—	Unverified
6	PackNet	Accuracy	86.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	78.32	—	Unverified
2	CPG	Accuracy	77.15	—	Unverified
3	H$^{2}$	Accuracy	75.1	—	Unverified
4	ProgressiveNet	Accuracy	74.94	—	Unverified
5	Piggyback	Accuracy	71.33	—	Unverified
6	PackNet	Accuracy	69.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ALTA-ViTB/16	Average Accuracy	92.85	—	Unverified
2	ALTA-RN50x4	Average Accuracy	84.91	—	Unverified
3	RMN (Resnet)	Average Accuracy	84.9	—	Unverified
4	ALTA-RN101	Average Accuracy	84.77	—	Unverified
5	ALTA-RN50	Average Accuracy	83.87	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RMN	Accuracy	68.1	—	Unverified
2	CondConvContinual	Accuracy	61.32	—	Unverified
3	CCGN	Accuracy	35.24	—	Unverified
4	DGMw	Accuracy	17.82	—	Unverified
5	DGMa	Accuracy	15.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RMN	Average Accuracy	97.99	—	Unverified
2	Model Zoo-Continual	Average Accuracy	97.71	—	Unverified
3	CODE-CL	Average Accuracy	96.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Accuracy	62.59	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CODE-CL	Average Accuracy	93.32	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TEST	1:3 Accuracy	2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Average Accuracy	62.79	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	82.69	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	88.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Model Zoo-Continual	Average Accuracy	84.27	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Accuracy	61.58	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CODE-CL	Average Accuracy	68.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Accuracy	57.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	53.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MRM	Acc	78.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Model Zoo-Continual	Average Accuracy	99.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CODE-CL	Average Accuracy	77.21	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	H$^{2}$	Top 1 Accuracy %	97.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	H$^{2}$	Top 1 Accuracy %	99.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	52.38	—	Unverified