Continual Learning

Continual Learning (also known as Incremental Learning, Life-long Learning) is a concept to learn a model for a large number of tasks sequentially without forgetting knowledge obtained from the preceding tasks, where the data in the old tasks are not available anymore during training new ones.
If not mentioned, the benchmarks here are Task-CL, where task-id is provided on validation.

Source:
Continual Learning by Asymmetric Loss Approximation with Single-Side Overestimation
Three scenarios for continual learning
Lifelong Machine Learning
Continual lifelong learning with neural networks: A review

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1451–1500 of 2644 papers

Title	Date	Tasks	Status
Neuro-mimetic Task-free Unsupervised Online Learning with Continual Self-Organizing Maps	Feb 19, 2024	class-incremental learningClass Incremental Learning	—Unverified
Neuronal Auditory Machine Intelligence (NEURO-AMI) In Perspective	Oct 14, 2023	Continual Learning	—Unverified
Neuro-Symbolic Concepts	May 9, 2025	Continual LearningNovel Concepts	—Unverified
NeVRF: Neural Video-based Radiance Fields for Long-duration Sequences	Dec 10, 2023	Continual LearningNeRF	—Unverified
New metrics for analyzing continual learners	Sep 1, 2023	Continual Learning	—Unverified
No Forgetting Learning: Memory-free Continual Learning	Mar 6, 2025	Continual LearningKnowledge Distillation	—Unverified
Noise-Tolerant Coreset-Based Class Incremental Continual Learning	Apr 23, 2025	class-incremental learningClass Incremental Learning	—Unverified
Nonconvex Continual Learning with Episodic Memory	Jan 1, 2021	Continual Learningimage-classification	—Unverified
Non-IID data and Continual Learning processes in Federated Learning: A long road ahead	Nov 26, 2021	BIG-bench Machine LearningContinual Learning	—Unverified
Non-Intrusive Load Monitoring Based on Image Load Signatures and Continual Learning	Jun 7, 2025	Continual LearningNon-Intrusive Load Monitoring	—Unverified
Non-Stationary Learning of Neural Networks with Automatic Soft Parameter Reset	Nov 6, 2024	Continual LearningMulti-Armed Bandits	—Unverified
Normalization and effective learning rates in reinforcement learning	Jul 1, 2024	Atari GamesContinual Learning	—Unverified
Novel-WD: Exploring acquisition of Novel World Knowledge in LLMs Using Prefix-Tuning	Aug 30, 2024	Causal Language ModelingContinual Learning	—Unverified
nVFNet-RDC: Replay and Non-Local Distillation Collaboration for Continual Object Detection	Sep 8, 2022	Continual Learningobject-detection	—Unverified
ODEStream: A Buffer-Free Online Learning Framework with ODE-based Adaptor for Streaming Time Series Forecasting	Nov 11, 2024	Continual LearningTime Series	—Unverified
OER: Offline Experience Replay for Continual Offline Reinforcement Learning	May 23, 2023	Continual LearningMuJoCo	—Unverified
Non-Exemplar Online Class-incremental Continual Learning via Dual-prototype Self-augment and Refinement	Mar 20, 2023	Continual Learning	—Unverified
On Continual Model Refinement in Out-of-Distribution Data Streams	May 4, 2022	BenchmarkingContinual Learning	—Unverified
On regret bounds for continual single-index learning	Feb 25, 2021	Continual Learning	—Unverified
On-device edge learning for IoT data streams: a survey	Feb 25, 2025	Continual LearningMeta-Learning	—Unverified
On-Device Federated Continual Learning on RISC-V-based Ultra-Low-Power SoC for Intelligent Nano-Drone Swarms	Mar 21, 2025	Continual LearningFace Recognition	—Unverified
On-Device Learning with Binary Neural Networks	Aug 29, 2023	Continual LearningQuantization	—Unverified
On-device Synaptic Memory Consolidation using Fowler-Nordheim Quantum-tunneling	Jun 27, 2022	Continual Learning	—Unverified
One Pass ImageNet	Nov 3, 2021	Continual LearningDeep Learning	—Unverified
One-shot learning for the long term: consolidation with an artificial hippocampal algorithm	Feb 15, 2021	Continual LearningFew-Shot Learning	—Unverified
One-stage Prompt-based Continual Learning	Feb 25, 2024	Continual Learning	—Unverified
One VLM to Keep it Learning: Generation and Balancing for Data-free Continual Visual Question Answering	Nov 4, 2024	Continual LearningQuestion Answering	—Unverified
On Generalizing Beyond Domains in Cross-Domain Continual Learning	Mar 8, 2022	Continual LearningKnowledge Distillation	—Unverified
On Label-Eﬀicient Computer Vision: Building Fast and Effective Few-Shot Image Classifiers	Oct 19, 2021	Active LearningContinual Learning	—Unverified
Online Analytic Exemplar-Free Continual Learning with Large Models for Imbalanced Autonomous Driving Task	May 28, 2024	Autonomous DrivingContinual Learning	—Unverified
Online Continual Knowledge Learning for Language Models	Nov 16, 2023	Continual LearningFact Checking	—Unverified
Online Continual Learning for Robust Indoor Object Recognition	Jul 19, 2023	Continual LearningObject	—Unverified
Online Continual Learning For Visual Food Classification	Aug 15, 2021	ClassificationContinual Learning	—Unverified
Online Continual Learning from Imbalanced Data	Jan 1, 2020	Computational EfficiencyContinual Learning	—Unverified
Online Continual Learning of End-to-End Speech Recognition Models	Jul 11, 2022	Automatic Speech RecognitionAutomatic Speech Recognition (ASR)	—Unverified
Lifelong Learning of Video Diffusion Models From a Single Video Stream	Jun 7, 2024	Continual LearningLifelong learning	—Unverified
Online Continual Learning on Hierarchical Label Expansion	Aug 28, 2023	Continual Learning	—Unverified
Online Continual Learning on Sequences	Mar 20, 2020	Continual LearningIncremental Learning	—Unverified
Online Continual Learning Under Domain Shift	Jan 1, 2021	Continual Learning	—Unverified
Online Continual Learning Via Candidates Voting	Oct 17, 2021	Continual Learningimage-classification	—Unverified
Online Continual Learning via the Knowledge Invariant and Spread-out Properties	Feb 2, 2023	Continual Learning	—Unverified
Online Continual Learning via the Meta-learning Update with Multi-scale Knowledge Distillation and Data Augmentation	Sep 12, 2022	Continual LearningData Augmentation	—Unverified
Online Continual Learning with Contrastive Vision Transformer	Jul 24, 2022	Continual LearningContrastive Learning	—Unverified
Online Coreset Selection for Rehearsal-based Continual Learning	Jun 2, 2021	Continual Learning	—Unverified
Online Curvature-Aware Replay: Leveraging 2^nd Order Information for Online Continual Learning	Feb 3, 2025	Continual Learning	—Unverified
Online DPO: Online Direct Preference Optimization with Fast-Slow Chasing	Jun 8, 2024	Continual Learning	—Unverified
Online Fast Adaptation and Knowledge Accumulation (OSAKA): a New Approach to Continual Learning	Dec 1, 2020	Continual LearningMeta-Learning	—Unverified
Reconciling meta-learning and continual learning with online mixtures of tasks	Dec 14, 2018	Continual LearningFew-Shot Learning	—Unverified
Online hand gesture recognition using Continual Graph Transformers	Feb 20, 2025	Action RecognitionContinual Learning	—Unverified
Online Learned Continual Compression with Stacked Quantization Modules	Sep 25, 2019	Continual LearningQuantization	—Unverified

Show:10 25 50

← PrevPage 30 of 53Next →

All datasets ASC (19 tasks)visual domain decathlon (10 tasks)Cifar100 (20 tasks)Tiny-ImageNet (10tasks)F-CelebA (10 tasks)20Newsgroup (10 tasks)CUBS (Fine-grained 6 Tasks)DSC (10 tasks)Flowers (Fine-grained 6 Tasks)ImageNet (Fine-grained 6 Tasks)Sketch (Fine-grained 6 Tasks)Stanford Cars (Fine-grained 6 Tasks)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Multi-task Learning (MTL; Upper Bound)	F1 - macro	0.88	—	Unverified
2	CTR	F1 - macro	0.84	—	Unverified
3	B-CL	F1 - macro	0.81	—	Unverified
4	LAMOL	F1 - macro	0.81	—	Unverified
5	OWM	F1 - macro	0.79	—	Unverified
6	A-GEM	F1 - macro	0.78	—	Unverified
7	HAT	F1 - macro	0.78	—	Unverified
8	Independent Learning (ONE)	F1 - macro	0.78	—	Unverified
9	KAN	F1 - macro	0.77	—	Unverified
10	Naive Continual Learning (NCL)	F1 - macro	0.77	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NetTailor	decathlon discipline (Score)	3,744	—	Unverified
2	Depthwise Soft Sharing	decathlon discipline (Score)	3,507	—	Unverified
3	Parallel Res. adapt.	decathlon discipline (Score)	3,412	—	Unverified
4	Depthwise Sharing	decathlon discipline (Score)	3,234	—	Unverified
5	Series Res. adapt.	decathlon discipline (Score)	3,159	—	Unverified
6	Res. adapt. (large)	decathlon discipline (Score)	3,131	—	Unverified
7	DAN	decathlon discipline (Score)	2,851	—	Unverified
8	Piggyback	decathlon discipline (Score)	2,838	—	Unverified
9	Res. adapt. finetune all	decathlon discipline (Score)	2,643	—	Unverified
10	Res. adapt. decay	decathlon discipline (Score)	2,621	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Model Zoo-Continual	Average Accuracy	94.99	—	Unverified
2	ALTA	Average Accuracy	92.98	—	Unverified
3	kNN-CLIP	Average Accuracy	90.8	—	Unverified
4	RMN	Average Accuracy	81	—	Unverified
5	CPG	Average Accuracy	80.9	—	Unverified
6	CondConvContinual	Average Accuracy	77.4	—	Unverified
7	PAENet	Average Accuracy	77.1	—	Unverified
8	CPG-light	Average Accuracy	77	—	Unverified
9	PackNet	Average Accuracy	67.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ALTA-ViTB/16	Average Accuracy	89.8	—	Unverified
2	ALTA-RN50x4	Average Accuracy	84.73	—	Unverified
3	ALTA-RN101	Average Accuracy	83.35	—	Unverified
4	ALTA-RN50	Average Accuracy	81.07	—	Unverified
5	SNCL	Average Accuracy	52.85	—	Unverified
6	DER [buzzega2020dark]	Average Accuracy	51.78	—	Unverified
7	ER[riemer2018learning]	Average Accuracy	48.64	—	Unverified
8	iCaRL [rebuffi2017icarl]	Average Accuracy	31.55	—	Unverified
9	A-GEM [chaudhry2018efficient]	Average Accuracy	25.33	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CAT (CNN backbone)	Acc	0.76	—	Unverified
2	CAT (MLP backbone)	Acc	0.69	—	Unverified
3	EWC	Acc	0.65	—	Unverified
4	HyperNet	Acc	0.6	—	Unverified
5	PathNet	Acc	0.58	—	Unverified
6	HAT	Acc	0.57	—	Unverified
7	RPSNet	Acc	0.55	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CTR	F1 - macro	0.95	—	Unverified
2	HAT	F1 - macro	0.95	—	Unverified
3	CAT	F1 - macro	0.95	—	Unverified
4	B-CL	F1 - macro	0.95	—	Unverified
5	EWC	F1 - macro	0.92	—	Unverified
6	LAMOL	F1 - macro	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	84.26	—	Unverified
2	H$^{2}$	Accuracy	84.1	—	Unverified
3	CPG	Accuracy	83.59	—	Unverified
4	Piggyback	Accuracy	80.5	—	Unverified
5	PackNet	Accuracy	80.41	—	Unverified
6	ProgressiveNet	Accuracy	78.94	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CTR	F1 - macro	0.89	—	Unverified
2	CAT	F1 - macro	0.87	—	Unverified
3	HAT	F1 - macro	0.86	—	Unverified
4	KAN	F1 - macro	0.81	—	Unverified
5	B-CL	F1 - macro	0.77	—	Unverified
6	EWC	F1 - macro	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	97.16	—	Unverified
2	CPG	Accuracy	96.62	—	Unverified
3	H$^{2}$	Accuracy	94.9	—	Unverified
4	Piggyback	Accuracy	94.77	—	Unverified
5	ProgressiveNet	Accuracy	93.41	—	Unverified
6	PackNet	Accuracy	93.04	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Piggyback	Accuracy	76.16	—	Unverified
2	ProgressiveNet	Accuracy	76.16	—	Unverified
3	CondConvContinual	Accuracy	76.16	—	Unverified
4	CPG	Accuracy	75.81	—	Unverified
5	PackNet	Accuracy	75.71	—	Unverified
6	H$^{2}$	Accuracy	75.71	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	80.77	—	Unverified
2	CPG	Accuracy	80.33	—	Unverified
3	Piggyback	Accuracy	79.91	—	Unverified
4	ProgressiveNet	Accuracy	76.35	—	Unverified
5	H$^{2}$	Accuracy	76.2	—	Unverified
6	PackNet	Accuracy	76.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CPG	Accuracy	92.8	—	Unverified
2	CondConvContinual	Accuracy	92.61	—	Unverified
3	H$^{2}$	Accuracy	90.6	—	Unverified
4	Piggyback	Accuracy	89.62	—	Unverified
5	ProgressiveNet	Accuracy	89.21	—	Unverified
6	PackNet	Accuracy	86.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	78.32	—	Unverified
2	CPG	Accuracy	77.15	—	Unverified
3	H$^{2}$	Accuracy	75.1	—	Unverified
4	ProgressiveNet	Accuracy	74.94	—	Unverified
5	Piggyback	Accuracy	71.33	—	Unverified
6	PackNet	Accuracy	69.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ALTA-ViTB/16	Average Accuracy	92.85	—	Unverified
2	ALTA-RN50x4	Average Accuracy	84.91	—	Unverified
3	RMN (Resnet)	Average Accuracy	84.9	—	Unverified
4	ALTA-RN101	Average Accuracy	84.77	—	Unverified
5	ALTA-RN50	Average Accuracy	83.87	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RMN	Accuracy	68.1	—	Unverified
2	CondConvContinual	Accuracy	61.32	—	Unverified
3	CCGN	Accuracy	35.24	—	Unverified
4	DGMw	Accuracy	17.82	—	Unverified
5	DGMa	Accuracy	15.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RMN	Average Accuracy	97.99	—	Unverified
2	Model Zoo-Continual	Average Accuracy	97.71	—	Unverified
3	CODE-CL	Average Accuracy	96.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Accuracy	62.59	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CODE-CL	Average Accuracy	93.32	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TEST	1:3 Accuracy	2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Average Accuracy	62.79	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	82.69	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	88.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Model Zoo-Continual	Average Accuracy	84.27	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Accuracy	61.58	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CODE-CL	Average Accuracy	68.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Accuracy	57.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	53.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MRM	Acc	78.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Model Zoo-Continual	Average Accuracy	99.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CODE-CL	Average Accuracy	77.21	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	H$^{2}$	Top 1 Accuracy %	97.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	H$^{2}$	Top 1 Accuracy %	99.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	52.38	—	Unverified