Continual Learning

Continual Learning (also known as Incremental Learning, Life-long Learning) is a concept to learn a model for a large number of tasks sequentially without forgetting knowledge obtained from the preceding tasks, where the data in the old tasks are not available anymore during training new ones.
If not mentioned, the benchmarks here are Task-CL, where task-id is provided on validation.

Source:
Continual Learning by Asymmetric Loss Approximation with Single-Side Overestimation
Three scenarios for continual learning
Lifelong Machine Learning
Continual lifelong learning with neural networks: A review

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 901–950 of 2644 papers

Title	Date	Tasks	Status	Hype
Natural Mitigation of Catastrophic Interference: Continual Learning in Power-Law Learning Environments	Jan 18, 2024	Continual Learning	—Unverified	0
Enabling On-device Continual Learning with Binary Neural Networks	Jan 18, 2024	Continual LearningQuantization	—Unverified	0
Divide and not forget: Ensemble of selectively trained experts in Continual Learning	Jan 18, 2024	class-incremental learningClass Incremental Learning	CodeCode Available	0
CEL: A Continual Learning Model for Disease Outbreak Prediction by Leveraging Domain Adaptation via Elastic Weight Consolidation	Jan 17, 2024	Continual LearningDomain Adaptation	CodeCode Available	0
Towards Continual Learning Desiderata via HSIC-Bottleneck Orthogonalization and Equiangular Embedding	Jan 17, 2024	Continual Learning	—Unverified	0
CPPO: Continual Learning for Reinforcement Learning with Human Feedback	Jan 16, 2024	Continual Learningreinforcement-learning	—Unverified	0
Decentralised Emergence of Robust and Adaptive Linguistic Conventions in Populations of Autonomous Agents Grounded in Continuous Worlds	Jan 16, 2024	Continual Learning	—Unverified	0
SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language Models	Jan 16, 2024	Continual LearningTransfer Learning	—Unverified	0
Enhancing Consistency and Mitigating Bias: A Data Replay Approach for Incremental Learning	Jan 12, 2024	class-incremental learningClass Incremental Learning	—Unverified	0
EsaCL: Efficient Continual Learning of Sparse Models	Jan 11, 2024	Continual Learning	—Unverified	0
Continuously Learning New Words in Automatic Speech Recognition	Jan 9, 2024	Automatic Speech RecognitionAutomatic Speech Recognition (ASR)	—Unverified	0
A Topology-aware Graph Coarsening Framework for Continual Graph Learning	Jan 5, 2024	Continual LearningGraph Learning	—Unverified	0
t-DGR: A Trajectory-Based Deep Generative Replay Method for Continual Learning in Decision Making	Jan 4, 2024	Continual LearningDecision Making	CodeCode Available	1
Balancing Continual Learning and Fine-tuning for Human Activity Recognition	Jan 4, 2024	Activity RecognitionContinual Learning	—Unverified	0
GLIDE-RL: Grounded Language Instruction through DEmonstration in RL	Jan 3, 2024	Continual Learningreinforcement-learning	—Unverified	0
Unsupervised Continual Anomaly Detection with Contrastively-learned Prompt	Jan 2, 2024	Anomaly DetectionAnomaly Segmentation	CodeCode Available	2
Elastic Multi-Gradient Descent for Parallel Continual Learning	Jan 2, 2024	Continual Learning	—Unverified	0
Online Task-Free Continual Generative and Discriminative Learning via Dynamic Cluster Memory	Jan 1, 2024	Continual LearningDiversity	CodeCode Available	1
Traceable Federated Continual Learning	Jan 1, 2024	Continual Learning	CodeCode Available	1
Uncertainty-Guided Never-Ending Learning to Drive	Jan 1, 2024	Autonomous DrivingContinual Learning	—Unverified	0
Continual Learning for Motion Prediction Model via Meta-Representation Learning and Optimal Memory Buffer Retention Strategy	Jan 1, 2024	Autonomous DrivingAutonomous Vehicles	—Unverified	0
NICE: Neurogenesis Inspired Contextual Encoding for Replay-free Class Incremental Learning	Jan 1, 2024	class-incremental learningClass Incremental Learning	CodeCode Available	1
RCL: Reliable Continual Learning for Unified Failure Detection	Jan 1, 2024	Continual LearningDecision Making	CodeCode Available	0
Effect of Optimizer, Initializer, and Architecture of Hypernetworks on Continual Learning from Demonstration	Dec 31, 2023	Continual Learning	CodeCode Available	0
Continual Learning via Sequential Function-Space Variational Inference	Dec 28, 2023	Bayesian InferenceContinual Learning	CodeCode Available	1
Continual Learning in Medical Image Analysis: A Comprehensive Review of Recent Advancements and Future Prospects	Dec 28, 2023	Continual LearningMedical Image Analysis	—Unverified	0
Infinite dSprites for Disentangled Continual Learning: Separating Memory Edits from Generalization	Dec 27, 2023	ClassificationContinual Learning	CodeCode Available	0
Dynamic Sub-graph Distillation for Robust Semi-supervised Continual Learning	Dec 27, 2023	Continual Learninggraph construction	CodeCode Available	0
Federated Continual Learning via Knowledge Fusion: A Survey	Dec 27, 2023	Continual LearningFederated Learning	—Unverified	0
An Incremental Update Framework for Online Recommenders with Data-Driven Prior	Dec 26, 2023	Continual Learning	—Unverified	0
Recursive Distillation for Open-Set Distributed Robot Localization	Dec 26, 2023	Continual LearningImage Retrieval	—Unverified	0
Learning to Prompt Knowledge Transfer for Open-World Continual Learning	Dec 22, 2023	Continual LearningTransfer Learning	CodeCode Available	0
PUMA: Efficient Continual Graph Learning for Node Classification with Graph Condensation	Dec 22, 2023	Continual LearningGraph Learning	CodeCode Available	0
Adapt & Align: Continual Learning with Generative Models Latent Space Alignment	Dec 21, 2023	Continual Learning	CodeCode Available	0
Interactive Visual Task Learning for Robots	Dec 20, 2023	Continual LearningNovel Concepts	—Unverified	0
Doubly Perturbed Task Free Continual Learning	Dec 20, 2023	Continual LearningDecision Making	—Unverified	0
Underwater Acoustic Signal Recognition Based on Salient Feature	Dec 20, 2023	Continual LearningDeep Learning	—Unverified	0
Continual Learning: Forget-free Winning Subnetworks for Video Representations	Dec 19, 2023	class-incremental learningClass Incremental Learning	CodeCode Available	1
CLOVA: A Closed-Loop Visual Assistant with Tool Usage and Update	Dec 18, 2023	Continual LearningQuestion Answering	—Unverified	0
Prediction and Control in Continual Reinforcement Learning	Dec 18, 2023	Continual LearningGeneral Knowledge	CodeCode Available	1
What to Remember: Self-Adaptive Continual Learning for Audio Deepfake Detection	Dec 15, 2023	Audio Deepfake DetectionContinual Learning	CodeCode Available	1
Bayesian Metaplasticity from Synaptic Uncertainty	Dec 15, 2023	Bayesian InferenceContinual Learning	—Unverified	0
Continual Adversarial Defense	Dec 15, 2023	Adversarial DefenseContinual Learning	CodeCode Available	0
RTRA: Rapid Training of Regularization-based Approaches in Continual Learning	Dec 14, 2023	Continual Learning	—Unverified	0
PBES: PCA Based Exemplar Sampling Algorithm for Continual Learning	Dec 14, 2023	class-incremental learningClass Incremental Learning	—Unverified	0
Managing the unknown: a survey on Open Set Recognition and tangential areas	Dec 14, 2023	Continual LearningNovelty Detection	—Unverified	0
Learning a Low-Rank Feature Representation: Achieving Better Trade-Off between Stability and Plasticity in Continual Learning	Dec 14, 2023	Continual Learning	CodeCode Available	0
Weighted Ensemble Models Are Strong Continual Learners	Dec 14, 2023	Continual Learning	CodeCode Available	1
Adaptive Shortcut Debiasing for Online Continual Learning	Dec 14, 2023	Continual Learning	—Unverified	0
Read Between the Layers: Leveraging Multi-Layer Representations for Rehearsal-Free Continual Learning with Pre-Trained Models	Dec 13, 2023	class-incremental learningClass Incremental Learning	CodeCode Available	0

Show:10 25 50

← PrevPage 19 of 53Next →

All datasets ASC (19 tasks)visual domain decathlon (10 tasks)Cifar100 (20 tasks)Tiny-ImageNet (10tasks)F-CelebA (10 tasks)20Newsgroup (10 tasks)CUBS (Fine-grained 6 Tasks)DSC (10 tasks)Flowers (Fine-grained 6 Tasks)ImageNet (Fine-grained 6 Tasks)Sketch (Fine-grained 6 Tasks)Stanford Cars (Fine-grained 6 Tasks)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Multi-task Learning (MTL; Upper Bound)	F1 - macro	0.88	—	Unverified
2	CTR	F1 - macro	0.84	—	Unverified
3	B-CL	F1 - macro	0.81	—	Unverified
4	LAMOL	F1 - macro	0.81	—	Unverified
5	OWM	F1 - macro	0.79	—	Unverified
6	A-GEM	F1 - macro	0.78	—	Unverified
7	HAT	F1 - macro	0.78	—	Unverified
8	Independent Learning (ONE)	F1 - macro	0.78	—	Unverified
9	KAN	F1 - macro	0.77	—	Unverified
10	Naive Continual Learning (NCL)	F1 - macro	0.77	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NetTailor	decathlon discipline (Score)	3,744	—	Unverified
2	Depthwise Soft Sharing	decathlon discipline (Score)	3,507	—	Unverified
3	Parallel Res. adapt.	decathlon discipline (Score)	3,412	—	Unverified
4	Depthwise Sharing	decathlon discipline (Score)	3,234	—	Unverified
5	Series Res. adapt.	decathlon discipline (Score)	3,159	—	Unverified
6	Res. adapt. (large)	decathlon discipline (Score)	3,131	—	Unverified
7	DAN	decathlon discipline (Score)	2,851	—	Unverified
8	Piggyback	decathlon discipline (Score)	2,838	—	Unverified
9	Res. adapt. finetune all	decathlon discipline (Score)	2,643	—	Unverified
10	Res. adapt. decay	decathlon discipline (Score)	2,621	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Model Zoo-Continual	Average Accuracy	94.99	—	Unverified
2	ALTA	Average Accuracy	92.98	—	Unverified
3	kNN-CLIP	Average Accuracy	90.8	—	Unverified
4	RMN	Average Accuracy	81	—	Unverified
5	CPG	Average Accuracy	80.9	—	Unverified
6	CondConvContinual	Average Accuracy	77.4	—	Unverified
7	PAENet	Average Accuracy	77.1	—	Unverified
8	CPG-light	Average Accuracy	77	—	Unverified
9	PackNet	Average Accuracy	67.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ALTA-ViTB/16	Average Accuracy	89.8	—	Unverified
2	ALTA-RN50x4	Average Accuracy	84.73	—	Unverified
3	ALTA-RN101	Average Accuracy	83.35	—	Unverified
4	ALTA-RN50	Average Accuracy	81.07	—	Unverified
5	SNCL	Average Accuracy	52.85	—	Unverified
6	DER [buzzega2020dark]	Average Accuracy	51.78	—	Unverified
7	ER[riemer2018learning]	Average Accuracy	48.64	—	Unverified
8	iCaRL [rebuffi2017icarl]	Average Accuracy	31.55	—	Unverified
9	A-GEM [chaudhry2018efficient]	Average Accuracy	25.33	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CAT (CNN backbone)	Acc	0.76	—	Unverified
2	CAT (MLP backbone)	Acc	0.69	—	Unverified
3	EWC	Acc	0.65	—	Unverified
4	HyperNet	Acc	0.6	—	Unverified
5	PathNet	Acc	0.58	—	Unverified
6	HAT	Acc	0.57	—	Unverified
7	RPSNet	Acc	0.55	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CTR	F1 - macro	0.95	—	Unverified
2	HAT	F1 - macro	0.95	—	Unverified
3	CAT	F1 - macro	0.95	—	Unverified
4	B-CL	F1 - macro	0.95	—	Unverified
5	EWC	F1 - macro	0.92	—	Unverified
6	LAMOL	F1 - macro	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	84.26	—	Unverified
2	H$^{2}$	Accuracy	84.1	—	Unverified
3	CPG	Accuracy	83.59	—	Unverified
4	Piggyback	Accuracy	80.5	—	Unverified
5	PackNet	Accuracy	80.41	—	Unverified
6	ProgressiveNet	Accuracy	78.94	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CTR	F1 - macro	0.89	—	Unverified
2	CAT	F1 - macro	0.87	—	Unverified
3	HAT	F1 - macro	0.86	—	Unverified
4	KAN	F1 - macro	0.81	—	Unverified
5	B-CL	F1 - macro	0.77	—	Unverified
6	EWC	F1 - macro	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	97.16	—	Unverified
2	CPG	Accuracy	96.62	—	Unverified
3	H$^{2}$	Accuracy	94.9	—	Unverified
4	Piggyback	Accuracy	94.77	—	Unverified
5	ProgressiveNet	Accuracy	93.41	—	Unverified
6	PackNet	Accuracy	93.04	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Piggyback	Accuracy	76.16	—	Unverified
2	ProgressiveNet	Accuracy	76.16	—	Unverified
3	CondConvContinual	Accuracy	76.16	—	Unverified
4	CPG	Accuracy	75.81	—	Unverified
5	PackNet	Accuracy	75.71	—	Unverified
6	H$^{2}$	Accuracy	75.71	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	80.77	—	Unverified
2	CPG	Accuracy	80.33	—	Unverified
3	Piggyback	Accuracy	79.91	—	Unverified
4	ProgressiveNet	Accuracy	76.35	—	Unverified
5	H$^{2}$	Accuracy	76.2	—	Unverified
6	PackNet	Accuracy	76.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CPG	Accuracy	92.8	—	Unverified
2	CondConvContinual	Accuracy	92.61	—	Unverified
3	H$^{2}$	Accuracy	90.6	—	Unverified
4	Piggyback	Accuracy	89.62	—	Unverified
5	ProgressiveNet	Accuracy	89.21	—	Unverified
6	PackNet	Accuracy	86.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	78.32	—	Unverified
2	CPG	Accuracy	77.15	—	Unverified
3	H$^{2}$	Accuracy	75.1	—	Unverified
4	ProgressiveNet	Accuracy	74.94	—	Unverified
5	Piggyback	Accuracy	71.33	—	Unverified
6	PackNet	Accuracy	69.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ALTA-ViTB/16	Average Accuracy	92.85	—	Unverified
2	ALTA-RN50x4	Average Accuracy	84.91	—	Unverified
3	RMN (Resnet)	Average Accuracy	84.9	—	Unverified
4	ALTA-RN101	Average Accuracy	84.77	—	Unverified
5	ALTA-RN50	Average Accuracy	83.87	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RMN	Accuracy	68.1	—	Unverified
2	CondConvContinual	Accuracy	61.32	—	Unverified
3	CCGN	Accuracy	35.24	—	Unverified
4	DGMw	Accuracy	17.82	—	Unverified
5	DGMa	Accuracy	15.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RMN	Average Accuracy	97.99	—	Unverified
2	Model Zoo-Continual	Average Accuracy	97.71	—	Unverified
3	CODE-CL	Average Accuracy	96.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Accuracy	62.59	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CODE-CL	Average Accuracy	93.32	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TEST	1:3 Accuracy	2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Average Accuracy	62.79	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	82.69	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	88.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Model Zoo-Continual	Average Accuracy	84.27	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Accuracy	61.58	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CODE-CL	Average Accuracy	68.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Accuracy	57.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	53.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MRM	Acc	78.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Model Zoo-Continual	Average Accuracy	99.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CODE-CL	Average Accuracy	77.21	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	H$^{2}$	Top 1 Accuracy %	97.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	H$^{2}$	Top 1 Accuracy %	99.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	52.38	—	Unverified