Continual Learning

Continual Learning (also known as Incremental Learning, Life-long Learning) is a concept to learn a model for a large number of tasks sequentially without forgetting knowledge obtained from the preceding tasks, where the data in the old tasks are not available anymore during training new ones.
If not mentioned, the benchmarks here are Task-CL, where task-id is provided on validation.

Source:
Continual Learning by Asymmetric Loss Approximation with Single-Side Overestimation
Three scenarios for continual learning
Lifelong Machine Learning
Continual lifelong learning with neural networks: A review

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 451–500 of 2644 papers

Title	Date	Tasks	Status	Hype
Unsupervised Assessment of Landscape Shifts Based on Persistent Entropy and Topological Preservation	Oct 5, 2024	Continual LearningTopological Data Analysis	—Unverified	0
A Retention-Centric Framework for Continual Learning with Guaranteed Model Developmental Safety	Oct 4, 2024	Autonomous DrivingContinual Learning	CodeCode Available	0
Variational Bayes Gaussian Splatting	Oct 4, 2024	Continual LearningVariational Inference	CodeCode Available	1
Structural-Entropy-Based Sample Selection for Efficient and Effective Learning	Oct 3, 2024	Active LearningContinual Learning	—Unverified	0
Self-Updatable Large Language Models with Parameter Integration	Oct 1, 2024	Continual LearningConversational Recommendation	—Unverified	0
LoRanPAC: Low-rank Random Features and Pre-trained Models for Bridging Theory and Practice in Continual Learning	Oct 1, 2024	Continual Learning	CodeCode Available	0
Mining Your Own Secrets: Diffusion Classifier Scores for Continual Personalization of Text-to-Image Diffusion Models	Oct 1, 2024	Continual Learning	—Unverified	0
Fine-Grained Gradient Restriction: A Simple Approach for Mitigating Catastrophic Forgetting	Oct 1, 2024	Continual Learning	—Unverified	0
Simplified priors for Object-Centric Learning	Oct 1, 2024	Continual LearningObject	—Unverified	0
GPTreeO: An R package for continual regression with dividing local Gaussian processes	Oct 1, 2024	Continual LearningGaussian Processes	—Unverified	0
Empowering Large Language Model for Continual Video Question Answering with Collaborative Prompting	Oct 1, 2024	Continual LearningLanguage Modeling	CodeCode Available	1
Demonstrating the Continual Learning Capabilities and Practical Application of Discrete-Time Active Inference	Sep 30, 2024	Bayesian InferenceContinual Learning	CodeCode Available	0
Continual Human Pose Estimation for Incremental Integration of Keypoints and Pose Variations	Sep 30, 2024	Continual LearningPose Estimation	—Unverified	0
Beyond Prompts: Dynamic Conversational Benchmarking of Large Language Models	Sep 30, 2024	BenchmarkingContinual Learning	CodeCode Available	2
Learning Attentional Mixture of LoRAs for Language Model Continual Learning	Sep 29, 2024	Continual LearningLanguage Modeling	—Unverified	0
Forgetting, Ignorance or Myopia: Revisiting Key Challenges in Online Continual Learning	Sep 28, 2024	Continual LearningMaximum Separation	CodeCode Available	0
LW2G: Learning Whether to Grow for Prompt-based Continual Learning	Sep 27, 2024	Continual LearningPrompt Learning	CodeCode Available	0
How green is continual learning, really? Analyzing the energy consumption in continual training of vision foundation models	Sep 27, 2024	Continual LearningIncremental Learning	—Unverified	0
Optimal Protocols for Continual Learning via Statistical Physics and Control Theory	Sep 26, 2024	Continual Learning	—Unverified	0
Continual learning with task specialist	Sep 26, 2024	class-incremental learningClass Incremental Learning	—Unverified	0
Building Real-time Awareness of Out-of-distribution in Trajectory Prediction for Autonomous Vehicles	Sep 25, 2024	Autonomous VehiclesChange Point Detection	—Unverified	0
Neural Network Plasticity and Loss Sharpness	Sep 25, 2024	Continual Learning	—Unverified	0
Patch-Based Contrastive Learning and Memory Consolidation for Online Unsupervised Continual Learning	Sep 24, 2024	Continual LearningContrastive Learning	CodeCode Available	0
Tiny Robotics Dataset and Benchmark for Continual Object Detection	Sep 24, 2024	Autonomous NavigationContinual Learning	CodeCode Available	0
CON: Continual Object Navigation via Data-Free Inter-Agent Knowledge Transfer in Unseen and Unfamiliar Places	Sep 23, 2024	Continual LearningTransfer Learning	—Unverified	0
Towards Accountable AI-Assisted Eye Disease Diagnosis: Workflow Design, External Validation, and Continual Learning	Sep 23, 2024	Continual LearningDiagnostic	—Unverified	0
Brain Surgery: Ensuring GDPR Compliance in Large Language Models via Concept Erasure	Sep 22, 2024	Continual LearningEthics	—Unverified	0
From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks	Sep 22, 2024	Continual LearningTransfer Learning	—Unverified	0
Towards LifeSpan Cognitive Systems	Sep 20, 2024	Continual Learning	—Unverified	0
Continual Learning for Multimodal Data Fusion of a Soft Gripper	Sep 20, 2024	Continual LearningIncremental Learning	—Unverified	0
Persistent Backdoor Attacks in Continual Learning	Sep 20, 2024	Continual Learning	—Unverified	0
A preliminary study on continual learning in computer vision using Kolmogorov-Arnold Networks	Sep 20, 2024	class-incremental learningClass Incremental Learning	CodeCode Available	1
ReFu: Recursive Fusion for Exemplar-Free 3D Class-Incremental Learning	Sep 18, 2024	class-incremental learningClass Incremental Learning	—Unverified	0
Reducing Catastrophic Forgetting in Online Class Incremental Learning Using Self-Distillation	Sep 17, 2024	class-incremental learningClass Incremental Learning	—Unverified	0
Continual Learning of Conjugated Visual Representations through Higher-order Motion Flows	Sep 16, 2024	Continual LearningOptical Flow Estimation	—Unverified	0
An Ultra-Low Power Wearable BMI System with Continual Learning Capabilities	Sep 16, 2024	Continual LearningEEG	CodeCode Available	0
MOST: MR reconstruction Optimization for multiple downStream Tasks via continual learning	Sep 16, 2024	Continual Learning	CodeCode Available	0
Train-On-Request: An On-Device Continual Learning Workflow for Adaptive Real-World Brain Machine Interfaces	Sep 13, 2024	Continual LearningEEG	CodeCode Available	0
Anytime Continual Learning for Open Vocabulary Classification	Sep 13, 2024	ClassificationContinual Learning	CodeCode Available	1
Continual Learning in 3D Point Clouds: Employing Spectral Techniques for Exemplar Selection	Sep 12, 2024	3D Object ClassificationClustering	—Unverified	0
Dark Experience for Incremental Keyword Spotting	Sep 12, 2024	Continual LearningKeyword Spotting	—Unverified	0
FACT: Feature Adaptive Continual-learning Tracker for Multiple Object Tracking	Sep 12, 2024	Continual LearningMultiple Object Tracking	—Unverified	0
Revisiting Static Feature-Based Android Malware Detection	Sep 11, 2024	Android Malware DetectionComputer Security	—Unverified	0
A Contrastive Symmetric Forward-Forward Algorithm (SFFA) for Continual Learning Tasks	Sep 11, 2024	Continual Learningimage-classification	—Unverified	0
Continual Domain Incremental Learning for Privacy-aware Digital Pathology	Sep 10, 2024	Continual LearningIncremental Learning	—Unverified	0
Open-World Dynamic Prompt and Continual Visual Representation Learning	Sep 9, 2024	Continual LearningImage Retrieval	—Unverified	0
Replay Consolidation with Label Propagation for Continual Object Detection	Sep 9, 2024	Autonomous DrivingContinual Learning	—Unverified	0
Interactive incremental learning of generalizable skills with local trajectory modulation	Sep 9, 2024	Continual LearningImitation Learning	CodeCode Available	0
CD-NGP: A Fast Scalable Continual Representation for Dynamic Scenes	Sep 8, 2024	3D ReconstructionContinual Learning	—Unverified	0
SCARF: Scalable Continual Learning Framework for Memory-efficient Multiple Neural Radiance Fields	Sep 6, 2024	Continual LearningKnowledge Distillation	—Unverified	0

Show:10 25 50

← PrevPage 10 of 53Next →

All datasets ASC (19 tasks)visual domain decathlon (10 tasks)Cifar100 (20 tasks)Tiny-ImageNet (10tasks)F-CelebA (10 tasks)20Newsgroup (10 tasks)CUBS (Fine-grained 6 Tasks)DSC (10 tasks)Flowers (Fine-grained 6 Tasks)ImageNet (Fine-grained 6 Tasks)Sketch (Fine-grained 6 Tasks)Stanford Cars (Fine-grained 6 Tasks)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Multi-task Learning (MTL; Upper Bound)	F1 - macro	0.88	—	Unverified
2	CTR	F1 - macro	0.84	—	Unverified
3	B-CL	F1 - macro	0.81	—	Unverified
4	LAMOL	F1 - macro	0.81	—	Unverified
5	OWM	F1 - macro	0.79	—	Unverified
6	A-GEM	F1 - macro	0.78	—	Unverified
7	HAT	F1 - macro	0.78	—	Unverified
8	Independent Learning (ONE)	F1 - macro	0.78	—	Unverified
9	KAN	F1 - macro	0.77	—	Unverified
10	Naive Continual Learning (NCL)	F1 - macro	0.77	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	NetTailor	decathlon discipline (Score)	3,744	—	Unverified
2	Depthwise Soft Sharing	decathlon discipline (Score)	3,507	—	Unverified
3	Parallel Res. adapt.	decathlon discipline (Score)	3,412	—	Unverified
4	Depthwise Sharing	decathlon discipline (Score)	3,234	—	Unverified
5	Series Res. adapt.	decathlon discipline (Score)	3,159	—	Unverified
6	Res. adapt. (large)	decathlon discipline (Score)	3,131	—	Unverified
7	DAN	decathlon discipline (Score)	2,851	—	Unverified
8	Piggyback	decathlon discipline (Score)	2,838	—	Unverified
9	Res. adapt. finetune all	decathlon discipline (Score)	2,643	—	Unverified
10	Res. adapt. decay	decathlon discipline (Score)	2,621	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Model Zoo-Continual	Average Accuracy	94.99	—	Unverified
2	ALTA	Average Accuracy	92.98	—	Unverified
3	kNN-CLIP	Average Accuracy	90.8	—	Unverified
4	RMN	Average Accuracy	81	—	Unverified
5	CPG	Average Accuracy	80.9	—	Unverified
6	CondConvContinual	Average Accuracy	77.4	—	Unverified
7	PAENet	Average Accuracy	77.1	—	Unverified
8	CPG-light	Average Accuracy	77	—	Unverified
9	PackNet	Average Accuracy	67.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ALTA-ViTB/16	Average Accuracy	89.8	—	Unverified
2	ALTA-RN50x4	Average Accuracy	84.73	—	Unverified
3	ALTA-RN101	Average Accuracy	83.35	—	Unverified
4	ALTA-RN50	Average Accuracy	81.07	—	Unverified
5	SNCL	Average Accuracy	52.85	—	Unverified
6	DER [buzzega2020dark]	Average Accuracy	51.78	—	Unverified
7	ER[riemer2018learning]	Average Accuracy	48.64	—	Unverified
8	iCaRL [rebuffi2017icarl]	Average Accuracy	31.55	—	Unverified
9	A-GEM [chaudhry2018efficient]	Average Accuracy	25.33	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CAT (CNN backbone)	Acc	0.76	—	Unverified
2	CAT (MLP backbone)	Acc	0.69	—	Unverified
3	EWC	Acc	0.65	—	Unverified
4	HyperNet	Acc	0.6	—	Unverified
5	PathNet	Acc	0.58	—	Unverified
6	HAT	Acc	0.57	—	Unverified
7	RPSNet	Acc	0.55	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CTR	F1 - macro	0.95	—	Unverified
2	HAT	F1 - macro	0.95	—	Unverified
3	CAT	F1 - macro	0.95	—	Unverified
4	B-CL	F1 - macro	0.95	—	Unverified
5	EWC	F1 - macro	0.92	—	Unverified
6	LAMOL	F1 - macro	0.46	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	84.26	—	Unverified
2	H$^{2}$	Accuracy	84.1	—	Unverified
3	CPG	Accuracy	83.59	—	Unverified
4	Piggyback	Accuracy	80.5	—	Unverified
5	PackNet	Accuracy	80.41	—	Unverified
6	ProgressiveNet	Accuracy	78.94	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CTR	F1 - macro	0.89	—	Unverified
2	CAT	F1 - macro	0.87	—	Unverified
3	HAT	F1 - macro	0.86	—	Unverified
4	KAN	F1 - macro	0.81	—	Unverified
5	B-CL	F1 - macro	0.77	—	Unverified
6	EWC	F1 - macro	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	97.16	—	Unverified
2	CPG	Accuracy	96.62	—	Unverified
3	H$^{2}$	Accuracy	94.9	—	Unverified
4	Piggyback	Accuracy	94.77	—	Unverified
5	ProgressiveNet	Accuracy	93.41	—	Unverified
6	PackNet	Accuracy	93.04	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Piggyback	Accuracy	76.16	—	Unverified
2	ProgressiveNet	Accuracy	76.16	—	Unverified
3	CondConvContinual	Accuracy	76.16	—	Unverified
4	CPG	Accuracy	75.81	—	Unverified
5	PackNet	Accuracy	75.71	—	Unverified
6	H$^{2}$	Accuracy	75.71	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	80.77	—	Unverified
2	CPG	Accuracy	80.33	—	Unverified
3	Piggyback	Accuracy	79.91	—	Unverified
4	ProgressiveNet	Accuracy	76.35	—	Unverified
5	H$^{2}$	Accuracy	76.2	—	Unverified
6	PackNet	Accuracy	76.17	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CPG	Accuracy	92.8	—	Unverified
2	CondConvContinual	Accuracy	92.61	—	Unverified
3	H$^{2}$	Accuracy	90.6	—	Unverified
4	Piggyback	Accuracy	89.62	—	Unverified
5	ProgressiveNet	Accuracy	89.21	—	Unverified
6	PackNet	Accuracy	86.11	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CondConvContinual	Accuracy	78.32	—	Unverified
2	CPG	Accuracy	77.15	—	Unverified
3	H$^{2}$	Accuracy	75.1	—	Unverified
4	ProgressiveNet	Accuracy	74.94	—	Unverified
5	Piggyback	Accuracy	71.33	—	Unverified
6	PackNet	Accuracy	69.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ALTA-ViTB/16	Average Accuracy	92.85	—	Unverified
2	ALTA-RN50x4	Average Accuracy	84.91	—	Unverified
3	RMN (Resnet)	Average Accuracy	84.9	—	Unverified
4	ALTA-RN101	Average Accuracy	84.77	—	Unverified
5	ALTA-RN50	Average Accuracy	83.87	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RMN	Accuracy	68.1	—	Unverified
2	CondConvContinual	Accuracy	61.32	—	Unverified
3	CCGN	Accuracy	35.24	—	Unverified
4	DGMw	Accuracy	17.82	—	Unverified
5	DGMa	Accuracy	15.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	RMN	Average Accuracy	97.99	—	Unverified
2	Model Zoo-Continual	Average Accuracy	97.71	—	Unverified
3	CODE-CL	Average Accuracy	96.56	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Accuracy	62.59	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CODE-CL	Average Accuracy	93.32	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TEST	1:3 Accuracy	2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Average Accuracy	62.79	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	82.69	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	88.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Model Zoo-Continual	Average Accuracy	84.27	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Accuracy	61.58	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CODE-CL	Average Accuracy	68.83	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAG-RMSProp	Accuracy	57.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	53.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MRM	Acc	78.4	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Model Zoo-Continual	Average Accuracy	99.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CODE-CL	Average Accuracy	77.21	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	H$^{2}$	Top 1 Accuracy %	97.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	H$^{2}$	Top 1 Accuracy %	99.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IBM	Accuracy	52.38	—	Unverified