SOTAVerified

Continual Learning

Continual Learning (also known as Incremental Learning, Life-long Learning) is a concept to learn a model for a large number of tasks sequentially without forgetting knowledge obtained from the preceding tasks, where the data in the old tasks are not available anymore during training new ones.
If not mentioned, the benchmarks here are Task-CL, where task-id is provided on validation.

Source:
Continual Learning by Asymmetric Loss Approximation with Single-Side Overestimation
Three scenarios for continual learning
Lifelong Machine Learning
Continual lifelong learning with neural networks: A review

Papers

Showing 351–400 of 2644 papers

TitleStatusHype
A Comprehensive Survey of Continual Learning: Theory, Method and ApplicationCode1
Continual Learning on Dynamic Graphs via Parameter IsolationCode1
Continual Learning with Scaled Gradient ProjectionCode1
Adapter Learning in Pretrained Feature Extractor for Continual Learning of DiseasesCode1
Dropout as an Implicit Gating Mechanism For Continual LearningCode1
Label-Efficient Online Continual Object Detection in Streaming VideoCode1
La-MAML: Look-ahead Meta Learning for Continual LearningCode1
Do Your Best and Get Enough Rest for Continual LearningCode1
Do Pre-trained Models Benefit Equally in Continual Learning?Code1
Can LLMs Alleviate Catastrophic Forgetting in Graph Continual Learning? A Systematic StudyCode1
Continual Learning Using a Kernel-Based Method Over Foundation ModelsCode1
Carousel Memory: Rethinking the Design of Episodic Memory for Continual LearningCode1
Carpe Diem: On the Evaluation of World Knowledge in Lifelong Language ModelsCode1
Latent Replay for Real-Time Continual LearningCode1
Learn From Others and Be Yourself in Heterogeneous Federated LearningCode1
Catastrophic Forgetting in Deep Graph Networks: an Introductory Benchmark for Graph ClassificationCode1
Do You Remember? Overcoming Catastrophic Forgetting for Fake Audio DetectionCode1
Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic EnvironmentsCode1
CaT: Balanced Continual Graph Learning with Graph CondensationCode1
CBA: Improving Online Continual Learning via Continual Bias AdaptorCode1
CCL: Continual Contrastive Learning for LiDAR Place RecognitionCode1
C-COMA: A CONTINUAL REINFORCEMENT LEARNING MODEL FOR DYNAMIC MULTIAGENT ENVIRONMENTSCode1
Adapt Your Teacher: Improving Knowledge Distillation for Exemplar-free Continual LearningCode1
Learning Successor Features the Simple WayCode1
Class-Incremental Learning with Generative ClassifiersCode1
CLIP model is an Efficient Continual LearnerCode1
Continual Learning with Echo State NetworksCode1
Learning to Continuously Optimize Wireless Resource in a Dynamic Environment: A Bilevel Optimization PerspectiveCode1
Drinking from a Firehose: Continual Learning with Web-scale Natural LanguageCode1
CF-KAN: Kolmogorov-Arnold Network-based Collaborative Filtering to Mitigate Catastrophic Forgetting in Recommender SystemsCode1
A preliminary study on continual learning in computer vision using Kolmogorov-Arnold NetworksCode1
Continual Learning with Gated Incremental Memories for sequential data processingCode1
Dynosaur: A Dynamic Growth Paradigm for Instruction-Tuning Data CurationCode1
Chameleon: A MatMul-Free Temporal Convolutional Network Accelerator for End-to-End Few-Shot and Continual Learning from Sequential DataCode1
Fine-tuned Language Models are Continual LearnersCode1
On Tiny Episodic Memories in Continual LearningCode1
Continual Multimodal Knowledge Graph ConstructionCode1
Continual Model-Based Reinforcement Learning with HypernetworksCode1
Continual Named Entity Recognition without Catastrophic ForgettingCode1
Lifelong Machine Learning of Functionally Compositional StructuresCode1
Avalanche RL: a Continual Reinforcement Learning LibraryCode1
CLAD: A realistic Continual Learning benchmark for Autonomous DrivingCode1
CLAP4CLIP: Continual Learning with Probabilistic Finetuning for Vision-Language ModelsCode1
ARCADe: A Rapid Continual Anomaly DetectorCode1
A Continual Deepfake Detection Benchmark: Dataset, Methods, and EssentialsCode1
Look-ahead Meta Learning for Continual LearningCode1
Class-Incremental Grouping Network for Continual Audio-Visual LearningCode1
Continual Object Detection via Prototypical Task Correlation Guided Gating MechanismCode1
Distilled Replay: Overcoming Forgetting through Synthetic SamplesCode1
Avalanche: an End-to-End Library for Continual LearningCode1
Show:102550
← PrevPage 8 of 53Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Multi-task Learning (MTL; Upper Bound)F1 - macro0.88—Unverified
2CTRF1 - macro0.84—Unverified
3B-CLF1 - macro0.81—Unverified
4LAMOLF1 - macro0.81—Unverified
5OWMF1 - macro0.79—Unverified
6A-GEMF1 - macro0.78—Unverified
7HATF1 - macro0.78—Unverified
8Independent Learning (ONE)F1 - macro0.78—Unverified
9KANF1 - macro0.77—Unverified
10Naive Continual Learning (NCL)F1 - macro0.77—Unverified
#ModelMetricClaimedVerifiedStatus
1NetTailordecathlon discipline (Score)3,744—Unverified
2Depthwise Soft Sharingdecathlon discipline (Score)3,507—Unverified
3Parallel Res. adapt.decathlon discipline (Score)3,412—Unverified
4Depthwise Sharingdecathlon discipline (Score)3,234—Unverified
5Series Res. adapt.decathlon discipline (Score)3,159—Unverified
6Res. adapt. (large)decathlon discipline (Score)3,131—Unverified
7DANdecathlon discipline (Score)2,851—Unverified
8Piggybackdecathlon discipline (Score)2,838—Unverified
9Res. adapt. finetune alldecathlon discipline (Score)2,643—Unverified
10Res. adapt. decaydecathlon discipline (Score)2,621—Unverified
#ModelMetricClaimedVerifiedStatus
1Model Zoo-ContinualAverage Accuracy94.99—Unverified
2ALTAAverage Accuracy92.98—Unverified
3kNN-CLIPAverage Accuracy90.8—Unverified
4RMNAverage Accuracy81—Unverified
5CPGAverage Accuracy80.9—Unverified
6CondConvContinualAverage Accuracy77.4—Unverified
7PAENetAverage Accuracy77.1—Unverified
8CPG-lightAverage Accuracy77—Unverified
9PackNetAverage Accuracy67.5—Unverified
#ModelMetricClaimedVerifiedStatus
1ALTA-ViTB/16Average Accuracy89.8—Unverified
2ALTA-RN50x4Average Accuracy84.73—Unverified
3ALTA-RN101Average Accuracy83.35—Unverified
4ALTA-RN50Average Accuracy81.07—Unverified
5SNCLAverage Accuracy52.85—Unverified
6DER [buzzega2020dark]Average Accuracy51.78—Unverified
7ER[riemer2018learning]Average Accuracy48.64—Unverified
8iCaRL [rebuffi2017icarl]Average Accuracy31.55—Unverified
9A-GEM [chaudhry2018efficient]Average Accuracy25.33—Unverified
#ModelMetricClaimedVerifiedStatus
1CAT (CNN backbone)Acc0.76—Unverified
2CAT (MLP backbone)Acc0.69—Unverified
3EWCAcc0.65—Unverified
4HyperNetAcc0.6—Unverified
5PathNetAcc0.58—Unverified
6HATAcc0.57—Unverified
7RPSNetAcc0.55—Unverified
#ModelMetricClaimedVerifiedStatus
1CTRF1 - macro0.95—Unverified
2HATF1 - macro0.95—Unverified
3CATF1 - macro0.95—Unverified
4B-CLF1 - macro0.95—Unverified
5EWCF1 - macro0.92—Unverified
6LAMOLF1 - macro0.46—Unverified
#ModelMetricClaimedVerifiedStatus
1CondConvContinualAccuracy84.26—Unverified
2H$^{2}$Accuracy84.1—Unverified
3CPGAccuracy83.59—Unverified
4PiggybackAccuracy80.5—Unverified
5PackNetAccuracy80.41—Unverified
6ProgressiveNetAccuracy78.94—Unverified
#ModelMetricClaimedVerifiedStatus
1CTRF1 - macro0.89—Unverified
2CATF1 - macro0.87—Unverified
3HATF1 - macro0.86—Unverified
4KANF1 - macro0.81—Unverified
5B-CLF1 - macro0.77—Unverified
6EWCF1 - macro0.66—Unverified
#ModelMetricClaimedVerifiedStatus
1CondConvContinualAccuracy97.16—Unverified
2CPGAccuracy96.62—Unverified
3H$^{2}$Accuracy94.9—Unverified
4PiggybackAccuracy94.77—Unverified
5ProgressiveNetAccuracy93.41—Unverified
6PackNetAccuracy93.04—Unverified
#ModelMetricClaimedVerifiedStatus
1ProgressiveNetAccuracy76.16—Unverified
2PiggybackAccuracy76.16—Unverified
3CondConvContinualAccuracy76.16—Unverified
4CPGAccuracy75.81—Unverified
5H$^{2}$Accuracy75.71—Unverified
6PackNetAccuracy75.71—Unverified
#ModelMetricClaimedVerifiedStatus
1CondConvContinualAccuracy80.77—Unverified
2CPGAccuracy80.33—Unverified
3PiggybackAccuracy79.91—Unverified
4ProgressiveNetAccuracy76.35—Unverified
5H$^{2}$Accuracy76.2—Unverified
6PackNetAccuracy76.17—Unverified
#ModelMetricClaimedVerifiedStatus
1CPGAccuracy92.8—Unverified
2CondConvContinualAccuracy92.61—Unverified
3H$^{2}$Accuracy90.6—Unverified
4PiggybackAccuracy89.62—Unverified
5ProgressiveNetAccuracy89.21—Unverified
6PackNetAccuracy86.11—Unverified
#ModelMetricClaimedVerifiedStatus
1CondConvContinualAccuracy78.32—Unverified
2CPGAccuracy77.15—Unverified
3H$^{2}$Accuracy75.1—Unverified
4ProgressiveNetAccuracy74.94—Unverified
5PiggybackAccuracy71.33—Unverified
6PackNetAccuracy69.4—Unverified
#ModelMetricClaimedVerifiedStatus
1ALTA-ViTB/16Average Accuracy92.85—Unverified
2ALTA-RN50x4Average Accuracy84.91—Unverified
3RMN (Resnet)Average Accuracy84.9—Unverified
4ALTA-RN101Average Accuracy84.77—Unverified
5ALTA-RN50Average Accuracy83.87—Unverified
#ModelMetricClaimedVerifiedStatus
1RMNAccuracy68.1—Unverified
2CondConvContinualAccuracy61.32—Unverified
3CCGNAccuracy35.24—Unverified
4DGMwAccuracy17.82—Unverified
5DGMaAccuracy15.16—Unverified
#ModelMetricClaimedVerifiedStatus
1RMNAverage Accuracy97.99—Unverified
2Model Zoo-ContinualAverage Accuracy97.71—Unverified
3CODE-CLAverage Accuracy96.56—Unverified
#ModelMetricClaimedVerifiedStatus
1TAG-RMSPropAccuracy62.59—Unverified
#ModelMetricClaimedVerifiedStatus
1CODE-CLAverage Accuracy93.32—Unverified
#ModelMetricClaimedVerifiedStatus
1TEST1:3 Accuracy2—Unverified
#ModelMetricClaimedVerifiedStatus
1TAG-RMSPropAverage Accuracy62.79—Unverified
#ModelMetricClaimedVerifiedStatus
1IBMAccuracy82.69—Unverified
#ModelMetricClaimedVerifiedStatus
1IBMAccuracy88.15—Unverified
#ModelMetricClaimedVerifiedStatus
1Model Zoo-ContinualAverage Accuracy84.27—Unverified
#ModelMetricClaimedVerifiedStatus
1TAG-RMSPropAccuracy61.58—Unverified
#ModelMetricClaimedVerifiedStatus
1CODE-CLAverage Accuracy68.83—Unverified
#ModelMetricClaimedVerifiedStatus
1TAG-RMSPropAccuracy57.2—Unverified
#ModelMetricClaimedVerifiedStatus
1IBMAccuracy53.9—Unverified
#ModelMetricClaimedVerifiedStatus
1MRMAcc78.4—Unverified
#ModelMetricClaimedVerifiedStatus
1Model Zoo-ContinualAverage Accuracy99.66—Unverified
#ModelMetricClaimedVerifiedStatus
1CODE-CLAverage Accuracy77.21—Unverified
#ModelMetricClaimedVerifiedStatus
1H$^{2}$Top 1 Accuracy %97.3—Unverified
#ModelMetricClaimedVerifiedStatus
1H$^{2}$Top 1 Accuracy %99.9—Unverified
#ModelMetricClaimedVerifiedStatus
1IBMAccuracy52.38—Unverified