SOTAVerified

Continual Learning

Continual Learning (also known as Incremental Learning, Life-long Learning) is a concept to learn a model for a large number of tasks sequentially without forgetting knowledge obtained from the preceding tasks, where the data in the old tasks are not available anymore during training new ones.
If not mentioned, the benchmarks here are Task-CL, where task-id is provided on validation.

Source:
Continual Learning by Asymmetric Loss Approximation with Single-Side Overestimation
Three scenarios for continual learning
Lifelong Machine Learning
Continual lifelong learning with neural networks: A review

Papers

Showing 1051–1100 of 2644 papers

TitleStatusHype
Brain-inspired continual pre-trained learner via silent synaptic consolidation—0
SHIELD: Secure Hypernetworks for Incremental Expansion Learning Defense—0
FedSpeech: Federated Text-to-Speech with Continual Learning—0
FETCH: A Memory-Efficient Replay Approach for Continual Learning in Image Classification—0
Mode-Aware Continual Learning for Conditional Generative Adversarial Networks—0
Continual Learning of Conjugated Visual Representations through Higher-order Motion Flows—0
Brain-Inspired Continual Learning-Robust Feature Distillation and Re-Consolidation for Class Incremental Learning—0
Continual Learning Long Short Term Memory—0
Brain insights improve RNNs' accuracy and robustness for hierarchical control of continually learned autonomous motor motifs—0
Ancestral Mamba: Enhancing Selective Discriminant Space Model with Online Visual Prototype Learning for Efficient and Robust Discriminant Approach—0
An Autonomous Network Orchestration Framework Integrating Large Language Models with Continual Reinforcement Learning—0
Continual Learning in Vision-Language Models via Aligned Model Merging—0
Boosting Open-Domain Continual Learning via Leveraging Intra-domain Category-aware Prototype—0
Continual Learning in the Presence of Repetition—0
Adaptive Rank, Reduced Forgetting: Knowledge Retention in Continual Learning Vision-Language Models with Dynamic Rank-Selective LoRA—0
FedKNOW: Federated Continual Learning with Signature Task Knowledge Integration at Edge—0
FedMeS: Personalized Federated Continual Learning Leveraging Local Memory—0
Continual Learning in the Presence of Spurious Correlation—0
Boosting Large Language Models with Continual Learning for Aspect-based Sentiment Analysis—0
Continual Learning in Sensor-based Human Activity Recognition: an Empirical Benchmark Analysis—0
Boosting-inspired online learning with transfer for railway maintenance—0
A Closer Look at Rehearsal-Free Continual Learning—0
Continual Learning in Predictive Autoscaling—0
Continual Learning in Practice—0
Adaptive Plasticity Improvement for Continual Learning—0
Federated Self-Supervised Learning for Acoustic Event Classification—0
FedRewind: Rewinding Continual Model Exchange for Decentralized Federated Learning—0
Bookworm continual learning: beyond zero-shot learning and continual learning—0
Continual Learning in Multilingual NMT via Language-Specific Embeddings—0
An Analysis under a Unified Fomulation of Learning Algorithms with Output Constraints—0
Continual Learning in Medical Image Analysis: A Comprehensive Review of Recent Advancements and Future Prospects—0
Adaptive Memory Replay for Continual Learning—0
Continual Learning in Machine Speech Chain Using Gradient Episodic Memory—0
Continual Learning in Linear Classification on Separable Data—0
Continual Learning in Human Activity Recognition: an Empirical Analysis of Regularization—0
BNS: Building Network Structures Dynamically for Continual Learning—0
Analyzing Mitigation Strategies for Catastrophic Forgetting in End-to-End Training of Spoken Language Models—0
Federated Intrusion Detection for IoT with Heterogeneous Cohort Privacy—0
Continual Learning in Generative Adversarial Nets—0
Block Contextual MDPs for Continual Learning—0
ACIL: Analytic Class-Incremental Learning with Absolute Memorization and Privacy Protection—0
A neural net architecture based on principles of neural plasticity and development evolves to effectively catch prey in a simulated environment—0
Continual Learning in Deep Neural Network by Using a Kalman Optimiser—0
Adaptive Masked Weight Imprinting for Few-Shot Segmentation—0
The Latent Space Hypothesis: Toward Universal Medical Representation Learning—0
Continual Learning in Deep Networks: an Analysis of the Last Layer—0
Continual learning in cross-modal retrieval—0
Continual Learning with Hebbian Plasticity in Sparse and Predictive Coding Networks: A Survey and Perspective—0
Continual Learning in 3D Point Clouds: Employing Spectral Techniques for Exemplar Selection—0
BIRD: Behavior Induction via Representation-structure Distillation—0
Show:102550
← PrevPage 22 of 53Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Multi-task Learning (MTL; Upper Bound)F1 - macro0.88—Unverified
2CTRF1 - macro0.84—Unverified
3B-CLF1 - macro0.81—Unverified
4LAMOLF1 - macro0.81—Unverified
5OWMF1 - macro0.79—Unverified
6A-GEMF1 - macro0.78—Unverified
7HATF1 - macro0.78—Unverified
8Independent Learning (ONE)F1 - macro0.78—Unverified
9KANF1 - macro0.77—Unverified
10Naive Continual Learning (NCL)F1 - macro0.77—Unverified
#ModelMetricClaimedVerifiedStatus
1NetTailordecathlon discipline (Score)3,744—Unverified
2Depthwise Soft Sharingdecathlon discipline (Score)3,507—Unverified
3Parallel Res. adapt.decathlon discipline (Score)3,412—Unverified
4Depthwise Sharingdecathlon discipline (Score)3,234—Unverified
5Series Res. adapt.decathlon discipline (Score)3,159—Unverified
6Res. adapt. (large)decathlon discipline (Score)3,131—Unverified
7DANdecathlon discipline (Score)2,851—Unverified
8Piggybackdecathlon discipline (Score)2,838—Unverified
9Res. adapt. finetune alldecathlon discipline (Score)2,643—Unverified
10Res. adapt. decaydecathlon discipline (Score)2,621—Unverified
#ModelMetricClaimedVerifiedStatus
1Model Zoo-ContinualAverage Accuracy94.99—Unverified
2ALTAAverage Accuracy92.98—Unverified
3kNN-CLIPAverage Accuracy90.8—Unverified
4RMNAverage Accuracy81—Unverified
5CPGAverage Accuracy80.9—Unverified
6CondConvContinualAverage Accuracy77.4—Unverified
7PAENetAverage Accuracy77.1—Unverified
8CPG-lightAverage Accuracy77—Unverified
9PackNetAverage Accuracy67.5—Unverified
#ModelMetricClaimedVerifiedStatus
1ALTA-ViTB/16Average Accuracy89.8—Unverified
2ALTA-RN50x4Average Accuracy84.73—Unverified
3ALTA-RN101Average Accuracy83.35—Unverified
4ALTA-RN50Average Accuracy81.07—Unverified
5SNCLAverage Accuracy52.85—Unverified
6DER [buzzega2020dark]Average Accuracy51.78—Unverified
7ER[riemer2018learning]Average Accuracy48.64—Unverified
8iCaRL [rebuffi2017icarl]Average Accuracy31.55—Unverified
9A-GEM [chaudhry2018efficient]Average Accuracy25.33—Unverified
#ModelMetricClaimedVerifiedStatus
1CAT (CNN backbone)Acc0.76—Unverified
2CAT (MLP backbone)Acc0.69—Unverified
3EWCAcc0.65—Unverified
4HyperNetAcc0.6—Unverified
5PathNetAcc0.58—Unverified
6HATAcc0.57—Unverified
7RPSNetAcc0.55—Unverified
#ModelMetricClaimedVerifiedStatus
1CTRF1 - macro0.95—Unverified
2HATF1 - macro0.95—Unverified
3CATF1 - macro0.95—Unverified
4B-CLF1 - macro0.95—Unverified
5EWCF1 - macro0.92—Unverified
6LAMOLF1 - macro0.46—Unverified
#ModelMetricClaimedVerifiedStatus
1CondConvContinualAccuracy84.26—Unverified
2H$^{2}$Accuracy84.1—Unverified
3CPGAccuracy83.59—Unverified
4PiggybackAccuracy80.5—Unverified
5PackNetAccuracy80.41—Unverified
6ProgressiveNetAccuracy78.94—Unverified
#ModelMetricClaimedVerifiedStatus
1CTRF1 - macro0.89—Unverified
2CATF1 - macro0.87—Unverified
3HATF1 - macro0.86—Unverified
4KANF1 - macro0.81—Unverified
5B-CLF1 - macro0.77—Unverified
6EWCF1 - macro0.66—Unverified
#ModelMetricClaimedVerifiedStatus
1CondConvContinualAccuracy97.16—Unverified
2CPGAccuracy96.62—Unverified
3H$^{2}$Accuracy94.9—Unverified
4PiggybackAccuracy94.77—Unverified
5ProgressiveNetAccuracy93.41—Unverified
6PackNetAccuracy93.04—Unverified
#ModelMetricClaimedVerifiedStatus
1PiggybackAccuracy76.16—Unverified
2ProgressiveNetAccuracy76.16—Unverified
3CondConvContinualAccuracy76.16—Unverified
4CPGAccuracy75.81—Unverified
5PackNetAccuracy75.71—Unverified
6H$^{2}$Accuracy75.71—Unverified
#ModelMetricClaimedVerifiedStatus
1CondConvContinualAccuracy80.77—Unverified
2CPGAccuracy80.33—Unverified
3PiggybackAccuracy79.91—Unverified
4ProgressiveNetAccuracy76.35—Unverified
5H$^{2}$Accuracy76.2—Unverified
6PackNetAccuracy76.17—Unverified
#ModelMetricClaimedVerifiedStatus
1CPGAccuracy92.8—Unverified
2CondConvContinualAccuracy92.61—Unverified
3H$^{2}$Accuracy90.6—Unverified
4PiggybackAccuracy89.62—Unverified
5ProgressiveNetAccuracy89.21—Unverified
6PackNetAccuracy86.11—Unverified
#ModelMetricClaimedVerifiedStatus
1CondConvContinualAccuracy78.32—Unverified
2CPGAccuracy77.15—Unverified
3H$^{2}$Accuracy75.1—Unverified
4ProgressiveNetAccuracy74.94—Unverified
5PiggybackAccuracy71.33—Unverified
6PackNetAccuracy69.4—Unverified
#ModelMetricClaimedVerifiedStatus
1ALTA-ViTB/16Average Accuracy92.85—Unverified
2ALTA-RN50x4Average Accuracy84.91—Unverified
3RMN (Resnet)Average Accuracy84.9—Unverified
4ALTA-RN101Average Accuracy84.77—Unverified
5ALTA-RN50Average Accuracy83.87—Unverified
#ModelMetricClaimedVerifiedStatus
1RMNAccuracy68.1—Unverified
2CondConvContinualAccuracy61.32—Unverified
3CCGNAccuracy35.24—Unverified
4DGMwAccuracy17.82—Unverified
5DGMaAccuracy15.16—Unverified
#ModelMetricClaimedVerifiedStatus
1RMNAverage Accuracy97.99—Unverified
2Model Zoo-ContinualAverage Accuracy97.71—Unverified
3CODE-CLAverage Accuracy96.56—Unverified
#ModelMetricClaimedVerifiedStatus
1TAG-RMSPropAccuracy62.59—Unverified
#ModelMetricClaimedVerifiedStatus
1CODE-CLAverage Accuracy93.32—Unverified
#ModelMetricClaimedVerifiedStatus
1TEST1:3 Accuracy2—Unverified
#ModelMetricClaimedVerifiedStatus
1TAG-RMSPropAverage Accuracy62.79—Unverified
#ModelMetricClaimedVerifiedStatus
1IBMAccuracy82.69—Unverified
#ModelMetricClaimedVerifiedStatus
1IBMAccuracy88.15—Unverified
#ModelMetricClaimedVerifiedStatus
1Model Zoo-ContinualAverage Accuracy84.27—Unverified
#ModelMetricClaimedVerifiedStatus
1TAG-RMSPropAccuracy61.58—Unverified
#ModelMetricClaimedVerifiedStatus
1CODE-CLAverage Accuracy68.83—Unverified
#ModelMetricClaimedVerifiedStatus
1TAG-RMSPropAccuracy57.2—Unverified
#ModelMetricClaimedVerifiedStatus
1IBMAccuracy53.9—Unverified
#ModelMetricClaimedVerifiedStatus
1MRMAcc78.4—Unverified
#ModelMetricClaimedVerifiedStatus
1Model Zoo-ContinualAverage Accuracy99.66—Unverified
#ModelMetricClaimedVerifiedStatus
1CODE-CLAverage Accuracy77.21—Unverified
#ModelMetricClaimedVerifiedStatus
1H$^{2}$Top 1 Accuracy %97.3—Unverified
#ModelMetricClaimedVerifiedStatus
1H$^{2}$Top 1 Accuracy %99.9—Unverified
#ModelMetricClaimedVerifiedStatus
1IBMAccuracy52.38—Unverified