SOTAVerified

Continual Learning

Continual Learning (also known as Incremental Learning, Life-long Learning) is a concept to learn a model for a large number of tasks sequentially without forgetting knowledge obtained from the preceding tasks, where the data in the old tasks are not available anymore during training new ones.
If not mentioned, the benchmarks here are Task-CL, where task-id is provided on validation.

Source:
Continual Learning by Asymmetric Loss Approximation with Single-Side Overestimation
Three scenarios for continual learning
Lifelong Machine Learning
Continual lifelong learning with neural networks: A review

Papers

Showing 601650 of 2644 papers

TitleStatusHype
MAC-Gaze: Motion-Aware Continual Calibration for Mobile Gaze Tracking0
IRS: Incremental Relationship-guided Segmentation for Digital PathologyCode0
Train with Perturbation, Infer after Merging: A Two-Stage Framework for Continual Learning0
SplitLoRA: Balancing Stability and Plasticity in Continual Learning Through Gradient Space Splitting0
Measuring Representational Shifts in Continual Learning: A Linear Transformation Perspective0
Cut out and Replay: A Simple yet Versatile Strategy for Multi-Label Online Continual LearningCode0
MM-Prompt: Cross-Modal Prompt Tuning for Continual Visual Question AnsweringCode0
Beyond Freezing: Sparse Tuning Enhances Plasticity in Continual Learning with Pre-Trained ModelsCode0
Data-Distill-Net: A Data Distillation Approach Tailored for Reply-based Continual Learning0
Knowledge Grafting of Large Language ModelsCode0
Exemplar-Free Continual Learning for State Space Models0
Learning without Isolation: Pathway Protection for Continual LearningCode0
Analyzing Mitigation Strategies for Catastrophic Forgetting in End-to-End Training of Spoken Language Models0
A Unified Gradient-based Framework for Task-agnostic Continual Learning-Unlearning0
Bayesian Ensembling: Insights from Online Optimization and Empirical BayesCode0
Contrastive Consolidation of Top-Down Modulations Achieves Sparsely Supervised Continual Learning0
Listen, Analyze, and Adapt to Learn New Attacks: An Exemplar-Free Class Incremental Learning Method for Audio Deepfake Source Tracing0
ACU: Analytic Continual Unlearning for Efficient and Exact Forgetting with Privacy Preservation0
Scalable Strategies for Continual Learning with Replay0
AFCL: Analytic Federated Continual Learning for Spatio-Temporal Invariance of Non-IID Data0
MINGLE: Mixtures of Null-Space Gated Low-Rank Experts for Test-Time Continual Model Merging0
CL-CaGAN: Capsule differential adversarial continuous learning for cross-domain hyperspectral anomaly detection0
CL-BioGAN: Biologically-Inspired Cross-Domain Continual Learning for Hyperspectral Anomaly Detection0
Continuous Subspace Optimization for Continual Learning0
Parameter Efficient Continual Learning with Dynamic Low-Rank Adaptation0
AnalyticKWS: Towards Exemplar-Free Analytic Class Incremental Learning for Small-footprint Keyword Spotting0
Multi-Modal Multi-Task (M3T) Federated Foundation Models for Embodied AI: Potentials and Challenges for Edge Integration0
Task-Core Memory Management and Consolidation for Long-term Continual Learning0
Incorporating brain-inspired mechanisms for multimodal learning in artificial intelligenceCode0
Reinforced Interactive Continual Learning via Real-time Noisy Human Feedback0
A Conformal Predictive Measure for Assessing Catastrophic Forgetting0
Advancing Multiple Instance Learning with Continual Learning for Whole Slide Imaging0
Preserving Plasticity in Continual Learning with Adaptive Linearity Injection0
Attention-based Generative Latent Replay: A Continual Learning Approach for WSI Analysis0
GradMix: Gradient-based Selective Mixup for Robust Data Augmentation in Class-Incremental Learning0
Low-Complexity Inference in Continual Learning via Compressed Knowledge Transfer0
Continual Reinforcement Learning via Autoencoder-Driven Task and New Environment Recognition0
Robust Emotion Recognition via Bi-Level Self-Supervised Continual Learning0
Adaptive, Robust and Scalable Bayesian Filtering for Online Learning0
Beyond CLIP Generalization: Against Forward&Backward Forgetting Adapter for Continual Learning of Vision-Language Models0
Prototype Augmented Hypernetworks for Continual Learning0
Ranking-aware Continual Learning for LiDAR Place Recognition0
Replay-Based Continual Learning with Dual-Layered Distillation and a Streamlined U-Net for Efficient Text-to-Image Generation0
CogniSNN: A First Exploration to Random Graph Architecture based Spiking Neural Networks with Enhanced Expandability and Neuroplasticity0
Neuro-Symbolic Concepts0
Elastic Weight Consolidation for Full-Parameter Continual Pre-Training of Gemma20
Replay to Remember (R2R): An Efficient Uncertainty-driven Unsupervised Continual Learning Framework Using Generative Replay0
Efficient Continual Learning in Keyword Spotting using Binary Neural Networks0
Lifelong Whole Slide Image Analysis: Online Vision-Language Adaptation and Past-to-Present Gradient Distillation0
SacFL: Self-Adaptive Federated Continual Learning for Resource-Constrained End DevicesCode0
Show:102550
← PrevPage 13 of 53Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Multi-task Learning (MTL; Upper Bound)F1 - macro0.88Unverified
2CTRF1 - macro0.84Unverified
3B-CLF1 - macro0.81Unverified
4LAMOLF1 - macro0.81Unverified
5OWMF1 - macro0.79Unverified
6A-GEMF1 - macro0.78Unverified
7HATF1 - macro0.78Unverified
8Independent Learning (ONE)F1 - macro0.78Unverified
9KANF1 - macro0.77Unverified
10Naive Continual Learning (NCL)F1 - macro0.77Unverified
#ModelMetricClaimedVerifiedStatus
1NetTailordecathlon discipline (Score)3,744Unverified
2Depthwise Soft Sharingdecathlon discipline (Score)3,507Unverified
3Parallel Res. adapt.decathlon discipline (Score)3,412Unverified
4Depthwise Sharingdecathlon discipline (Score)3,234Unverified
5Series Res. adapt.decathlon discipline (Score)3,159Unverified
6Res. adapt. (large)decathlon discipline (Score)3,131Unverified
7DANdecathlon discipline (Score)2,851Unverified
8Piggybackdecathlon discipline (Score)2,838Unverified
9Res. adapt. finetune alldecathlon discipline (Score)2,643Unverified
10Res. adapt. decaydecathlon discipline (Score)2,621Unverified
#ModelMetricClaimedVerifiedStatus
1Model Zoo-ContinualAverage Accuracy94.99Unverified
2ALTAAverage Accuracy92.98Unverified
3kNN-CLIPAverage Accuracy90.8Unverified
4RMNAverage Accuracy81Unverified
5CPGAverage Accuracy80.9Unverified
6CondConvContinualAverage Accuracy77.4Unverified
7PAENetAverage Accuracy77.1Unverified
8CPG-lightAverage Accuracy77Unverified
9PackNetAverage Accuracy67.5Unverified
#ModelMetricClaimedVerifiedStatus
1ALTA-ViTB/16Average Accuracy89.8Unverified
2ALTA-RN50x4Average Accuracy84.73Unverified
3ALTA-RN101Average Accuracy83.35Unverified
4ALTA-RN50Average Accuracy81.07Unverified
5SNCLAverage Accuracy52.85Unverified
6DER [buzzega2020dark]Average Accuracy51.78Unverified
7ER[riemer2018learning]Average Accuracy48.64Unverified
8iCaRL [rebuffi2017icarl]Average Accuracy31.55Unverified
9A-GEM [chaudhry2018efficient]Average Accuracy25.33Unverified
#ModelMetricClaimedVerifiedStatus
1CAT (CNN backbone)Acc0.76Unverified
2CAT (MLP backbone)Acc0.69Unverified
3EWCAcc0.65Unverified
4HyperNetAcc0.6Unverified
5PathNetAcc0.58Unverified
6HATAcc0.57Unverified
7RPSNetAcc0.55Unverified
#ModelMetricClaimedVerifiedStatus
1CTRF1 - macro0.95Unverified
2HATF1 - macro0.95Unverified
3CATF1 - macro0.95Unverified
4B-CLF1 - macro0.95Unverified
5EWCF1 - macro0.92Unverified
6LAMOLF1 - macro0.46Unverified
#ModelMetricClaimedVerifiedStatus
1CondConvContinualAccuracy84.26Unverified
2H$^{2}$Accuracy84.1Unverified
3CPGAccuracy83.59Unverified
4PiggybackAccuracy80.5Unverified
5PackNetAccuracy80.41Unverified
6ProgressiveNetAccuracy78.94Unverified
#ModelMetricClaimedVerifiedStatus
1CTRF1 - macro0.89Unverified
2CATF1 - macro0.87Unverified
3HATF1 - macro0.86Unverified
4KANF1 - macro0.81Unverified
5B-CLF1 - macro0.77Unverified
6EWCF1 - macro0.66Unverified
#ModelMetricClaimedVerifiedStatus
1CondConvContinualAccuracy97.16Unverified
2CPGAccuracy96.62Unverified
3H$^{2}$Accuracy94.9Unverified
4PiggybackAccuracy94.77Unverified
5ProgressiveNetAccuracy93.41Unverified
6PackNetAccuracy93.04Unverified
#ModelMetricClaimedVerifiedStatus
1ProgressiveNetAccuracy76.16Unverified
2PiggybackAccuracy76.16Unverified
3CondConvContinualAccuracy76.16Unverified
4CPGAccuracy75.81Unverified
5H$^{2}$Accuracy75.71Unverified
6PackNetAccuracy75.71Unverified
#ModelMetricClaimedVerifiedStatus
1CondConvContinualAccuracy80.77Unverified
2CPGAccuracy80.33Unverified
3PiggybackAccuracy79.91Unverified
4ProgressiveNetAccuracy76.35Unverified
5H$^{2}$Accuracy76.2Unverified
6PackNetAccuracy76.17Unverified
#ModelMetricClaimedVerifiedStatus
1CPGAccuracy92.8Unverified
2CondConvContinualAccuracy92.61Unverified
3H$^{2}$Accuracy90.6Unverified
4PiggybackAccuracy89.62Unverified
5ProgressiveNetAccuracy89.21Unverified
6PackNetAccuracy86.11Unverified
#ModelMetricClaimedVerifiedStatus
1CondConvContinualAccuracy78.32Unverified
2CPGAccuracy77.15Unverified
3H$^{2}$Accuracy75.1Unverified
4ProgressiveNetAccuracy74.94Unverified
5PiggybackAccuracy71.33Unverified
6PackNetAccuracy69.4Unverified
#ModelMetricClaimedVerifiedStatus
1ALTA-ViTB/16Average Accuracy92.85Unverified
2ALTA-RN50x4Average Accuracy84.91Unverified
3RMN (Resnet)Average Accuracy84.9Unverified
4ALTA-RN101Average Accuracy84.77Unverified
5ALTA-RN50Average Accuracy83.87Unverified
#ModelMetricClaimedVerifiedStatus
1RMNAccuracy68.1Unverified
2CondConvContinualAccuracy61.32Unverified
3CCGNAccuracy35.24Unverified
4DGMwAccuracy17.82Unverified
5DGMaAccuracy15.16Unverified
#ModelMetricClaimedVerifiedStatus
1RMNAverage Accuracy97.99Unverified
2Model Zoo-ContinualAverage Accuracy97.71Unverified
3CODE-CLAverage Accuracy96.56Unverified
#ModelMetricClaimedVerifiedStatus
1TAG-RMSPropAccuracy62.59Unverified
#ModelMetricClaimedVerifiedStatus
1CODE-CLAverage Accuracy93.32Unverified
#ModelMetricClaimedVerifiedStatus
1TEST1:3 Accuracy2Unverified
#ModelMetricClaimedVerifiedStatus
1TAG-RMSPropAverage Accuracy62.79Unverified
#ModelMetricClaimedVerifiedStatus
1IBMAccuracy82.69Unverified
#ModelMetricClaimedVerifiedStatus
1IBMAccuracy88.15Unverified
#ModelMetricClaimedVerifiedStatus
1Model Zoo-ContinualAverage Accuracy84.27Unverified
#ModelMetricClaimedVerifiedStatus
1TAG-RMSPropAccuracy61.58Unverified
#ModelMetricClaimedVerifiedStatus
1CODE-CLAverage Accuracy68.83Unverified
#ModelMetricClaimedVerifiedStatus
1TAG-RMSPropAccuracy57.2Unverified
#ModelMetricClaimedVerifiedStatus
1IBMAccuracy53.9Unverified
#ModelMetricClaimedVerifiedStatus
1MRMAcc78.4Unverified
#ModelMetricClaimedVerifiedStatus
1Model Zoo-ContinualAverage Accuracy99.66Unverified
#ModelMetricClaimedVerifiedStatus
1CODE-CLAverage Accuracy77.21Unverified
#ModelMetricClaimedVerifiedStatus
1H$^{2}$Top 1 Accuracy %97.3Unverified
#ModelMetricClaimedVerifiedStatus
1H$^{2}$Top 1 Accuracy %99.9Unverified
#ModelMetricClaimedVerifiedStatus
1IBMAccuracy52.38Unverified