| Effective Whole-body Pose Estimation with Two-stages Distillation | Jul 29, 2023 | 2D Human Pose EstimationKnowledge Distillation | CodeCode Available | 4 | 5 |
| Towards A Generalizable Pathology Foundation Model via Unified Knowledge Distillation | Jul 26, 2024 | Knowledge DistillationQuestion Answering | CodeCode Available | 2 | 5 |
| Graph-based Knowledge Distillation: A survey and experimental evaluation | Feb 27, 2023 | Knowledge DistillationSelf-Knowledge Distillation | CodeCode Available | 1 | 5 |
| Multimodality Multi-Lead ECG Arrhythmia Classification using Self-Supervised Learning | Sep 30, 2022 | ECG ClassificationKnowledge Distillation | CodeCode Available | 1 | 5 |
| BGE M3-Embedding: Multi-Lingual, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation | Feb 5, 2024 | Knowledge DistillationRetrieval | CodeCode Available | 1 | 5 |
| ProSelfLC: Progressive Self Label Correction for Training Robust Deep Neural Networks | May 7, 2020 | Knowledge DistillationSelf-Knowledge Distillation | CodeCode Available | 1 | 5 |
| Self-Knowledge Distillation with Progressive Refinement of Targets | Jun 22, 2020 | image-classificationImage Classification | CodeCode Available | 1 | 5 |
| Regularizing Class-wise Predictions via Self-knowledge Distillation | Mar 31, 2020 | image-classificationImage Classification | CodeCode Available | 1 | 5 |
| Noisy Self-Knowledge Distillation for Text Summarization | Sep 15, 2020 | Knowledge DistillationSelf-Knowledge Distillation | CodeCode Available | 1 | 5 |
| Refine Myself by Teaching Myself: Feature Refinement via Self-Knowledge Distillation | Mar 15, 2021 | Data AugmentationKnowledge Distillation | CodeCode Available | 1 | 5 |
| Three-Stream Temporal-Shift Attention Network Based on Self-Knowledge Distillation for Micro-Expression Recognition | Jun 25, 2024 | Knowledge DistillationMicro Expression Recognition | CodeCode Available | 1 | 5 |
| DualFair: Fair Representation Learning at Both Group and Individual Levels via Contrastive Self-supervision | Mar 15, 2023 | counterfactualFairness | CodeCode Available | 1 | 5 |
| Even your Teacher Needs Guidance: Ground-Truth Targets Dampen Regularization Imposed by Self-Distillation | Feb 25, 2021 | Knowledge DistillationSelf-Knowledge Distillation | CodeCode Available | 1 | 5 |
| CrossMatch: Enhance Semi-Supervised Medical Image Segmentation with Perturbation Strategies and Knowledge Distillation | May 1, 2024 | Image SegmentationKnowledge Distillation | CodeCode Available | 1 | 5 |
| MixSKD: Self-Knowledge Distillation from Mixup for Image Recognition | Aug 11, 2022 | Data Augmentationimage-classification | CodeCode Available | 1 | 5 |
| Preservation of the Global Knowledge by Not-True Distillation in Federated Learning | Jun 6, 2021 | Continual LearningFederated Learning | CodeCode Available | 1 | 5 |
| FedSOL: Stabilized Orthogonal Learning with Proximal Restrictions in Federated Learning | Aug 24, 2023 | Continual LearningFederated Learning | CodeCode Available | 1 | 5 |
| Robust Spatiotemporal Traffic Forecasting with Reinforced Dynamic Adversarial Training | Jun 25, 2023 | Adversarial RobustnessKnowledge Distillation | CodeCode Available | 1 | 5 |
| Incorporating Graph Information in Transformer-based AMR Parsing | Jun 23, 2023 | Abstract Meaning RepresentationAMR Parsing | CodeCode Available | 0 | 5 |
| Efficient Lung Ultrasound Severity Scoring Using Dedicated Feature Extractor | Jan 21, 2025 | DiagnosticKnowledge Distillation | CodeCode Available | 0 | 5 |
| Promoting Generalized Cross-lingual Question Answering in Few-resource Scenarios via Self-knowledge Distillation | Sep 29, 2023 | Cross-Lingual Question AnsweringCross-Lingual Transfer | CodeCode Available | 0 | 5 |
| Guiding Frame-Level CTC Alignments Using Self-knowledge Distillation | Jun 12, 2024 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | CodeCode Available | 0 | 5 |
| Combining inherent knowledge of vision-language models with unsupervised domain adaptation through strong-weak guidance | Dec 7, 2023 | Domain AdaptationKnowledge Distillation | CodeCode Available | 0 | 5 |
| From Knowledge Distillation to Self-Knowledge Distillation: A Unified Approach with Normalized Loss and Customized Soft Labels | Mar 23, 2023 | Knowledge DistillationSelf-Knowledge Distillation | CodeCode Available | 0 | 5 |
| Frequency-Guided Masking for Enhanced Vision Self-Supervised Learning | Sep 16, 2024 | Few-Shot Learningimage-classification | CodeCode Available | 0 | 5 |
