BiLD: Bi-directional Logits Difference Loss for Large Language Model Distillation Jun 19, 2024 Knowledge Distillation Language Modeling
Code Code Available 5 Inter-Region Affinity Distillation for Road Marking Segmentation Apr 11, 2020 Knowledge Distillation Lane Detection
Code Code Available 5 Dice Semimetric Losses: Optimizing the Dice Score with Soft Labels Mar 28, 2023 Knowledge Distillation
Code Code Available 5 Intra-Document Cascading: Learning to Select Passages for Neural Document Ranking May 20, 2021 Document Ranking Knowledge Distillation
Code Code Available 5 DGEKT: A Dual Graph Ensemble Learning Method for Knowledge Tracing Nov 23, 2022 Ensemble Learning Knowledge Distillation
Code Code Available 5 Decoupled Multimodal Distilling for Emotion Recognition Mar 24, 2023 Emotion Recognition Knowledge Distillation
Code Code Available 5 Discriminative and Consistent Representation Distillation Jul 16, 2024 Causal Inference Contrastive Learning
Code Code Available 5 Invariant Teacher and Equivariant Student for Unsupervised 3D Human Pose Estimation Dec 17, 2020 3D Human Pose Estimation Knowledge Distillation
Code Code Available 5 DFIL: Deepfake Incremental Learning by Exploiting Domain-invariant Forgery Clues Sep 18, 2023 Continual Learning Contrastive Learning
Code Code Available 5 Directed Acyclic Transformer for Non-Autoregressive Machine Translation May 16, 2022 Knowledge Distillation Machine Translation
Code Code Available 5 Jaccard Metric Losses: Optimizing the Jaccard Index with Soft Labels Feb 11, 2023 Knowledge Distillation Semantic Segmentation
Code Code Available 5 DeepAqua: Self-Supervised Semantic Segmentation of Wetland Surface Water Extent with SAR Images using Knowledge Distillation May 2, 2023 Knowledge Distillation Semantic Segmentation
Code Code Available 5 Hybrid Inverted Index Is a Robust Accelerator for Dense Retrieval Oct 11, 2022 Knowledge Distillation Quantization
Code Code Available 5 TinyGAN: Distilling BigGAN for Conditional Image Generation Sep 29, 2020 Conditional Image Generation Image Generation
Code Code Available 5 Densely Guided Knowledge Distillation using Multiple Teacher Assistants Sep 18, 2020 Knowledge Distillation Model Compression
Code Code Available 5 DE-RRD: A Knowledge Distillation Framework for Recommender System Dec 8, 2020 Knowledge Distillation Model Compression
Code Code Available 5 Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models Nov 2, 2023 Data Augmentation Domain Generalization
Code Code Available 5 Deep Encoder, Shallow Decoder: Reevaluating Non-autoregressive Machine Translation Jun 18, 2020 Decoder Knowledge Distillation
Code Code Available 5 AMFD: Distillation via Adaptive Multimodal Fusion for Multispectral Pedestrian Detection May 21, 2024 Knowledge Distillation Pedestrian Detection
Code Code Available 5 Join the High Accuracy Club on ImageNet with A Binary Neural Network Ticket Nov 23, 2022 Data Augmentation Knowledge Distillation
Code Code Available 5 Deep Graph-level Anomaly Detection by Glocal Knowledge Distillation Dec 19, 2021 Anomaly Detection Knowledge Distillation
Code Code Available 5 DeepKD: A Deeply Decoupled and Denoised Knowledge Distillation Trainer May 21, 2025 Denoising Knowledge Distillation
Code Code Available 5 Learning Cross-Lingual IR from an English Retriever Dec 15, 2021 Cross-Lingual Information Retrieval Information Retrieval
Code Code Available 5 KD3A: Unsupervised Multi-Source Decentralized Domain Adaptation via Knowledge Distillation Nov 19, 2020 Domain Adaptation Knowledge Distillation
Code Code Available 5 Adaptive Multi-Teacher Knowledge Distillation with Meta-Learning Jun 11, 2023 Knowledge Distillation Meta-Learning
Code Code Available 5 KDAS: Knowledge Distillation via Attention Supervision Framework for Polyp Segmentation Dec 13, 2023 Knowledge Distillation Medical Image Segmentation
Code Code Available 5 Black-box Few-shot Knowledge Distillation Jul 25, 2022 image-classification Image Classification
Code Code Available 5 KD-MRI: A knowledge distillation framework for image reconstruction and image restoration in MRI workflow Apr 11, 2020 CPU GPU
Code Code Available 5 Adaptive Multi-Teacher Multi-level Knowledge Distillation Mar 6, 2021 Knowledge Distillation
Code Code Available 5 KD-MVS: Knowledge Distillation Based Self-supervised Learning for Multi-view Stereo Jul 21, 2022 Knowledge Distillation Self-Supervised Learning
Code Code Available 5 Knapsack Pruning with Inner Distillation Feb 19, 2020 GPU Knowledge Distillation
Code Code Available 5 Deep Semi-supervised Knowledge Distillation for Overlapping Cervical Cell Instance Segmentation Jul 21, 2020 Instance Segmentation Knowledge Distillation
Code Code Available 5 Towards Efficient 3D Object Detection with Knowledge Distillation May 30, 2022 3D Object Detection Knowledge Distillation
Code Code Available 5 Deep Structured Instance Graph for Distilling Object Detectors Sep 27, 2021 Instance Segmentation Knowledge Distillation
Code Code Available 5 Understanding the Role of the Projector in Knowledge Distillation Mar 20, 2023 image-classification Image Classification
Code Code Available 5 Knowledge Condensation Distillation Jul 12, 2022 Knowledge Distillation
Code Code Available 5 Learning to Retrieve In-Context Examples for Large Language Models Jul 14, 2023 In-Context Learning Knowledge Distillation
Code Code Available 5 LTE4G: Long-Tail Experts for Graph Neural Networks Aug 22, 2022 Knowledge Distillation Node Classification
Code Code Available 5 Defocus Blur Detection via Depth Distillation Jul 16, 2020 Decoder Defocus Blur Detection
Code Code Available 5 Deformation Flow Based Two-Stream Network for Lip Reading Mar 12, 2020 Knowledge Distillation Lipreading
Code Code Available 5 Knowledge Distillation as Efficient Pre-training: Faster Convergence, Higher Data-efficiency, and Better Transferability Mar 10, 2022 Knowledge Distillation
Code Code Available 5 Deliberated Domain Bridging for Domain Adaptive Semantic Segmentation Sep 16, 2022 Domain Adaptation Image-to-Image Translation
Code Code Available 5 Deliberation on Priors: Trustworthy Reasoning of Large Language Models on Knowledge Graphs May 21, 2025 Knowledge Distillation Knowledge Graphs
Code Code Available 5 Knowledge Distillation for BERT Unsupervised Domain Adaptation Oct 22, 2020 Domain Adaptation General Classification
Code Code Available 5 Knowledge Distillation Based on Transformed Teacher Matching Feb 17, 2024 Knowledge Distillation
Code Code Available 5 Traffic Signal Control Using Lightweight Transformers: An Offline-to-Online RL Approach Dec 12, 2023 Knowledge Distillation Offline RL
Code Code Available 5 Knowledge Distillation for Brain Tumor Segmentation Feb 10, 2020 Brain Tumor Segmentation Knowledge Distillation
Code Code Available 5 Knowledge Distillation for Feature Extraction in Underwater VSLAM Mar 31, 2023 Binarization Knowledge Distillation
Code Code Available 5 Dense Interspecies Face Embedding Nov 28, 2022 Image Manipulation Interspecies Facial Keypoint Transfer
Code Code Available 5 Multi-Granularity Distillation Scheme Towards Lightweight Semi-Supervised Semantic Segmentation Aug 22, 2022 Knowledge Distillation Semantic Segmentation
Code Code Available 5 