Towards Non-task-specific Distillation of BERT via Sentence Representation Approximation Apr 7, 2020 Knowledge Distillation Sentence
— Unverified Enhancing Review Comprehension with Domain-Specific Commonsense Apr 6, 2020 Aspect Extraction Knowledge Distillation
— Unverified Temporally Distributed Networks for Fast Video Semantic Segmentation Apr 3, 2020 Knowledge Distillation Real-Time Semantic Segmentation
Code Code Available More Grounded Image Captioning by Distilling Image-Text Matching Model Apr 1, 2020 Image Captioning Image-text matching
Code Code Available Knowledge as Priors: Cross-Modal Knowledge Generalization for Datasets without Superior Knowledge Apr 1, 2020 3D Hand Pose Estimation Hand Pose Estimation
— Unverified Creating Something from Nothing: Unsupervised Knowledge Distillation for Cross-Modal Hashing Apr 1, 2020 Knowledge Distillation Retrieval
Code Code Available Neural Networks Are More Productive Teachers Than Human Raters: Active Mixup for Data-Efficient Knowledge Distillation from a Blackbox Model Mar 31, 2020 Active Learning Knowledge Distillation
Code Code Available Distilled Semantics for Comprehensive Scene Understanding from Videos Mar 31, 2020 Depth Estimation Knowledge Distillation
Code Code Available Spatio-Temporal Graph for Video Captioning with Knowledge Distillation Mar 31, 2020 Knowledge Distillation Object
— Unverified SS-IL: Separated Softmax for Incremental Learning Mar 31, 2020 class-incremental learning Class Incremental Learning
— Unverified Regularizing Class-wise Predictions via Self-knowledge Distillation Mar 31, 2020 image-classification Image Classification
Code Code Available Squeezed Deep 6DoF Object Detection Using Knowledge Distillation Mar 30, 2020 Knowledge Distillation Object
Code Code Available Analysis of Knowledge Transfer in Kernel Regime Mar 30, 2020 Knowledge Distillation Transfer Learning
— Unverified Circumventing Outliers of AutoAugment with Knowledge Distillation Mar 25, 2020 Data Augmentation General Classification
Code Code Available A Survey of Methods for Low-Power Deep Learning and Computer Vision Mar 24, 2020 Knowledge Distillation Quantization
— Unverified Synergic Adversarial Label Learning for Grading Retinal Diseases via Knowledge Distillation and Multi-task Learning Mar 24, 2020 Classification General Classification
— Unverified Distilling Knowledge from Graph Convolutional Networks Mar 23, 2020 Knowledge Distillation Transfer Learning
Code Code Available Collaborative Distillation for Ultra-Resolution Universal Style Transfer Mar 18, 2020 Decoder GPU
Code Code Available Incremental Object Detection via Meta-Learning Mar 17, 2020 Incremental Learning Knowledge Distillation
Code Code Available Teacher-Student chain for efficient semi-supervised histology image classification Mar 17, 2020 Classification General Classification
— Unverified Deformation Flow Based Two-Stream Network for Lip Reading Mar 12, 2020 Knowledge Distillation Lipreading
Code Code Available SuperMix: Supervising the Mixing Data Augmentation Mar 10, 2020 Data Augmentation General Classification
Code Code Available Knowledge distillation via adaptive instance normalization Mar 9, 2020 Knowledge Distillation Model Compression
— Unverified Faster ILOD: Incremental Learning for Object Detectors based on Faster RCNN Mar 9, 2020 Incremental Learning Knowledge Distillation
Code Code Available Pacemaker: Intermediate Teacher Knowledge Distillation For On-The-Fly Convolutional Neural Network Mar 9, 2020 Knowledge Distillation Model Compression
— Unverified PoseNet3D: Learning Temporally Consistent 3D Human Pose via Knowledge Distillation Mar 7, 2020 3D Human Pose Estimation Knowledge Distillation
Code Code Available Distilling portable Generative Adversarial Networks for Image Translation Mar 7, 2020 Image-to-Image Translation Knowledge Distillation
— Unverified Explaining Knowledge Distillation by Quantifying the Knowledge Mar 7, 2020 Knowledge Distillation
— Unverified Distill, Adapt, Distill: Training Small, In-Domain Models for Neural Machine Translation Mar 5, 2020 Domain Adaptation Knowledge Distillation
— Unverified An Efficient Method of Training Small Models for Regression Problems with Knowledge Distillation Feb 28, 2020 Knowledge Distillation Memorization
— Unverified TextBrewer: An Open-Source Knowledge Distillation Toolkit for Natural Language Processing Feb 28, 2020 Knowledge Distillation Reading Comprehension
Code Code Available Efficient Semantic Video Segmentation with Per-frame Inference Feb 26, 2020 Knowledge Distillation Optical Flow Estimation
Code Code Available Semi-Supervised Speech Recognition via Local Prior Matching Feb 24, 2020 Knowledge Distillation Language Modeling
Code Code Available Residual Knowledge Distillation Feb 21, 2020 Knowledge Distillation Model Compression
— Unverified Balancing Cost and Benefit with Tied-Multi Transformers Feb 20, 2020 Decoder Knowledge Distillation
— Unverified The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding Feb 19, 2020 Knowledge Distillation Multi-Task Learning
— Unverified Knapsack Pruning with Inner Distillation Feb 19, 2020 GPU Knowledge Distillation
Code Code Available Self-Distillation Amplifies Regularization in Hilbert Space Feb 13, 2020 Knowledge Distillation L2 Regularization
— Unverified Salvaging Federated Learning by Local Adaptation Feb 12, 2020 Federated Learning Knowledge Distillation
Code Code Available Content Based Singing Voice Extraction From a Musical Mixture Feb 12, 2020 Decoder Deep Learning
Code Code Available Meta-Learning across Meta-Tasks for Few-Shot Learning Feb 11, 2020 Domain Adaptation Few-Shot Learning
— Unverified Regularized Evolutionary Population-Based Training Feb 11, 2020 Diversity image-classification
— Unverified Knowledge Distillation for Brain Tumor Segmentation Feb 10, 2020 Brain Tumor Segmentation Knowledge Distillation
Code Code Available Understanding and Improving Knowledge Distillation Feb 10, 2020 Knowledge Distillation Model Compression
— Unverified Unlabeled Data Deployment for Classification of Diabetic Retinopathy Images Using Knowledge Transfer Feb 9, 2020 General Classification Knowledge Distillation
— Unverified SUOD: Toward Scalable Unsupervised Outlier Detection Feb 8, 2020 Knowledge Distillation Outlier Detection
Code Code Available BERT-of-Theseus: Compressing BERT by Progressive Module Replacing Feb 7, 2020 Knowledge Distillation Model Compression
Code Code Available Feature-map-level Online Adversarial Knowledge Distillation Feb 5, 2020 Knowledge Distillation
— Unverified Periodic Intra-Ensemble Knowledge Distillation for Reinforcement Learning Feb 1, 2020 Knowledge Distillation MuJoCo
Code Code Available Search for Better Students to Learn Distilled Knowledge Jan 30, 2020 Knowledge Distillation Model Compression
— Unverified 