Compressing GANs using Knowledge Distillation Feb 1, 2019 Knowledge Distillation Super-Resolution
— Unverified Progressive Label Distillation: Learning Input-Efficient Deep Neural Networks Jan 26, 2019 Knowledge Distillation speech-recognition
— Unverified Unsupervised Learning of Neural Networks to Explain Neural Networks (extended abstract) Jan 21, 2019 Knowledge Distillation Object
— Unverified Learning Efficient Detector with Semi-supervised Adaptive Distillation Jan 2, 2019 image-classification Image Classification
Code Code Available Stealing Neural Networks via Timing Side Channels Dec 31, 2018 Knowledge Distillation Reinforcement Learning
— Unverified Improving the Interpretability of Deep Neural Networks with Knowledge Distillation Dec 28, 2018 Ethics Knowledge Distillation
— Unverified Learning Student Networks via Feature Embedding Dec 17, 2018 Knowledge Distillation
— Unverified Spatial Knowledge Distillation to aid Visual Reasoning Dec 10, 2018 Diagnostic Knowledge Distillation
— Unverified Optimizing speed/accuracy trade-off for person re-identification via knowledge distillation Dec 7, 2018 Deep Learning General Classification
— Unverified An Embarrassingly Simple Approach for Knowledge Distillation Dec 5, 2018 Face Recognition Knowledge Distillation
Code Code Available Few Sample Knowledge Distillation for Efficient Network Compression Dec 5, 2018 Knowledge Distillation Network Pruning
Code Code Available Accelerating Large Scale Knowledge Distillation via Dynamic Importance Sampling Dec 3, 2018 Knowledge Distillation Machine Translation
— Unverified Knowledge Distillation with Feature Maps for Image Classification Dec 3, 2018 Classification General Classification
— Unverified On Compressing U-net Using Knowledge Distillation Dec 1, 2018 Knowledge Distillation
— Unverified KDGAN: Knowledge Distillation with Generative Adversarial Networks Dec 1, 2018 Knowledge Distillation Multi-Label Learning
— Unverified Learning to Specialize with Knowledge Distillation for Visual Question Answering Dec 1, 2018 General Classification General Knowledge
— Unverified ExpandNets: Linear Over-parameterization to Train Compact Convolutional Networks Nov 26, 2018 General Classification image-classification
— Unverified Low-resolution Face Recognition in the Wild via Selective Knowledge Distillation Nov 25, 2018 CPU Face Model
— Unverified Structured Pruning of Neural Networks with Budget-Aware Regularization Nov 23, 2018 Knowledge Distillation
— Unverified Graph-Adaptive Pruning for Efficient Inference of Convolutional Neural Networks Nov 21, 2018 Knowledge Distillation Model Compression
— Unverified Factorized Distillation: Training Holistic Person Re-identification Model by Distilling an Ensemble of Partial ReID Models Nov 20, 2018 Knowledge Distillation Person Re-Identification
— Unverified Self-Referenced Deep Learning Nov 19, 2018 Deep Learning Knowledge Distillation
— Unverified Private Model Compression via Knowledge Distillation Nov 13, 2018 Knowledge Distillation model
— Unverified Sequence-Level Knowledge Distillation for Model Compression of Attention-based Sequence-to-Sequence Speech Recognition Nov 12, 2018 Knowledge Distillation Model Compression
— Unverified Cogni-Net: Cognitive Feature Learning through Deep Visual Perception Nov 1, 2018 EEG Electroencephalogram (EEG)
Code Code Available A Closer Look at Deep Learning Heuristics: Learning rate restarts, Warmup and Distillation Oct 29, 2018 Dimensionality Reduction Knowledge Distillation
— Unverified Block-wise Intermediate Representation Training for Model Compression Oct 20, 2018 Knowledge Distillation model
— Unverified KTAN: Knowledge Transfer Adversarial Network Oct 18, 2018 image-classification Image Classification
— Unverified LIT: Block-wise Intermediate Representation Training for Model Compression Oct 2, 2018 Knowledge Distillation Model Compression
— Unverified Analyzing Knowledge Distillation in Neural Machine Translation Oct 1, 2018 Knowledge Distillation Machine Translation
— Unverified Knowledge Distillation from Few Samples Sep 27, 2018 Knowledge Distillation
— Unverified Ranking Distillation: Learning Compact Ranking Models With High Performance for Recommender System Sep 19, 2018 Knowledge Distillation Learning-To-Rank
Code Code Available Real-Time Joint Semantic Segmentation and Depth Estimation Using Asymmetric Annotations Sep 13, 2018 Depth Estimation GPU
Code Code Available MotherNets: Rapid Deep Ensemble Learning Sep 12, 2018 Clustering Clustering Ensemble
— Unverified Label Denoising with Large Ensembles of Heterogeneous Neural Networks Sep 12, 2018 Data Augmentation Denoising
— Unverified RDPD: Rich Data Helps Poor Data via Imitation Sep 6, 2018 Knowledge Distillation
Code Code Available Lifelong Learning via Progressive Distillation and Retrospection Sep 1, 2018 Knowledge Distillation Lifelong learning
— Unverified Attention-Guided Answer Distillation for Machine Reading Comprehension Aug 23, 2018 Knowledge Distillation Machine Reading Comprehension
— Unverified Whole-Slide Mitosis Detection in H&E Breast Histology Using PHH3 as a Reference to Train Distilled Stain-Invariant Convolutional Networks Aug 17, 2018 Data Augmentation Knowledge Distillation
— Unverified Cooperative Denoising for Distantly Supervised Relation Extraction Aug 1, 2018 Denoising Information Retrieval
— Unverified SlimNets: An Exploration of Deep Model Compression and Acceleration Aug 1, 2018 Knowledge Distillation Model Compression
Code Code Available Self-supervised Knowledge Distillation Using Singular Value Decomposition Jul 18, 2018 Knowledge Distillation Transfer Learning
Code Code Available Revisiting Distillation and Incremental Classifier Learning Jul 8, 2018 Incremental Learning Knowledge Distillation
Code Code Available Distillation Techniques for Pseudo-rehearsal Based Incremental Learning Jul 8, 2018 Incremental Learning Knowledge Distillation
Code Code Available Gradient Adversarial Training of Neural Networks Jun 21, 2018 BIG-bench Machine Learning Binary Classification
— Unverified Knowledge Distillation by On-the-Fly Native Ensemble Jun 12, 2018 Computational Efficiency image-classification
Code Code Available Coupled End-to-End Transfer Learning With Generalized Fisher Information Jun 1, 2018 Decoder Domain Adaptation
— Unverified Collaborative Learning for Deep Neural Networks May 30, 2018 Knowledge Distillation Multi-Task Learning
— Unverified A novel channel pruning method for deep neural network compression May 29, 2018 channel selection Combinatorial Optimization
— Unverified Theory and Experiments on Vector Quantized Autoencoders May 28, 2018 Image Generation Knowledge Distillation
Code Code Available 