Fair Feature Distillation for Visual Recognition May 27, 2021 Fairness Knowledge Distillation
— Unverified How Does Distilled Data Complexity Impact the Quality and Confidence of Non-Autoregressive Machine Translation? May 27, 2021 Diversity Knowledge Distillation
— Unverified KnowSR: Knowledge Sharing among Homogeneous Agents in Multi-agent Reinforcement Learning May 25, 2021 Deep Reinforcement Learning Knowledge Distillation
— Unverified Real-time Monocular Depth Estimation with Sparse Supervision on Mobile May 25, 2021 Autonomous Vehicles Depth Estimation
— Unverified Experimenting with Knowledge Distillation techniques for performing Brain Tumor Segmentation May 24, 2021 Brain Tumor Segmentation Knowledge Distillation
— Unverified AirNet: Neural Network Transmission over the Air May 24, 2021 Knowledge Distillation
— Unverified Revisiting Knowledge Distillation for Object Detection May 22, 2021 Domain Adaptation Knowledge Distillation
— Unverified Inplace knowledge distillation with teacher assistant for improved training of flexible deep neural networks May 18, 2021 image-classification Image Classification
— Unverified Weakly Supervised Dense Video Captioning via Jointly Usage of Knowledge Distillation and Cross-modal Matching May 18, 2021 Caption Generation Cross-Modal Retrieval
— Unverified Class-Incremental Few-Shot Object Detection May 17, 2021 Clustering Few-Shot Object Detection
— Unverified Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders May 12, 2021 Automatic Speech Recognition Automatic Speech Recognition (ASR)
— Unverified KDExplainer: A Task-oriented Attention Model for Explaining Knowledge Distillation May 10, 2021 Knowledge Distillation Mixture-of-Experts
— Unverified Test-Time Adaptation Toward Personalized Speech Enhancement: Zero-Shot Learning with Knowledge Distillation May 8, 2021 Denoising Knowledge Distillation
— Unverified Regression Bugs Are In Your Model! Measuring, Reducing and Analyzing Regressions In NLP Model Updates May 7, 2021 Knowledge Distillation model
— Unverified Black-Box Dissector: Towards Erasing-based Hard-Label Model Stealing Attack May 3, 2021 Knowledge Distillation Self-Knowledge Distillation
— Unverified A Peek Into the Reasoning of Neural Networks: Interpreting with Structural Visual Concepts May 1, 2021 Explainable artificial intelligence Knowledge Distillation
— Unverified Knowledge Distillation for Swedish NER models: A Search for Performance and Efficiency May 1, 2021 Knowledge Distillation Model Compression
— Unverified Contrastive Conditioning for Assessing Disambiguation in MT: A Case Study of Distilled Bias May 1, 2021 Knowledge Distillation Machine Translation
Code Code Available Semantic Relation Preserving Knowledge Distillation for Image-to-Image Translation Apr 30, 2021 Image-to-Image Translation Knowledge Distillation
— Unverified Distilling EEG Representations via Capsules for Affective Computing Apr 30, 2021 EEG Electroencephalogram (EEG)
— Unverified LIDAR and Position-Aided mmWave Beam Selection with Non-local CNNs and Curriculum Training Apr 29, 2021 Knowledge Distillation Position
Code Code Available Spirit Distillation: A Model Compression Method with Multi-domain Knowledge Transfer Apr 29, 2021 General Knowledge Knowledge Distillation
— Unverified Interpretable Embedding Procedure Knowledge Transfer via Stacked Principal Component Analysis and Graph Neural Network Apr 28, 2021 Graph Neural Network Knowledge Distillation
Code Code Available Self-distillation with Batch Knowledge Ensembling Improves ImageNet Classification Apr 27, 2021 Classification General Classification
— Unverified Extract then Distill: Efficient and Effective Task-Agnostic BERT Distillation Apr 24, 2021 Knowledge Distillation
— Unverified Relational Subsets Knowledge Distillation for Long-tailed Retinal Diseases Recognition Apr 22, 2021 Knowledge Distillation
— Unverified Orderly Dual-Teacher Knowledge Distillation for Lightweight Human Pose Estimation Apr 21, 2021 Binarization Knowledge Distillation
— Unverified Brittle Features May Help Anomaly Detection Apr 21, 2021 Anomaly Detection Knowledge Distillation
— Unverified Knowledge Distillation as Semiparametric Inference Apr 20, 2021 Knowledge Distillation Model Compression
Code Code Available EduPal leaves no professor behind: Supporting faculty via a peer-powered recommender system Apr 20, 2021 Chatbot Knowledge Distillation
— Unverified Compact CNN Structure Learning by Knowledge Distillation Apr 19, 2021 Knowledge Distillation Model Compression
— Unverified Continual Learning for Fake Audio Detection Apr 15, 2021 Continual Learning Knowledge Distillation
— Unverified Integration of Pre-trained Networks with Continuous Token Interface for End-to-End Spoken Language Understanding Apr 15, 2021 intent-classification Intent Classification
— Unverified Unsupervised Continual Learning Via Pseudo Labels Apr 14, 2021 Clustering Continual Learning
— Unverified The Curious Case of Hallucinations in Neural Machine Translation Apr 14, 2021 Hallucination Knowledge Distillation
Code Code Available Sentence Embeddings by Ensemble Distillation Apr 14, 2021 Knowledge Distillation Semantic Textual Similarity
— Unverified Annealing Knowledge Distillation Apr 14, 2021 image-classification Image Classification
Code Code Available Dealing with Missing Modalities in the Visual Question Answer-Difference Prediction Task through Knowledge Distillation Apr 13, 2021 Knowledge Distillation Triplet
— Unverified Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translation Apr 13, 2021 Automatic Speech Recognition Automatic Speech Recognition (ASR)
— Unverified RankDistil: Knowledge Distillation for Ranking Apr 13, 2021 Document Ranking Knowledge Distillation
— Unverified CXR Segmentation by AdaIN-based Domain Adaptation and Knowledge Distillation Apr 13, 2021 Domain Adaptation Knowledge Distillation
Code Code Available Dual Discriminator Adversarial Distillation for Data-free Model Compression Apr 12, 2021 Data-free Knowledge Distillation Knowledge Distillation
— Unverified Data-Free Knowledge Distillation with Soft Targeted Transfer Set Synthesis Apr 10, 2021 Data-free Knowledge Distillation Knowledge Distillation
— Unverified Towards Enabling Meta-Learning from Target Models Apr 8, 2021 Few-Shot Learning Inductive Bias
Code Code Available GKD: Semi-supervised Graph Knowledge Distillation for Graph-Independent Inference Apr 8, 2021 Disease Prediction graph construction
Code Code Available Distilling and Transferring Knowledge via cGAN-generated Samples for Image Classification and Regression Apr 7, 2021 General Classification image-classification
Code Code Available Compressing Visual-linguistic Model via Knowledge Distillation Apr 5, 2021 Image Captioning Knowledge Distillation
— Unverified Knowledge Distillation For Wireless Edge Learning Apr 3, 2021 Cloud Computing Federated Learning
Code Code Available Students are the Best Teacher: Exit-Ensemble Distillation with Multi-Exits Apr 1, 2021 Classification General Classification
Code Code Available Dialect Identification through Adversarial Learning and Knowledge Distillation on Romanian BERT Apr 1, 2021 Automatic Speech Recognition Automatic Speech Recognition (ASR)
— Unverified 