CMU’s IWSLT 2022 Dialect Speech Translation System May 1, 2022 Decoder Knowledge Distillation
— Unverified Model Distillation for Faithful Explanations of Medical Code Predictions May 1, 2022 Decision Making Knowledge Distillation
— Unverified An Unsupervised Multiple-Task and Multiple-Teacher Model for Cross-lingual Named Entity Recognition May 1, 2022 Cross-Lingual NER Knowledge Distillation
— Unverified Multi-Granularity Structural Knowledge Distillation for Language Model Compression May 1, 2022 Knowledge Distillation Language Modeling
Code Code Available The Xiaomi Text-to-Text Simultaneous Speech Translation System for IWSLT 2022 May 1, 2022 Automatic Speech Recognition Automatic Speech Recognition (ASR)
— Unverified Domain Knowledge Transferring for Pre-trained Language Model via Calibrated Activation Boundary Distillation May 1, 2022 Knowledge Distillation Language Modeling
Code Code Available Domain-specific knowledge distillation yields smaller and better models for conversational commerce May 1, 2022 Knowledge Distillation Language Modeling
— Unverified Pretrained Speech Encoders and Efficient Fine-tuning Methods for Speech Translation: UPC at IWSLT 2022 May 1, 2022 Decoder Knowledge Distillation
Code Code Available Low Resource Causal Event Detection from Biomedical Literature May 1, 2022 Event Detection Knowledge Distillation
— Unverified Nearest Neighbor Knowledge Distillation for Neural Machine Translation May 1, 2022 Knowledge Distillation Machine Translation
Code Code Available EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing Apr 30, 2022 Few-Shot Learning Knowledge Distillation
— Unverified Multiple Degradation and Reconstruction Network for Single Image Denoising via Knowledge Distillation Apr 29, 2022 Denoising Image Denoising
— Unverified Curriculum Learning for Dense Retrieval Distillation Apr 28, 2022 Knowledge Distillation Passage Retrieval
Code Code Available DearKD: Data-Efficient Early Knowledge Distillation for Vision Transformers Apr 27, 2022 Knowledge Distillation
— Unverified Human-Centered Prior-Guided and Task-Dependent Multi-Task Representation Learning for Action Recognition Pre-Training Apr 27, 2022 Action Recognition Contrastive Learning
— Unverified Conformer and Blind Noisy Students for Improved Image Quality Assessment Apr 27, 2022 Image Quality Assessment Image Restoration
Code Code Available Transfer Learning with Pre-trained Conditional Generative Models Apr 27, 2022 Knowledge Distillation Transfer Learning
— Unverified One-shot Federated Learning without Server-side Training Apr 26, 2022 Federated Learning image-classification
Code Code Available Improving Feature Generalizability with Multitask Learning in Class Incremental Learning Apr 26, 2022 class-incremental learning Class Incremental Learning
— Unverified Revisiting Graph based Social Recommendation: A Distillation Enhanced Social Graph Network Apr 25, 2022 Knowledge Distillation Recommendation Systems
— Unverified Boosting Pruned Networks with Linear Over-parameterization Apr 25, 2022 Knowledge Distillation
— Unverified Proto2Proto: Can you recognize the car, the way I do? Apr 25, 2022 Knowledge Distillation
Code Code Available Selective Cross-Task Distillation Apr 25, 2022 Knowledge Distillation
— Unverified Joint Feature Distribution Alignment Learning for NIR-VIS and VIS-VIS Face Recognition Apr 25, 2022 Face Recognition Heterogeneous Face Recognition
— Unverified On-Device Next-Item Recommendation with Self-Supervised Knowledge Distillation Apr 23, 2022 Knowledge Distillation Recommendation Systems
Code Code Available Learning to Purification for Unsupervised Person Re-identification Apr 21, 2022 Knowledge Distillation Person Re-Identification
— Unverified Eliminating Backdoor Triggers for Deep Neural Networks Using Attention Relation Graph Distillation Apr 21, 2022 backdoor defense Knowledge Distillation
Code Code Available Unseen Object Instance Segmentation with Fully Test-time RGB-D Embeddings Adaptation Apr 21, 2022 Instance Segmentation Knowledge Distillation
— Unverified HRPose: Real-Time High-Resolution 6D Pose Estimation Network Using Knowledge Distillation Apr 20, 2022 6D Pose Estimation 6D Pose Estimation using RGB
— Unverified DialoKG: Knowledge-Structure Aware Task-Oriented Dialogue Generation Apr 19, 2022 Dialogue Generation Knowledge Distillation
Code Code Available Modeling Missing Annotations for Incremental Learning in Object Detection Apr 19, 2022 Incremental Learning Instance Segmentation
Code Code Available Multi-Modal Few-Shot Object Detection with Meta-Learning-Based Cross-Modal Prompting Apr 16, 2022 Few-Shot Learning Few-Shot Object Detection
— Unverified MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation Apr 15, 2022 Knowledge Distillation Mixture-of-Experts
Code Code Available CILDA: Contrastive Data Augmentation using Intermediate Layer Knowledge Distillation Apr 15, 2022 Contrastive Learning Data Augmentation
— Unverified Ensemble diverse hypotheses and knowledge distillation for unsupervised cross-subject adaptation Apr 15, 2022 Activity Recognition Domain Adaptation
Code Code Available Cross-Image Relational Knowledge Distillation for Semantic Segmentation Apr 14, 2022 Knowledge Distillation Segmentation
Code Code Available Spatial Likelihood Voting with Self-Knowledge Distillation for Weakly Supervised Object Detection Apr 14, 2022 Knowledge Distillation Multiple Instance Learning
— Unverified Impossible Triangle: What's Next for Pre-trained Language Models? Apr 13, 2022 Data Augmentation Few-Shot Learning
— Unverified Localization Distillation for Object Detection Apr 12, 2022 Knowledge Distillation Object
Code Code Available DistPro: Searching A Fast Knowledge Distillation Process via Meta Optimization Apr 12, 2022 Knowledge Distillation Meta-Learning
— Unverified CoupleFace: Relation Matters for Face Recognition Distillation Apr 12, 2022 Face Recognition Knowledge Distillation
— Unverified LRH-Net: A Multi-Level Knowledge Distillation Approach for Low-Resource Heart Network Apr 11, 2022 Knowledge Distillation
Code Code Available Solving ImageNet: a Unified Scheme for Training any Backbone to Top Results Apr 7, 2022 Image Classification Knowledge Distillation
Code Code Available Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response Distillation Apr 5, 2022 Class-Incremental Object Detection Incremental Learning
Code Code Available Towards On-Board Panoptic Segmentation of Multispectral Satellite Images Apr 5, 2022 Knowledge Distillation Panoptic Segmentation
— Unverified Using Explainable Boosting Machine to Compare Idiographic and Nomothetic Approaches for Ecological Momentary Assessment Data Apr 4, 2022 Interpretable Machine Learning Knowledge Distillation
— Unverified Co-Teaching for Unsupervised Domain Adaptation and Expansion Apr 4, 2022 Domain Adaptation image-classification
Code Code Available CDKT-FL: Cross-Device Knowledge Transfer using Proxy Dataset in Federated Learning Apr 4, 2022 Federated Learning Knowledge Distillation
— Unverified DST: Dynamic Substitute Training for Data-free Black-box Attack Apr 3, 2022 Knowledge Distillation
— Unverified CL-XABSA: Contrastive Learning for Cross-lingual Aspect-based Sentiment Analysis Apr 2, 2022 Aspect-Based Sentiment Analysis Aspect-Based Sentiment Analysis (ABSA)
Code Code Available 