PEA-Diffusion: Parameter-Efficient Adapter with Knowledge Distillation in non-English Text-to-Image Generation Nov 28, 2023 Cross-lingual Text-to-Image Generation Image Generation
Code Code Available Some Like It Small: Czech Semantic Embedding Models for Industry Applications Nov 23, 2023 Image Retrieval Knowledge Distillation
Code Code Available HoVer-UNet: Accelerating HoVerNet with UNet-based multi-class nuclei segmentation via knowledge distillation Nov 21, 2023 Instance Segmentation Knowledge Distillation
Code Code Available Point, Segment and Count: A Generalized Framework for Object Counting Nov 21, 2023 Knowledge Distillation Object
Code Code Available FreeKD: Knowledge Distillation via Semantic Frequency Prompt Nov 20, 2023 Knowledge Distillation
Code Code Available Expanding Scene Graph Boundaries: Fully Open-vocabulary Scene Graph Generation via Visual-Concept Alignment and Retention Nov 18, 2023 Concept Alignment Graph Generation
Code Code Available Quantized Distillation: Optimizing Driver Activity Recognition Models for Resource-Constrained Environments Nov 10, 2023 Activity Recognition Autonomous Driving
Code Code Available Cross-Level Distillation and Feature Denoising for Cross-Domain Few-Shot Classification Nov 4, 2023 Classification Cross-Domain Few-Shot
Code Code Available Implicit Chain of Thought Reasoning via Knowledge Distillation Nov 2, 2023 Knowledge Distillation Math
Code Code Available Multilingual DistilWhisper: Efficient Distillation of Multi-task Speech Models via Language-Specific Experts Nov 2, 2023 Automatic Speech Recognition Automatic Speech Recognition (ASR)
Code Code Available Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models Nov 2, 2023 Data Augmentation Domain Generalization
Code Code Available One-for-All: Bridge the Gap Between Heterogeneous Architectures in Knowledge Distillation Oct 30, 2023 All Knowledge Distillation
Code Code Available Label Poisoning is All You Need Oct 29, 2023 All Backdoor Attack
Code Code Available Understanding the Effects of Projectors in Knowledge Distillation Oct 26, 2023 Knowledge Distillation
Code Code Available MonoSKD: General Distillation Framework for Monocular 3D Object Detection via Spearman Correlation Coefficient Oct 17, 2023 3D Object Detection GPU
Code Code Available Dialogue Chain-of-Thought Distillation for Commonsense-aware Conversational Agents Oct 13, 2023 Informativeness Knowledge Distillation
Code Code Available Transport-Hub-Aware Spatial-Temporal Adaptive Graph Transformer for Traffic Flow Prediction Oct 12, 2023 Incremental Learning Knowledge Distillation
Code Code Available Online Speculative Decoding Oct 11, 2023 Knowledge Distillation
Code Code Available DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation Oct 11, 2023 Decoder fr-en
Code Code Available A Discrepancy Aware Framework for Robust Anomaly Detection Oct 11, 2023 Anomaly Detection Decoder
Code Code Available LumiNet: The Bright Side of Perceptual Knowledge Distillation Oct 5, 2023 Classification Knowledge Distillation
Code Code Available SEA: Sparse Linear Attention with Estimated Attention Mask Oct 3, 2023 Knowledge Distillation Language Modeling
Code Code Available NAYER: Noisy Layer Data Generation for Efficient and Effective Data-free Knowledge Distillation Sep 30, 2023 Data-free Knowledge Distillation Knowledge Distillation
Code Code Available DistillBEV: Boosting Multi-Camera 3D Object Detection with Cross-Modal Knowledge Distillation Sep 26, 2023 3D Object Detection Autonomous Driving
Code Code Available A Sentence Speaks a Thousand Images: Domain Generalization through Distilling CLIP with Language Guidance Sep 21, 2023 Domain Generalization Knowledge Distillation
Code Code Available Weight Averaging Improves Knowledge Distillation under Domain Shift Sep 20, 2023 Domain Generalization Knowledge Distillation
Code Code Available DFIL: Deepfake Incremental Learning by Exploiting Domain-invariant Forgery Clues Sep 18, 2023 Continual Learning Contrastive Learning
Code Code Available FDCNet: Feature Drift Compensation Network for Class-Incremental Weakly Supervised Object Localization Sep 17, 2023 class-incremental learning Incremental Learning
Code Code Available Rethinking Momentum Knowledge Distillation in Online Continual Learning Sep 6, 2023 Continual Learning Knowledge Distillation
Code Code Available COMEDIAN: Self-Supervised Learning and Knowledge Distillation for Action Spotting using Transformers Sep 3, 2023 Action Detection Action Spotting
Code Code Available SpikeBERT: A Language Spikformer Learned from BERT with Knowledge Distillation Aug 29, 2023 Knowledge Distillation text-classification
Code Code Available Bridging Cross-task Protocol Inconsistency for Distillation in Dense Object Detection Aug 28, 2023 Binary Classification Classification
Code Code Available DM-VTON: Distilled Mobile Real-time Virtual Try-On Aug 26, 2023 GPU Human Parsing
Code Code Available Sentence Embedding Models for Ancient Greek Using Multilingual Knowledge Distillation Aug 24, 2023 Authorship Attribution Knowledge Distillation
Code Code Available Ground-to-Aerial Person Search: Benchmark Dataset and Approach Aug 24, 2023 Knowledge Distillation Person Search
Code Code Available FedSOL: Stabilized Orthogonal Learning with Proximal Restrictions in Federated Learning Aug 24, 2023 Continual Learning Federated Learning
Code Code Available SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation Aug 21, 2023 Knowledge Distillation Language Modelling
Code Code Available FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal Heterogeneous Federated Learning Aug 21, 2023 Federated Learning Knowledge Distillation
Code Code Available AltDiffusion: A Multilingual Text-to-Image Diffusion Model Aug 19, 2023 Blocking Concept Alignment
Code Code Available Adapt Your Teacher: Improving Knowledge Distillation for Exemplar-free Continual Learning Aug 18, 2023 class-incremental learning Class Incremental Learning
Code Code Available Token-Scaled Logit Distillation for Ternary Weight Generative Language Models Aug 13, 2023 Arithmetic Reasoning Common Sense Reasoning
Code Code Available Multi-Label Knowledge Distillation Aug 12, 2023 Binary Classification Knowledge Distillation
Code Code Available Multi-View Fusion and Distillation for Subgrade Distresses Detection based on 3D-GPR Aug 9, 2023 GPR Knowledge Distillation
Code Code Available AICSD: Adaptive Inter-Class Similarity Distillation for Semantic Segmentation Aug 8, 2023 Knowledge Distillation Semantic Segmentation
Code Code Available One-stage Low-resolution Text Recognition with High-resolution Knowledge Transfer Aug 5, 2023 Contrastive Learning Knowledge Distillation
Code Code Available VQGraph: Rethinking Graph Representation Space for Bridging GNNs and MLPs Aug 4, 2023 Knowledge Distillation Quantization
Code Code Available Transferable Graph Structure Learning for Graph-based Traffic Forecasting Across Cities Aug 4, 2023 Graph structure learning Knowledge Distillation
Code Code Available Baby Llama: knowledge distillation from an ensemble of teachers trained on a small dataset with no performance penalty Aug 3, 2023 Knowledge Distillation
Code Code Available Beyond Generic: Enhancing Image Captioning with Real-World Knowledge using Vision-Language Pre-Training Model Aug 2, 2023 Hallucination Image Captioning
Code Code Available NormKD: Normalized Logits for Knowledge Distillation Aug 1, 2023 image-classification Image Classification
Code Code Available 