SOTAVerified

Model Compression

Model Compression is an actively pursued area of research over the last few years with the goal of deploying state-of-the-art deep networks in low-power and resource limited devices without significant drop in accuracy. Parameter pruning, low-rank factorization and weight quantization are some of the proposed methods to compress the size of deep networks.

Source: KD-MRI: A knowledge distillation framework for image reconstruction and image restoration in MRI workflow

Papers

Showing 13011325 of 1356 papers

TitleStatusHype
Multihop: Leveraging Complex Models to Learn Accurate Simple Models0
Structured Model Pruning for Efficient Inference in Computational Pathology0
Distilling Inductive Bias: Knowledge Distillation Beyond Model Compression0
Bringing AI To Edge: From Deep Learning's Perspective0
Structured Multi-Hashing for Model Compression0
BRIEDGE: EEG-Adaptive Edge AI for Multi-Brain to Multi-Robot Interaction0
Distilling Optimal Neural Networks: Rapid Search in Diverse Spaces0
Distilling Spikes: Knowledge Distillation in Spiking Neural Networks0
Compress and Compare: Interactively Evaluating Efficiency and Behavior Across ML Model Compression Experiments0
Distilling with Performance Enhanced Students0
Distributed Low Precision Training Without Mixed Precision0
Divergent Token Metrics: Measuring degradation to prune away LLM components -- and optimize quantization0
DKM: Differentiable K-Means Clustering Layer for Neural Network Compression0
DLIP: Distilling Language-Image Pre-training0
DMT: Comprehensive Distillation with Multiple Self-supervised Teachers0
DNA data storage, sequencing data-carrying DNA0
DNN Model Compression Under Accuracy Constraints0
Does Learning Require Memorization? A Short Tale about a Long Tail0
Domain Adaptation Regularization for Spectral Pruning0
Domain Generalization on Efficient Acoustic Scene Classification using Residual Normalization0
Don't Be So Dense: Sparse-to-Sparse GAN Training Without Sacrificing Performance0
Don't encrypt the data; just approximate the model \ Towards Secure Transaction and Fair Pricing of Training Data0
Double Viterbi: Weight Encoding for High Compression Ratio and Fast On-Chip Reconstruction for Deep Neural Network0
Bridging the Resource Gap: Deploying Advanced Imitation Learning Models onto Affordable Embedded Platforms0
Dream Distillation: A Data-Independent Model Compression Framework0
Show:102550
← PrevPage 53 of 55Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MobileBERT + 2bit-1dim model compression using DKMAccuracy82.13Unverified
2MobileBERT + 1bit-1dim model compression using DKMAccuracy63.17Unverified