SOTAVerified

Model Compression

Model Compression is an actively pursued area of research over the last few years with the goal of deploying state-of-the-art deep networks in low-power and resource limited devices without significant drop in accuracy. Parameter pruning, low-rank factorization and weight quantization are some of the proposed methods to compress the size of deep networks.

Source: KD-MRI: A knowledge distillation framework for image reconstruction and image restoration in MRI workflow

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1001–1025 of 1356 papers

TitleStatusHype
Privacy-Preserving SAM Quantization for Efficient Edge Intelligence in Healthcare—0
Private Model Compression via Knowledge Distillation—0
Train Flat, Then Compress: Sharpness-Aware Minimization Learns More Compressible Models—0
Inferring ECG from PPG for Continuous Cardiac Monitoring Using Lightweight Neural Network—0
Progressive Weight Pruning of Deep Neural Networks using ADMM—0
Pro-KD: Progressive Distillation by Following the Footsteps of the Teacher—0
ALF: Autoencoder-based Low-rank Filter-sharing for Efficient Convolutional Neural Networks—0
“Learning-Compression” Algorithms for Neural Net Pruning—0
Prototype-based Personalized Pruning—0
Prototypical Contrastive Predictive Coding—0
Provable Benefits of Overparameterization in Model Compression: From Double Descent to Pruning Neural Networks—0
Training Acceleration of Low-Rank Decomposed Networks using Sequential Freezing and Rank Quantization—0
Structured Pruning of a BERT-based Question Answering Model—0
Pruning Algorithms to Accelerate Convolutional Neural Networks for Edge Applications: A Survey—0
Pruning at a Glance: A Structured Class-Blind Pruning Technique for Model Compression—0
Pruning at a Glance: Global Neural Pruning for Model Compression—0
What is Left After Distillation? How Knowledge Transfer Impacts Fairness and Bias—0
A Half-Space Stochastic Projected Gradient Method for Group Sparsity Regularization—0
What is Lost in Knowledge Distillation?—0
Pruning Large Language Models via Accuracy Predictor—0
Aggressive Post-Training Compression on Extremely Large Language Models—0
Pruning Ternary Quantization—0
AfroXLMR-Comet: Multilingual Knowledge Distillation with Attention Matching for Low-Resource languages—0
AACP: Model Compression by Accurate and Automatic Channel Pruning—0
A flexible, extensible software framework for model compression based on the LC algorithm—0
Show:102550
← PrevPage 41 of 55Next →
All datasetsImageNetQNLI

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ADLIK-MO-ResNet50+W4A4Top-177.88—Unverified
2ADLIK-MO-ResNet50+W3A4Top-177.34—Unverified
3ResNet-18 + 4bit-1dim model compression using DKMTop-170.52—Unverified
4MobileNet-v1 + 4bit-1dim model compression using DKMTop-169.63—Unverified
5ResNet-18 + 2bit-1dim model compression using DKMTop-168.63—Unverified
6MobileNet-v1 + 2bit-1dim model compression using DKMTop-167.62—Unverified
7ResNet-18 + 4bit-4dim model compression using DKMTop-166.1—Unverified
8ResNet-18 + 2bit-2dim model compression using DKMTop-164.7—Unverified
9MobileNet-v1 + 4bit-4dim model compression using DKMTop-161.4—Unverified
10ResNet-18 + 1bit-1dim model compression using DKMTop-159.7—Unverified
#ModelMetricClaimedVerifiedStatus
1MobileBERT + 2bit-1dim model compression using DKMAccuracy82.13—Unverified
2MobileBERT + 1bit-1dim model compression using DKMAccuracy63.17—Unverified