SOTAVerified

Model Compression

Model Compression is an actively pursued area of research over the last few years with the goal of deploying state-of-the-art deep networks in low-power and resource limited devices without significant drop in accuracy. Parameter pruning, low-rank factorization and weight quantization are some of the proposed methods to compress the size of deep networks.

Source: KD-MRI: A knowledge distillation framework for image reconstruction and image restoration in MRI workflow

Papers

Showing 10011025 of 1356 papers

TitleStatusHype
Mobile Fitting Room: On-device Virtual Try-on via Diffusion Models0
MoDeGPT: Modular Decomposition for Large Language Model Compression0
Model Adaptation for Time Constrained Embodied Control0
Model Blending for Text Classification0
Model Compression0
Model Compression and Efficient Inference for Large Language Models: A Survey0
Model compression as constrained optimization, with application to neural nets. Part II: quantization0
Model compression as constrained optimization, with application to neural nets. Part I: general framework0
Model compression as constrained optimization, with application to neural nets. Part V: combining compressions0
Scalable Model Compression by Entropy Penalized Reparameterization0
Model Compression for DNN-based Speaker Verification Using Weight Quantization0
Model compression for faster structural separation of macromolecules captured by Cellular Electron Cryo-Tomography0
Model Compression for Resource-Constrained Mobile Robots0
Model Compression in Practice: Lessons Learned from Practitioners Creating On-device Machine Learning Experiences0
Model Compression Methods for YOLOv5: A Review0
Model compression using knowledge distillation with integrated gradients0
Model Compression Using Optimal Transport0
Model Compression via Hyper-Structure Network0
Model Compression via Symmetries of the Parameter Space0
Model Compression with Generative Adversarial Networks0
Model Compression with Multi-Task Knowledge Distillation for Web-scale Question Answering System0
Model Compression with Two-stage Multi-teacher Knowledge Distillation for Web Question Answering System0
Model Distillation with Knowledge Transfer from Face Classification to Alignment and Verification0
On Cross-Layer Alignment for Model Fusion of Heterogeneous Neural Networks0
A Light-weight Deep Human Activity Recognition Algorithm Using Multi-knowledge Distillation0
Show:102550
← PrevPage 41 of 55Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MobileBERT + 2bit-1dim model compression using DKMAccuracy82.13Unverified
2MobileBERT + 1bit-1dim model compression using DKMAccuracy63.17Unverified