SOTAVerified

Model Compression

Model Compression is an actively pursued area of research over the last few years with the goal of deploying state-of-the-art deep networks in low-power and resource limited devices without significant drop in accuracy. Parameter pruning, low-rank factorization and weight quantization are some of the proposed methods to compress the size of deep networks.

Source: KD-MRI: A knowledge distillation framework for image reconstruction and image restoration in MRI workflow

Papers

Showing 13261350 of 1356 papers

TitleStatusHype
Dreaming To Prune Image Deraining Networks0
Stochastic Model Pruning via Weight Dropping Away and Back0
Bridging the Gap Between Foundation Models and Heterogeneous Federated Learning0
Dual Discriminator Adversarial Distillation for Data-free Model Compression0
Boosting Graph Neural Networks via Adaptive Knowledge Distillation0
Dual sparse training framework: inducing activation map sparsity via Transformed 1 regularization0
Structured Pruning for Multi-Task Deep Neural Networks0
Dynamically Hierarchy Revolution: DirNet for Compressing Recurrent Neural Network on Mobile Devices0
Block-wise Intermediate Representation Training for Model Compression0
Block Skim Transformer for Efficient Question Answering0
Dynamic Model Pruning with Feedback0
Dynamic Probabilistic Pruning: Training sparse networks based on stochastic and dynamic masking0
Structured Pruning is All You Need for Pruning CNNs at Initialization0
Blending LSTMs into CNNs0
Dynamic Sparse Learning: A Novel Paradigm for Efficient Recommendation0
DynaQuant: Compressing Deep Learning Training Checkpoints via Dynamic Quantization0
Structured Pruning Learns Compact and Accurate Models0
BioNetExplorer: Architecture-Space Exploration of Bio-Signal Processing Deep Neural Networks for Wearables0
ECoFLaP: Efficient Coarse-to-Fine Layer-Wise Pruning for Vision-Language Models0
EDCompress: Energy-Aware Model Compression for Dataflows0
Edge AI: Evaluation of Model Compression Techniques for Convolutional Neural Networks0
Edge-AI for Agriculture: Lightweight Vision Models for Disease Detection in Resource-Limited Settings0
Edge Deep Learning for Neural Implants0
Edge-First Language Model Inference: Models, Metrics, and Tradeoffs0
Edge-MultiAI: Multi-Tenancy of Latency-Sensitive Deep Learning Applications on Edge0
Show:102550
← PrevPage 54 of 55Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MobileBERT + 2bit-1dim model compression using DKMAccuracy82.13Unverified
2MobileBERT + 1bit-1dim model compression using DKMAccuracy63.17Unverified