SOTAVerified

Model Compression

Model Compression is an actively pursued area of research over the last few years with the goal of deploying state-of-the-art deep networks in low-power and resource limited devices without significant drop in accuracy. Parameter pruning, low-rank factorization and weight quantization are some of the proposed methods to compress the size of deep networks.

Source: KD-MRI: A knowledge distillation framework for image reconstruction and image restoration in MRI workflow

Papers

Showing 12511275 of 1356 papers

TitleStatusHype
GASL: Guided Attention for Sparsity Learning in Deep Neural NetworksCode0
Exploring the 3D architectures of deep material network in data-driven multiscale mechanics0
Natively Interpretable Machine Learning and Artificial Intelligence: Preliminary Results and Future Directions0
Learning Efficient Detector with Semi-supervised Adaptive DistillationCode0
A Low Effort Approach to Structured CNN Design Using PCA0
Exploiting Kernel Sparsity and Entropy for Interpretable CNN CompressionCode0
Stochastic Model Pruning via Weight Dropping Away and Back0
Teacher-Student Compression with Generative Adversarial NetworksCode0
Leveraging Filter Correlations for Deep Model Compression0
A Survey of Mobile Computing for the Visually Impaired0
Joint Neural Architecture Search and Quantization0
Graph-Adaptive Pruning for Efficient Inference of Convolutional Neural Networks0
Stability Based Filter Pruning for Accelerating Deep CNNs0
Three Dimensional Convolutional Neural Network Pruning with Regularization-Based Method0
Private Model Compression via Knowledge Distillation0
Sequence-Level Knowledge Distillation for Model Compression of Attention-based Sequence-to-Sequence Speech Recognition0
FLOPs as a Direct Optimization Objective for Learning Sparse Neural Networks0
A Unified Framework of DNN Weight Pruning and Weight Clustering/Quantization Using ADMM0
JavaScript Convolutional Neural Networks for Keyword Spotting in the Browser: An Experimental AnalysisCode0
DeepTwist: Learning Model Compression via Occasional Weight Distortion0
A Miniaturized Semantic Segmentation Method for Remote Sensing ImageCode0
Distilling with Performance Enhanced Students0
To Compress, or Not to Compress: Characterizing Deep Learning Model Compression for Embedded Inference0
Pruning at a Glance: A Structured Class-Blind Pruning Technique for Model Compression0
Compression of Deep Neural Networks by combining pruning and low rank decomposition0
Show:102550
← PrevPage 51 of 55Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MobileBERT + 2bit-1dim model compression using DKMAccuracy82.13Unverified
2MobileBERT + 1bit-1dim model compression using DKMAccuracy63.17Unverified