SOTAVerified

Model Compression

Model Compression is an actively pursued area of research over the last few years with the goal of deploying state-of-the-art deep networks in low-power and resource limited devices without significant drop in accuracy. Parameter pruning, low-rank factorization and weight quantization are some of the proposed methods to compress the size of deep networks.

Source: KD-MRI: A knowledge distillation framework for image reconstruction and image restoration in MRI workflow

Papers

Showing 751775 of 1356 papers

TitleStatusHype
Sometimes Painful but Certainly Promising: Feasibility and Trade-offs of Language Model Inference at the Edge0
SpaLLM: Unified Compressive Adaptation of Large Language Models with Sketching0
Sparse Deep Learning for Time Series Data: Theory and Applications0
Sparse Unbalanced GAN Training with In-Time Over-Parameterization0
Spatio-Temporal Pruning and Quantization for Low-latency Spiking Neural Networks0
Compressible Spectral Mixture Kernels with Sparse Dependency Structures for Gaussian Processes0
Spectral Pruning: Compressing Deep Neural Networks via Spectral Analysis and its Generalization Error0
Speeding up Convolutional Neural Networks with Low Rank Expansions0
Speeding Up Image Classifiers with Little Companions0
Spirit Distillation: A Model Compression Method with Multi-domain Knowledge Transfer0
Sponge Attacks on Sensing AI: Energy-Latency Vulnerabilities and Defense via Model Pruning0
SS-Auto: A Single-Shot, Automatic Structured Weight Pruning Framework of DNNs with Ultra-High Efficiency0
Stability Based Filter Pruning for Accelerating Deep CNNs0
Effective Model Compression via Stage-wise Pruning0
Statistical Model Compression for Small-Footprint Natural Language Understanding0
Strategic Fusion Optimizes Transformer Compression0
Streamlining Tensor and Network Pruning in PyTorch0
Structured Bayesian Compression for Deep Neural Networks Based on The Turbo-VBI Approach0
Structured Compression by Weight Encryption for Unstructured Pruning and Quantization0
Structured Convolutions for Efficient Neural Network Design0
Structured Model Pruning for Efficient Inference in Computational Pathology0
Structured Multi-Hashing for Model Compression0
Structured Pruning for Multi-Task Deep Neural Networks0
Structured Pruning is All You Need for Pruning CNNs at Initialization0
Structured Pruning Learns Compact and Accurate Models0
Show:102550
← PrevPage 31 of 55Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MobileBERT + 2bit-1dim model compression using DKMAccuracy82.13Unverified
2MobileBERT + 1bit-1dim model compression using DKMAccuracy63.17Unverified