SOTAVerified

Model Compression

Model Compression is an actively pursued area of research over the last few years with the goal of deploying state-of-the-art deep networks in low-power and resource limited devices without significant drop in accuracy. Parameter pruning, low-rank factorization and weight quantization are some of the proposed methods to compress the size of deep networks.

Source: KD-MRI: A knowledge distillation framework for image reconstruction and image restoration in MRI workflow

Papers

Showing 11761200 of 1356 papers

TitleStatusHype
Extremely Small BERT Models from Mixed-Vocabulary Training0
Atomic Compression Networks0
Network Pruning for Low-Rank Binary Index0
GQ-Net: Training Quantization-Friendly Deep Networks0
Decoupling Weight Regularization from Batch Size for Model Compression0
Balancing Specialization, Generalization, and Compression for Detection and Tracking0
Class-dependent Compression of Deep Neural NetworksCode0
Differentiable Mask for Pruning Convolutional and Recurrent Networks0
PCONV: The Missing but Desirable Sparsity in DNN Weight Pruning for Real-time Execution on Mobile Devices0
LIT: Learned Intermediate Representation Training for Model CompressionCode0
Knowledge Distillation for End-to-End Person SearchCode0
Tiny but Accurate: A Pruned, Quantized and Optimized Memristor Crossbar Framework for Ultra Efficient DNN Implementation0
On the Effectiveness of Low-Rank Matrix Factorization for LSTM Model Compression0
Patient Knowledge Distillation for BERT Model CompressionCode0
MobiSR: Efficient On-Device Super-Resolution through Heterogeneous Mobile Processors0
Einconv: Exploring Unexplored Tensor Network Decompositions for Convolutional Neural NetworksCode0
Tuning Algorithms and Generators for Efficient Edge Inference0
Memory- and Communication-Aware Model Compression for Distributed Deep Learning Inference on IoT0
Real-Time Correlation Tracking via Joint Model Compression and TransferCode0
Light Multi-segment Activation for Model CompressionCode0
Neural Epitome Search for Architecture-Agnostic Network Compression0
Data-Independent Neural Pruning via Coresets0
ShrinkML: End-to-End ASR Model Compression Using Reinforcement Learning0
AutoCompress: An Automatic DNN Structured Pruning Framework for Ultra-High Compression Rates0
Non-Structured DNN Weight Pruning -- Is It Beneficial in Any Platform?0
Show:102550
← PrevPage 48 of 55Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MobileBERT + 2bit-1dim model compression using DKMAccuracy82.13Unverified
2MobileBERT + 1bit-1dim model compression using DKMAccuracy63.17Unverified