SOTAVerified

Model Compression

Model Compression is an actively pursued area of research over the last few years with the goal of deploying state-of-the-art deep networks in low-power and resource limited devices without significant drop in accuracy. Parameter pruning, low-rank factorization and weight quantization are some of the proposed methods to compress the size of deep networks.

Source: KD-MRI: A knowledge distillation framework for image reconstruction and image restoration in MRI workflow

Papers

Showing 10761100 of 1356 papers

TitleStatusHype
ResOT: Resource-Efficient Oblique Trees for Neural Signal Classification0
Resource Allocation for Compression-aided Federated Learning with High Distortion Rate0
TutorNet: Towards Flexible Knowledge Distillation for End-to-End Speech Recognition0
ResSVD: Residual Compensated SVD for Large Language Model Compression0
ADC/DAC-Free Analog Acceleration of Deep Neural Networks with Frequency Transformation0
Retraining-Based Iterative Weight Quantization for Deep Neural Networks0
AdaSpring: Context-adaptive and Runtime-evolutionary Deep Model Compression for Mobile Applications0
Retrieval-based Knowledge Transfer: An Effective Approach for Extreme Large Language Model Compression0
Reverse-engineering recurrent neural network solutions to a hierarchical inference task for mice0
Reversible Watermarking in Deep Convolutional Neural Networks for Integrity Authentication0
Revisiting Data Augmentation in Model Compression: An Empirical and Comprehensive Study0
Revisiting Self-Distillation0
Reweighted Solutions for Weighted Low Rank Approximation0
Riemannian Low-Rank Model Compression for Federated Learning with Over-the-Air Aggregation0
RingMoE: Mixture-of-Modality-Experts Multi-Modal Foundation Models for Universal Remote Sensing Image Interpretation0
RLRC: Reinforcement Learning-based Recovery for Compressed Vision-Language-Action Models0
Adaptive Learning of Tensor Network Structures0
Robot Intent Recognition Method Based on State Grid Business Office0
TwinDNN: A Tale of Two Deep Neural Networks0
Two-Bit Networks for Deep Learning on Resource-Constrained Embedded Devices0
Two is Better than One: Efficient Ensemble Defense for Robust and Compact Models0
Two-Pass End-to-End ASR Model Compression0
Robustness-Guided Image Synthesis for Data-Free Quantization0
Robustness in Compressed Neural Networks for Object Detection0
Robust testing of low-dimensional functions0
Show:102550
← PrevPage 44 of 55Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MobileBERT + 2bit-1dim model compression using DKMAccuracy82.13Unverified
2MobileBERT + 1bit-1dim model compression using DKMAccuracy63.17Unverified