SOTAVerified

Model Compression

Model Compression is an actively pursued area of research over the last few years with the goal of deploying state-of-the-art deep networks in low-power and resource limited devices without significant drop in accuracy. Parameter pruning, low-rank factorization and weight quantization are some of the proposed methods to compress the size of deep networks.

Source: KD-MRI: A knowledge distillation framework for image reconstruction and image restoration in MRI workflow

Papers

Showing 676700 of 1356 papers

TitleStatusHype
Radio: Rate-Distortion Optimization for Large Language Model Compression0
Random Conditioning for Diffusion Model Compression with Distillation0
Random Conditioning with Distillation for Data-Efficient Diffusion Model Compression0
Random Offset Block Embedding Array (ROBE) for CriteoTB Benchmark MLPerf DLRM Model : 1000 Compression and 3.1 Faster Inference0
RAND: Robustness Aware Norm Decay For Quantized Seq2seq Models0
Rank-Based Filter Pruning for Real-Time UAV Tracking0
RankDVQA-mini: Knowledge Distillation-Driven Deep Video Quality Assessment0
Rapid Deployment of DNNs for Edge Computing via Structured Pruning at Initialization0
Rate Distortion For Model Compression: From Theory To Practice0
Experimental implementation of a neural network optical channel equalizer in restricted hardware using pruning and quantization0
Real time backbone for semantic segmentation0
Membership Privacy for Machine Learning Models Through Knowledge Transfer0
Rectifying the Data Bias in Knowledge Distillation0
Recurrent Convolution for Compact and Cost-Adjustable Neural Networks: An Empirical Study0
Recurrent Convolutions: A Model Compression Point of View0
Reducing Computational Complexity of Neural Networks in Optical Channel Equalization: From Concepts to Implementation0
Reinforced Multi-Teacher Selection for Knowledge Distillation0
Relationship between Model Compression and Adversarial Robustness: A Review of Current Evidence0
Re-Parameterization of Lightweight Transformer for On-Device Speech Emotion Recognition0
RepControlNet: ControlNet Reparameterization0
Representation Transfer by Optimal Transport0
REQ-YOLO: A Resource-Aware, Efficient Quantization Framework for Object Detection on FPGAs0
Residual Knowledge Distillation0
ResOT: Resource-Efficient Oblique Trees for Neural Signal Classification0
Resource Allocation for Compression-aided Federated Learning with High Distortion Rate0
Show:102550
← PrevPage 28 of 55Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MobileBERT + 2bit-1dim model compression using DKMAccuracy82.13Unverified
2MobileBERT + 1bit-1dim model compression using DKMAccuracy63.17Unverified