SOTAVerified

Model Compression

Model Compression is an actively pursued area of research over the last few years with the goal of deploying state-of-the-art deep networks in low-power and resource limited devices without significant drop in accuracy. Parameter pruning, low-rank factorization and weight quantization are some of the proposed methods to compress the size of deep networks.

Source: KD-MRI: A knowledge distillation framework for image reconstruction and image restoration in MRI workflow

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 901–950 of 1356 papers

TitleStatusHype
Analysis of memory consumption by neural networks based on hyperparameters—0
Neural Regularized Domain Adaptation for Chinese Word Segmentation—0
NeuSemSlice: Towards Effective DNN Model Maintenance via Neuron-level Semantic Slicing—0
Noisy Neural Network Compression for Analog Storage Devices—0
Understanding the Performance Horizon of the Latest ML Workloads with NonGEMM Workloads—0
Non-Structured DNN Weight Pruning -- Is It Beneficial in Any Platform?—0
Normalized Feature Distillation for Semantic Segmentation—0
Norm Tweaking: High-performance Low-bit Quantization of Large Language Models—0
NurtureNet: A Multi-task Video-based Approach for Newborn Anthropometry—0
NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models—0
NVRC: Neural Video Representation Compression—0
oBERTa: Improving Sparse Transfer Learning via improved initialization, distillation, and pruning regimes—0
Towards efficient deep autoencoders for multivariate time series anomaly detection—0
An Algorithm-Hardware Co-Optimized Framework for Accelerating N:M Sparse Transformers—0
On Accelerating Edge AI: Optimizing Resource-Constrained Environments—0
On Achieving Privacy-Preserving State-of-the-Art Edge Intelligence—0
Data-Independent Neural Pruning via Coresets—0
On Attention Redundancy: A Comprehensive Study—0
Onboard Optimization and Learning: A Survey—0
Once-Tuning-Multiple-Variants: Tuning Once and Expanded as Multiple Vision-Language Model Variants—0
On-Device Document Classification using multimodal features—0
An Efficient Real-Time Object Detection Framework on Resource-Constricted Hardware Devices via Software and Hardware Co-design—0
Towards Efficient Deep Spiking Neural Networks Construction with Spiking Activity based Pruning—0
On-Device Qwen2.5: Efficient LLM Inference with Model Compression and Hardware Acceleration—0
One-Shot Model for Mixed-Precision Quantization—0
One Teacher is Enough? Pre-trained Language Model Distillation from Multiple Teachers—0
One Weight Bitwidth to Rule Them All—0
On Linearizing Structured Data in Encoder-Decoder Language Models: Insights from Text-to-SQL—0
Online Cross-Layer Knowledge Distillation on Graph Neural Networks with Deep Supervision—0
Towards Efficient Full 8-bit Integer DNN Online Training on Resource-limited Devices without Batch Normalization—0
A Model Compression Method with Matrix Product Operators for Speech Enhancement—0
Online Model Compression for Federated Learning with Large Models—0
On Multilingual Encoder Language Model Compression for Low-Resource Languages—0
On the Adversarial Robustness of Quantized Neural Networks—0
On the Compression of Recurrent Neural Networks with an Application to LVCSR acoustic modeling for Embedded Speech Recognition—0
On the Demystification of Knowledge Distillation: A Residual Network Perspective—0
Towards Efficient Tensor Decomposition-Based DNN Model Compression with Optimization Framework—0
On the Effectiveness of Low-Rank Matrix Factorization for LSTM Model Compression—0
On the Impact of Quantization and Pruning of Self-Supervised Speech Models for Downstream Speech Recognition Tasks "In-the-Wild''—0
On the social bias of speech self-supervised models—0
Weight Squeezing: Reparameterization for Knowledge Transfer and Model Compression—0
A Mixed Integer Programming Approach for Verifying Properties of Binarized Neural Networks—0
Optimal Policy Sparsification and Low Rank Decomposition for Deep Reinforcement Learning—0
Optimising TinyML with Quantization and Distillation of Transformer and Mamba Models for Indoor Localisation on Edge Devices—0
Optimization and Scalability of Collaborative Filtering Algorithms in Large Language Models—0
Optimize Deep Convolutional Neural Network with Ternarized Weights and High Accuracy—0
Optimizing LLMs for Resource-Constrained Environments: A Survey of Model Compression Techniques—0
Optimizing Singular Spectrum for Large Language Model Compression—0
Optimizing Small Language Models for In-Vehicle Function-Calling—0
Optimizing Traffic Signal Control using High-Dimensional State Representation and Efficient Deep Reinforcement Learning—0
Show:102550
← PrevPage 19 of 28Next →
All datasetsImageNetQNLI

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ADLIK-MO-ResNet50+W4A4Top-177.88—Unverified
2ADLIK-MO-ResNet50+W3A4Top-177.34—Unverified
3ResNet-18 + 4bit-1dim model compression using DKMTop-170.52—Unverified
4MobileNet-v1 + 4bit-1dim model compression using DKMTop-169.63—Unverified
5ResNet-18 + 2bit-1dim model compression using DKMTop-168.63—Unverified
6MobileNet-v1 + 2bit-1dim model compression using DKMTop-167.62—Unverified
7ResNet-18 + 4bit-4dim model compression using DKMTop-166.1—Unverified
8ResNet-18 + 2bit-2dim model compression using DKMTop-164.7—Unverified
9MobileNet-v1 + 4bit-4dim model compression using DKMTop-161.4—Unverified
10ResNet-18 + 1bit-1dim model compression using DKMTop-159.7—Unverified
#ModelMetricClaimedVerifiedStatus
1MobileBERT + 2bit-1dim model compression using DKMAccuracy82.13—Unverified
2MobileBERT + 1bit-1dim model compression using DKMAccuracy63.17—Unverified