SOTAVerified

Network Pruning

Network Pruning is a popular approach to reduce a heavy network to obtain a light-weight form by removing redundancy in the heavy network. In this approach, a complex over-parameterized network is first trained, then pruned based on come criterions, and finally fine-tuned to achieve comparable performance with reduced parameters.

Source: Ensemble Knowledge Distillation for Learning Improved and Efficient Networks

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 251–300 of 534 papers

TitleStatusHype
Neural Network Pruning Through Constrained Reinforcement Learning—0
Training Deep Neural Networks with Joint Quantization and Pruning of Weights and ActivationsCode1
Differentiable Network Pruning for Microcontrollers—0
Compact CNN Models for On-device Ocular-based User Recognition in Mobile Devices—0
ABCP: Automatic Block-wise and Channel-wise Network Pruning via Joint SearchCode0
Learning Compact Representations of Neural Networks using DiscriminAtive Masking (DAM)Code1
Can network pruning benefit deep learning under label noise?—0
Global Magnitude Pruning With Minimum Threshold Is All We NeedCode0
LEAN: graph-based pruning for convolutional neural networks by extracting longest chains—0
Automated Channel Pruning with Learned Importance—0
Learning Efficient Image Super-Resolution Networks via Structure-Regularized Pruning—0
Efficient Ensembles of Graph Neural Networks—0
Structured Pruning Meets Orthogonality—0
Network Pruning Optimization by Simulated Annealing Algorithm—0
Revisit Kernel Pruning with Lottery Regulated Grouped ConvolutionsCode1
Rethinking Again the Value of Network Pruning -- A Dynamical Isometry Perspective—0
Stabilizing Elastic Weight Consolidation method in practical ML tasks and using weight importances for neural network pruningCode0
Reproducibility Study: Comparing Rewinding and Fine-tuning in Neural Network PruningCode0
Structured Pattern Pruning Using Regularization—0
Causal Explanation of Convolutional Neural NetworksCode0
GDP: Stabilized Neural Network Pruning via Gates with Differentiable Polarization—0
Multistage Pruning of CNN Based ECG Classifiers for Edge Devices—0
New Pruning Method Based on DenseNet Network for Image Classification—0
Pruning in the Face of AdversariesCode0
An Information Theory-inspired Strategy for Automatic Network PruningCode1
Pruning vs XNOR-Net: A Comprehensive Study of Deep Learning for Audio Classification on Edge-devicesCode0
Basis Scaling and Double Pruning for Efficient Inference in Network-Based Transfer Learning—0
Group Fisher Pruning for Practical Network CompressionCode1
How much pre-training is enough to discover a good subnetwork?—0
Model Preserving Compression for Neural NetworksCode0
Manipulating Identical Filter Redundancy for Efficient Pruning on Deep and Complicated CNNCode1
Continual Learning for Task-oriented Dialogue System with Iterative Network Pruning, Expanding and MaskingCode0
Blending Pruning Criteria for Convolutional Neural Networks—0
Model compression as constrained optimization, with application to neural nets. Part V: combining compressionsCode0
Weight Reparametrization for Budget-Aware Network Pruning—0
M-FAC: Efficient Matrix-Free Approximations of Second-Order InformationCode1
Connectivity Matters: Neural Network Pruning Through the Lens of Effective SparsityCode0
A Lottery Ticket Hypothesis Framework for Low-Complexity Device-Robust Neural Acoustic Scene Classification—0
Dep-L_0: Improving L_0-based Network Sparsification via Dependency ModelingCode0
AC/DC: Alternating Compressed/DeCompressed Training of Deep Neural NetworksCode1
Connection Sensitivity Matters for Training-free DARTS: From Architecture-Level Scoring to Operation-Level Sensitivity Analysis—0
Iterative Network Pruning with Uncertainty Regularization for Lifelong Sentiment ClassificationCode0
Cogradient Descent for Dependable LearningCode0
Network Pruning via Performance MaximizationCode0
Sparse Training via Boosting Pruning Plasticity with NeuroregenerationCode1
Heterogeneous Federated Learning using Dynamic Model Pruning and Adaptive Gradient—0
Self-Damaging Contrastive LearningCode1
1xN Pattern for Pruning Convolutional Neural NetworksCode1
Dynamic Probabilistic Pruning: A general framework for hardware-constrained pruning at different granularities—0
A Probabilistic Approach to Neural Network Pruning—0
Show:102550
← PrevPage 6 of 11Next →
All datasetsImageNetImageNet - ResNet 50 - 90% sparsityCIFAR-100CIFAR-10MNIST

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ResNet50-2.3 GFLOPsAccuracy78.79—Unverified
2ResNet50-1.5 GFLOPsAccuracy78.07—Unverified
3ResNet50 2.5 GFLOPSAccuracy78—Unverified
4RegX-1.6GAccuracy77.97—Unverified
5ResNet50 2.0 GFLOPSAccuracy77.7—Unverified
6ResNet50-3G FLOPsAccuracy77.1—Unverified
7ResNet50-2G FLOPsAccuracy76.4—Unverified
8ResNet50-1G FLOPsAccuracy76.38—Unverified
9TAS-pruned ResNet-50Accuracy76.2—Unverified
10ResNet50Accuracy75.59—Unverified
#ModelMetricClaimedVerifiedStatus
1FeatherTop-1 Accuracy76.93—Unverified
2SpartanTop-1 Accuracy76.17—Unverified
3ST-3Top-1 Accuracy76.03—Unverified
4AC/DCTop-1 Accuracy75.64—Unverified
5CSTop-1 Accuracy75.5—Unverified
6ProbMaskTop-1 Accuracy74.68—Unverified
7STRTop-1 Accuracy74.31—Unverified
8DNWTop-1 Accuracy74—Unverified
9GMPTop-1 Accuracy73.91—Unverified
#ModelMetricClaimedVerifiedStatus
1+U-DML*Inference Time (ms)675.56—Unverified
2DenseAccuracy79—Unverified
3AC/DCAccuracy78.2—Unverified
4Beta-RankAccuracy74.01—Unverified
5TAS-pruned ResNet-110Accuracy73.16—Unverified
#ModelMetricClaimedVerifiedStatus
1TAS-pruned ResNet-110Accuracy94.33—Unverified
2ShuffleNet – QuantisedInference Time (ms)23.15—Unverified
3AlexNet – QuantisedInference Time (ms)5.23—Unverified
4MobileNet – QuantisedInference Time (ms)4.74—Unverified
#ModelMetricClaimedVerifiedStatus
1FFN-ShapleyPrunedAvg #Steps12.05—Unverified