SOTAVerified

Network Pruning

Network Pruning is a popular approach to reduce a heavy network to obtain a light-weight form by removing redundancy in the heavy network. In this approach, a complex over-parameterized network is first trained, then pruned based on come criterions, and finally fine-tuned to achieve comparable performance with reduced parameters.

Source: Ensemble Knowledge Distillation for Learning Improved and Efficient Networks

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 301–325 of 534 papers

TitleStatusHype
Troubleshooting Blind Image Quality Models in the Wild—0
Dynamical Isometry: The Missing Ingredient for Neural Network Pruning—0
Network Pruning That Matters: A Case Study on Retraining VariantsCode1
Effective Sparsification of Neural Networks with Global Sparsity ConstraintCode1
Post-training deep neural network pruning via layer-wise calibration—0
Lottery Jackpots Exist in Pre-trained ModelsCode1
Rethinking Network Pruning -- under the Pre-train and Fine-tune ParadigmCode0
Convolutional Neural Network Pruning with Structural Redundancy Reduction—0
EfficientTDNN: Efficient Architecture Search for Speaker RecognitionCode1
Cascade Weight Shedding in Deep Neural Networks: Benefits and Pitfalls for Network Pruning—0
Recent Advances on Neural Network Pruning at InitializationCode1
Manifold Regularized Dynamic Network PruningCode1
Understanding Diversity Based Neural Network Pruning in Teacher Student Setup—0
Lost in Pruning: The Effects of Pruning Neural Networks beyond Test Accuracy—0
Network Pruning via Resource ReallocationCode1
Knowledge Distillation Circumvents Nonlinearity for Optical Convolutional Neural Networks—0
Feature Selection for Multivariate Time Series via Network PruningCode0
Topology-Aware Network Pruning using Multi-stage Graph Embedding and Reinforcement LearningCode1
Network Pruning using Adaptive Exemplar FiltersCode1
Multi-Task Network Pruning and Embedded Optimization for Real-time Deployment in ADAS—0
Network Automatic Pruning: Start NAP and Take a Nap—0
Single-path Bit Sharing for Automatic Loss-aware Model Compression—0
Max-Affine Spline Insights Into Deep Network PruningCode0
CAP-Context-Aware-Pruning-for-Semantic-Segmentation—0
CAP: Context-Aware Pruning for Semantic-Segmentation—0
Show:102550
← PrevPage 13 of 22Next →
All datasetsImageNetImageNet - ResNet 50 - 90% sparsityCIFAR-100CIFAR-10MNIST

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ResNet50-2.3 GFLOPsAccuracy78.79—Unverified
2ResNet50-1.5 GFLOPsAccuracy78.07—Unverified
3ResNet50 2.5 GFLOPSAccuracy78—Unverified
4RegX-1.6GAccuracy77.97—Unverified
5ResNet50 2.0 GFLOPSAccuracy77.7—Unverified
6ResNet50-3G FLOPsAccuracy77.1—Unverified
7ResNet50-2G FLOPsAccuracy76.4—Unverified
8ResNet50-1G FLOPsAccuracy76.38—Unverified
9TAS-pruned ResNet-50Accuracy76.2—Unverified
10ResNet50Accuracy75.59—Unverified
#ModelMetricClaimedVerifiedStatus
1FeatherTop-1 Accuracy76.93—Unverified
2SpartanTop-1 Accuracy76.17—Unverified
3ST-3Top-1 Accuracy76.03—Unverified
4AC/DCTop-1 Accuracy75.64—Unverified
5CSTop-1 Accuracy75.5—Unverified
6ProbMaskTop-1 Accuracy74.68—Unverified
7STRTop-1 Accuracy74.31—Unverified
8DNWTop-1 Accuracy74—Unverified
9GMPTop-1 Accuracy73.91—Unverified
#ModelMetricClaimedVerifiedStatus
1+U-DML*Inference Time (ms)675.56—Unverified
2DenseAccuracy79—Unverified
3AC/DCAccuracy78.2—Unverified
4Beta-RankAccuracy74.01—Unverified
5TAS-pruned ResNet-110Accuracy73.16—Unverified
#ModelMetricClaimedVerifiedStatus
1TAS-pruned ResNet-110Accuracy94.33—Unverified
2ShuffleNet – QuantisedInference Time (ms)23.15—Unverified
3AlexNet – QuantisedInference Time (ms)5.23—Unverified
4MobileNet – QuantisedInference Time (ms)4.74—Unverified
#ModelMetricClaimedVerifiedStatus
1FFN-ShapleyPrunedAvg #Steps12.05—Unverified