SOTAVerified

Network Pruning

Network Pruning is a popular approach to reduce a heavy network to obtain a light-weight form by removing redundancy in the heavy network. In this approach, a complex over-parameterized network is first trained, then pruned based on come criterions, and finally fine-tuned to achieve comparable performance with reduced parameters.

Source: Ensemble Knowledge Distillation for Learning Improved and Efficient Networks

Papers

Showing 301325 of 534 papers

TitleStatusHype
PP-StructureV2: A Stronger Document Analysis System0
Privacy-preserving Learning via Deep Net Pruning0
Privacy Preserving Stochastic Channel-Based Federated Learning with Neural Network Pruning0
Probabilistic Modeling: Proving the Lottery Ticket Hypothesis in Spiking Neural Network0
Progressive Local Filter Pruning for Image Retrieval Acceleration0
Protective Self-Adaptive Pruning to Better Compress DNNs0
How much pre-training is enough to discover a good subnetwork?0
Prune Responsibly0
Pruning a neural network using Bayesian inference0
Pruning CNN's with linear filter ensembles0
Pruning Compact ConvNets for Efficient Inference0
Pruning has a disparate impact on model accuracy0
PRUNIX: Non-Ideality Aware Convolutional Neural Network Pruning for Memristive Accelerators0
Putting 3D Spatially Sparse Networks on a Diet0
Rapid Neural Pruning for Novel Datasets with Set-based Task-Adaptive Meta-Pruning0
Rapid Structural Pruning of Neural Networks with Set-based Task-Adaptive Meta-Pruning0
RARTS: An Efficient First-Order Relaxed Architecture Search Method0
Recall Distortion in Neural Network Pruning and the Undecayed Pruning Algorithm0
Recent Advances in Efficient Computation of Deep Convolutional Neural Networks0
Reducing the Model Order of Deep Neural Networks Using Information Theory0
Renormalized Sparse Neural Network Pruning0
Representation and decomposition of functions in DAG-DNNs and structural network pruning0
Resource-Efficient Neural Networks for Embedded Systems0
Resource Efficient Neural Networks Using Hessian Based Pruning0
Rethinking Again the Value of Network Pruning -- A Dynamical Isometry Perspective0
Show:102550
← PrevPage 13 of 22Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ResNet50-2.3 GFLOPsAccuracy78.79Unverified
2ResNet50-1.5 GFLOPsAccuracy78.07Unverified
3ResNet50 2.5 GFLOPSAccuracy78Unverified
4RegX-1.6GAccuracy77.97Unverified
5ResNet50 2.0 GFLOPSAccuracy77.7Unverified
6ResNet50-3G FLOPsAccuracy77.1Unverified
7ResNet50-2G FLOPsAccuracy76.4Unverified
8ResNet50-1G FLOPsAccuracy76.38Unverified
9TAS-pruned ResNet-50Accuracy76.2Unverified
10ResNet50Accuracy75.59Unverified
#ModelMetricClaimedVerifiedStatus
1FeatherTop-1 Accuracy76.93Unverified
2SpartanTop-1 Accuracy76.17Unverified
3ST-3Top-1 Accuracy76.03Unverified
4AC/DCTop-1 Accuracy75.64Unverified
5CSTop-1 Accuracy75.5Unverified
6ProbMaskTop-1 Accuracy74.68Unverified
7STRTop-1 Accuracy74.31Unverified
8DNWTop-1 Accuracy74Unverified
9GMPTop-1 Accuracy73.91Unverified
#ModelMetricClaimedVerifiedStatus
1+U-DML*Inference Time (ms)675.56Unverified
2DenseAccuracy79Unverified
3AC/DCAccuracy78.2Unverified
4Beta-RankAccuracy74.01Unverified
5TAS-pruned ResNet-110Accuracy73.16Unverified
#ModelMetricClaimedVerifiedStatus
1TAS-pruned ResNet-110Accuracy94.33Unverified
2ShuffleNet – QuantisedInference Time (ms)23.15Unverified
3AlexNet – QuantisedInference Time (ms)5.23Unverified
4MobileNet – QuantisedInference Time (ms)4.74Unverified
#ModelMetricClaimedVerifiedStatus
1FFN-ShapleyPrunedAvg #Steps12.05Unverified