SOTAVerified

Network Pruning

Network Pruning is a popular approach to reduce a heavy network to obtain a light-weight form by removing redundancy in the heavy network. In this approach, a complex over-parameterized network is first trained, then pruned based on come criterions, and finally fine-tuned to achieve comparable performance with reduced parameters.

Source: Ensemble Knowledge Distillation for Learning Improved and Efficient Networks

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 351–400 of 534 papers

TitleStatusHype
To prune or not to prune : A chaos-causality approach to principled pruning of dense neural networks—0
Automatic Block-wise Pruning with Auxiliary Gating Structures for Deep Convolutional Neural Networks—0
NTP-INT: Network Traffic Prediction-Driven In-band Network Telemetry for High-load Switches—0
Automated Model Compression by Jointly Applied Pruning and Quantization—0
Data-Independent Neural Pruning via Coresets—0
Towards Communication-Learning Trade-off for Federated Learning at the Network Edge—0
Towards Compact and Robust Deep Neural Networks—0
One-shot Network Pruning at Initialization with Discriminative Image Patches—0
One-Shot Pruning of Recurrent Neural Networks by Jacobian Spectrum Evaluation—0
On Iterative Neural Network Pruning, Reinitialization, and the Similarity of Masks—0
Automated Channel Pruning with Learned Importance—0
On the Decision Boundaries of Deep Neural Networks: A Tropical Geometry Perspective—0
On the Decision Boundaries of Neural Networks: A Tropical Geometry Perspective—0
On the Decision Boundaries of Neural Networks. A Tropical Geometry Perspective—0
On-the-fly Network Pruning for Object Detection—0
On the Landscape of Sparse Linear Networks—0
On the use of local structural properties for improving the efficiency of hierarchical community detection methods—0
Bypass Back-propagation: Optimization-based Structural Pruning for Large Language Models via Policy Gradient—0
Optimization over Trained (and Sparse) Neural Networks: A Surrogate within a Surrogate—0
Optimizing Learning Rate Schedules for Iterative Pruning of Deep Neural Networks—0
Optimizing Memory Placement using Evolutionary Graph Reinforcement Learning—0
Towards Efficient Deep Spiking Neural Networks Construction with Spiking Activity based Pruning—0
Auto Graph Encoder-Decoder for Neural Network Pruning—0
AutoAdversary: A Pixel Pruning Method for Sparse Adversarial Attack—0
Towards Fairness-aware Adversarial Network Pruning—0
Parameter Sharing with Network Pruning for Scalable Multi-Agent Deep Reinforcement Learning—0
A rescaling-invariant Lipschitz bound based on path-metrics for modern ReLU network parameterizations—0
A Unified Approach to Coreset Learning—0
Performance Aware Convolutional Neural Network Channel Pruning for Embedded GPUs—0
Personalized Federated Learning for Generative AI-Assisted Semantic Communications—0
Picking the Underused Heads: A Network Pruning Perspective of Attention Head Selection for Fusing Dialogue Coreference Information—0
Combining Multi-Objective Bayesian Optimization with Reinforcement Learning for TinyML—0
Post-training deep neural network pruning via layer-wise calibration—0
Why Does DARTS Miss the Target, and How Do We Aim to Fix It?—0
Single-path Bit Sharing for Automatic Loss-aware Model Compression—0
Privacy-preserving Learning via Deep Net Pruning—0
Privacy Preserving Stochastic Channel-Based Federated Learning with Neural Network Pruning—0
Probabilistic Modeling: Proving the Lottery Ticket Hypothesis in Spiking Neural Network—0
Progressive Local Filter Pruning for Image Retrieval Acceleration—0
Towards Lightweight Graph Neural Network Search with Curriculum Graph Sparsification—0
Protective Self-Adaptive Pruning to Better Compress DNNs—0
How much pre-training is enough to discover a good subnetwork?—0
Prune Responsibly—0
Pruning a neural network using Bayesian inference—0
Attend Who is Weak: Pruning-assisted Medical Image Localization under Sophisticated and Implicit Imbalances—0
Towards Lightweight Neural Animation : Exploration of Neural Network Pruning in Mixture of Experts-based Animation Models—0
Towards thinner convolutional neural networks through Gradually Global Pruning—0
Pruning CNN's with linear filter ensembles—0
Pruning Compact ConvNets for Efficient Inference—0
A Targeted Acceleration and Compression Framework for Low bit Neural Networks—0
Show:102550
← PrevPage 8 of 11Next →
All datasetsImageNetImageNet - ResNet 50 - 90% sparsityCIFAR-100CIFAR-10MNIST

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ResNet50-2.3 GFLOPsAccuracy78.79—Unverified
2ResNet50-1.5 GFLOPsAccuracy78.07—Unverified
3ResNet50 2.5 GFLOPSAccuracy78—Unverified
4RegX-1.6GAccuracy77.97—Unverified
5ResNet50 2.0 GFLOPSAccuracy77.7—Unverified
6ResNet50-3G FLOPsAccuracy77.1—Unverified
7ResNet50-2G FLOPsAccuracy76.4—Unverified
8ResNet50-1G FLOPsAccuracy76.38—Unverified
9TAS-pruned ResNet-50Accuracy76.2—Unverified
10ResNet50Accuracy75.59—Unverified
#ModelMetricClaimedVerifiedStatus
1FeatherTop-1 Accuracy76.93—Unverified
2SpartanTop-1 Accuracy76.17—Unverified
3ST-3Top-1 Accuracy76.03—Unverified
4AC/DCTop-1 Accuracy75.64—Unverified
5CSTop-1 Accuracy75.5—Unverified
6ProbMaskTop-1 Accuracy74.68—Unverified
7STRTop-1 Accuracy74.31—Unverified
8DNWTop-1 Accuracy74—Unverified
9GMPTop-1 Accuracy73.91—Unverified
#ModelMetricClaimedVerifiedStatus
1+U-DML*Inference Time (ms)675.56—Unverified
2DenseAccuracy79—Unverified
3AC/DCAccuracy78.2—Unverified
4Beta-RankAccuracy74.01—Unverified
5TAS-pruned ResNet-110Accuracy73.16—Unverified
#ModelMetricClaimedVerifiedStatus
1TAS-pruned ResNet-110Accuracy94.33—Unverified
2ShuffleNet – QuantisedInference Time (ms)23.15—Unverified
3AlexNet – QuantisedInference Time (ms)5.23—Unverified
4MobileNet – QuantisedInference Time (ms)4.74—Unverified
#ModelMetricClaimedVerifiedStatus
1FFN-ShapleyPrunedAvg #Steps12.05—Unverified