SOTAVerified

Network Pruning

Network Pruning is a popular approach to reduce a heavy network to obtain a light-weight form by removing redundancy in the heavy network. In this approach, a complex over-parameterized network is first trained, then pruned based on come criterions, and finally fine-tuned to achieve comparable performance with reduced parameters.

Source: Ensemble Knowledge Distillation for Learning Improved and Efficient Networks

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 251–300 of 534 papers

TitleStatusHype
Adversarial Robustness of Distilled and Pruned Deep Learning-based Wireless Classifiers—0
Importance Estimation with Random Gradient for Neural Network Pruning—0
Improve Convolutional Neural Network Pruning by Maximizing Filter Variety—0
ADMP: An Adversarial Double Masks Based Pruning Framework For Unsupervised Cross-Domain Compression—0
Adaptive Neural Connections for Sparsity Learning—0
Spectral Analysis for Semantic Segmentation with Applications on Feature Truncation and Weak Annotation—0
Channel-wise pruning of neural networks with tapering resource constraint—0
Heterogeneous Federated Learning using Dynamic Model Pruning and Adaptive Gradient—0
Channel Planting for Deep Neural Networks using Knowledge Distillation—0
SqueezerFaceNet: Reducing a Small Face Recognition CNN Even More Via Filter Pruning—0
Iteratively Training Look-Up Tables for Network Quantization—0
Accelerating Convolutional Neural Network Pruning via Spatial Aura Entropy—0
Certified Invertibility in Neural Networks via Mixed-Integer Programming—0
Joint Regularization on Activations and Weights for Efficient Neural Network Pruning—0
Cascade Weight Shedding in Deep Neural Networks: Benefits and Pitfalls for Network Pruning—0
Knowledge Distillation Circumvents Nonlinearity for Optical Convolutional Neural Networks—0
Weight Reparametrization for Budget-Aware Network Pruning—0
Streamlining Tensor and Network Pruning in PyTorch—0
On the Landscape of One-hidden-layer Sparse Networks and Beyond—0
Layer-adaptive Structured Pruning Guided by Latency—0
CWP: Instance complexity weighted channel-wise soft masks for network pruning—0
Structural Alignment for Network Pruning through Partial Regularization—0
Structurally Prune Anything: Any Architecture, Any Framework, Any Time—0
LEAN: graph-based pruning for convolutional neural networks by extracting longest chains—0
Learning ASR pathways: A sparse multilingual ASR model—0
Learning Compact Neural Networks with Regularization—0
CAP: Context-Aware Pruning for Semantic-Segmentation—0
Learning Efficient Image Super-Resolution Networks via Structure-Regularized Pruning—0
LearningGroup: A Real-Time Sparse Training on FPGA via Learnable Weight Grouping for Multi-Agent Reinforcement Learning—0
Accelerate CNNs from Three Dimensions: A Comprehensive Pruning Framework—0
Learning Pruned Structure and Weights Simultaneously from Scratch: an Attention based Approach—0
Structured Deep Neural Network Pruning via Matrix Pivoting—0
Learning Sparse Structured Ensembles with SG-MCMC and Network Pruning—0
Structured Network Pruning by Measuring Filter-wise Interactions—0
Less is More: The Influence of Pruning on the Explainability of CNNs—0
CAP-Context-Aware-Pruning-for-Semantic-Segmentation—0
Linear Mode Connectivity in Sparse Neural Networks—0
Lipschitz Constant Meets Condition Number: Learning Robust and Compact Deep Neural Networks—0
Structured Pattern Pruning Using Regularization—0
LNPT: Label-free Network Pruning and Training—0
Long Live the Lottery: The Existence of Winning Tickets in Lifelong Learning—0
Adaptive Consensus: A network pruning approach for decentralized optimization—0
Can We Find Strong Lottery Tickets in Generative Models?—0
Can network pruning benefit deep learning under label noise?—0
Low-Rank Prune-And-Factorize for Language Model Compression—0
Structured Pruning Meets Orthogonality—0
C2S2: Cost-aware Channel Sparse Selection for Progressive Network Pruning—0
Brain-Inspired Efficient Pruning: Exploiting Criticality in Spiking Neural Networks—0
MARS: Multi-macro Architecture SRAM CIM-Based Accelerator with Co-designed Compressed Neural Networks—0
MaskConvNet: Training Efficient ConvNets from Scratch via Budget-constrained Filter Pruning—0
Show:102550
← PrevPage 6 of 11Next →
All datasetsImageNetImageNet - ResNet 50 - 90% sparsityCIFAR-100CIFAR-10MNIST

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ResNet50-2.3 GFLOPsAccuracy78.79—Unverified
2ResNet50-1.5 GFLOPsAccuracy78.07—Unverified
3ResNet50 2.5 GFLOPSAccuracy78—Unverified
4RegX-1.6GAccuracy77.97—Unverified
5ResNet50 2.0 GFLOPSAccuracy77.7—Unverified
6ResNet50-3G FLOPsAccuracy77.1—Unverified
7ResNet50-2G FLOPsAccuracy76.4—Unverified
8ResNet50-1G FLOPsAccuracy76.38—Unverified
9TAS-pruned ResNet-50Accuracy76.2—Unverified
10ResNet50Accuracy75.59—Unverified
#ModelMetricClaimedVerifiedStatus
1FeatherTop-1 Accuracy76.93—Unverified
2SpartanTop-1 Accuracy76.17—Unverified
3ST-3Top-1 Accuracy76.03—Unverified
4AC/DCTop-1 Accuracy75.64—Unverified
5CSTop-1 Accuracy75.5—Unverified
6ProbMaskTop-1 Accuracy74.68—Unverified
7STRTop-1 Accuracy74.31—Unverified
8DNWTop-1 Accuracy74—Unverified
9GMPTop-1 Accuracy73.91—Unverified
#ModelMetricClaimedVerifiedStatus
1+U-DML*Inference Time (ms)675.56—Unverified
2DenseAccuracy79—Unverified
3AC/DCAccuracy78.2—Unverified
4Beta-RankAccuracy74.01—Unverified
5TAS-pruned ResNet-110Accuracy73.16—Unverified
#ModelMetricClaimedVerifiedStatus
1TAS-pruned ResNet-110Accuracy94.33—Unverified
2ShuffleNet – QuantisedInference Time (ms)23.15—Unverified
3AlexNet – QuantisedInference Time (ms)5.23—Unverified
4MobileNet – QuantisedInference Time (ms)4.74—Unverified
#ModelMetricClaimedVerifiedStatus
1FFN-ShapleyPrunedAvg #Steps12.05—Unverified