Network Pruning

Network Pruning is a popular approach to reduce a heavy network to obtain a light-weight form by removing redundancy in the heavy network. In this approach, a complex over-parameterized network is first trained, then pruned based on come criterions, and finally fine-tuned to achieve comparable performance with reduced parameters.

Source: Ensemble Knowledge Distillation for Learning Improved and Efficient Networks

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 276–300 of 534 papers

Title	Date	Tasks	Status	Hype
Pruning vs XNOR-Net: A Comprehensive Study of Deep Learning for Audio Classification on Edge-devices	Aug 13, 2021	Audio ClassificationClassification	CodeCode Available	0
Basis Scaling and Double Pruning for Efficient Inference in Network-Based Transfer Learning	Aug 6, 2021	Network PruningTransfer Learning	—Unverified	0
Group Fisher Pruning for Practical Network Compression	Aug 2, 2021	image-classificationImage Classification	CodeCode Available	1
How much pre-training is enough to discover a good subnetwork?	Jul 31, 2021	Network Pruning	—Unverified	0
Model Preserving Compression for Neural Networks	Jul 30, 2021	modelNetwork Pruning	CodeCode Available	0
Manipulating Identical Filter Redundancy for Efficient Pruning on Deep and Complicated CNN	Jul 30, 2021	Network Pruning	CodeCode Available	1
Continual Learning for Task-oriented Dialogue System with Iterative Network Pruning, Expanding and Masking	Jul 17, 2021	Continual LearningNetwork Pruning	CodeCode Available	0
Blending Pruning Criteria for Convolutional Neural Networks	Jul 11, 2021	ClusteringNetwork Pruning	—Unverified	0
Model compression as constrained optimization, with application to neural nets. Part V: combining compressions	Jul 9, 2021	Additive modelsLow-rank compression	—Unverified	0
Weight Reparametrization for Budget-Aware Network Pruning	Jul 8, 2021	Network Pruning	—Unverified	0
M-FAC: Efficient Matrix-Free Approximations of Second-Order Information	Jul 7, 2021	Network PruningSecond-order methods	CodeCode Available	1
Connectivity Matters: Neural Network Pruning Through the Lens of Effective Sparsity	Jul 5, 2021	BenchmarkingNetwork Pruning	CodeCode Available	0
A Lottery Ticket Hypothesis Framework for Low-Complexity Device-Robust Neural Acoustic Scene Classification	Jul 3, 2021	Acoustic Scene ClassificationData Augmentation	—Unverified	0
Dep-L_0: Improving L_0-based Network Sparsification via Dependency Modeling	Jun 30, 2021	Network PruningVariational Inference	CodeCode Available	0
AC/DC: Alternating Compressed/DeCompressed Training of Deep Neural Networks	Jun 23, 2021	Network Pruning	CodeCode Available	1
Connection Sensitivity Matters for Training-free DARTS: From Architecture-Level Scoring to Operation-Level Sensitivity Analysis	Jun 22, 2021	Computational EfficiencyNetwork Pruning	—Unverified	0
Iterative Network Pruning with Uncertainty Regularization for Lifelong Sentiment Classification	Jun 21, 2021	Lifelong learningNetwork Pruning	CodeCode Available	0
Cogradient Descent for Dependable Learning	Jun 20, 2021	Image InpaintingImage Reconstruction	CodeCode Available	0
Network Pruning via Performance Maximization	Jun 19, 2021	Model CompressionNetwork Pruning	CodeCode Available	0
Sparse Training via Boosting Pruning Plasticity with Neuroregeneration	Jun 19, 2021	Network PruningSparse Learning	CodeCode Available	1
Heterogeneous Federated Learning using Dynamic Model Pruning and Adaptive Gradient	Jun 13, 2021	Federated LearningModel Compression	—Unverified	0
Self-Damaging Contrastive Learning	Jun 6, 2021	Contrastive LearningLinear evaluation	CodeCode Available	1
1xN Pattern for Pruning Convolutional Neural Networks	May 31, 2021	CPUNetwork Pruning	CodeCode Available	1
Dynamic Probabilistic Pruning: A general framework for hardware-constrained pruning at different granularities	May 26, 2021	image-classificationImage Classification	—Unverified	0
A Probabilistic Approach to Neural Network Pruning	May 20, 2021	Network Pruning	—Unverified	0

Show:10 25 50

← PrevPage 12 of 22Next →

All datasets ImageNet ImageNet - ResNet 50 - 90% sparsity CIFAR-100 CIFAR-10 MNIST

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ResNet50-2.3 GFLOPs	Accuracy	78.79	—	Unverified
2	ResNet50-1.5 GFLOPs	Accuracy	78.07	—	Unverified
3	ResNet50 2.5 GFLOPS	Accuracy	78	—	Unverified
4	RegX-1.6G	Accuracy	77.97	—	Unverified
5	ResNet50 2.0 GFLOPS	Accuracy	77.7	—	Unverified
6	ResNet50-3G FLOPs	Accuracy	77.1	—	Unverified
7	ResNet50-2G FLOPs	Accuracy	76.4	—	Unverified
8	ResNet50-1G FLOPs	Accuracy	76.38	—	Unverified
9	TAS-pruned ResNet-50	Accuracy	76.2	—	Unverified
10	ResNet50	Accuracy	75.59	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Feather	Top-1 Accuracy	76.93	—	Unverified
2	Spartan	Top-1 Accuracy	76.17	—	Unverified
3	ST-3	Top-1 Accuracy	76.03	—	Unverified
4	AC/DC	Top-1 Accuracy	75.64	—	Unverified
5	CS	Top-1 Accuracy	75.5	—	Unverified
6	ProbMask	Top-1 Accuracy	74.68	—	Unverified
7	STR	Top-1 Accuracy	74.31	—	Unverified
8	DNW	Top-1 Accuracy	74	—	Unverified
9	GMP	Top-1 Accuracy	73.91	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	+U-DML*	Inference Time (ms)	675.56	—	Unverified
2	Dense	Accuracy	79	—	Unverified
3	AC/DC	Accuracy	78.2	—	Unverified
4	Beta-Rank	Accuracy	74.01	—	Unverified
5	TAS-pruned ResNet-110	Accuracy	73.16	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TAS-pruned ResNet-110	Accuracy	94.33	—	Unverified
2	ShuffleNet – Quantised	Inference Time (ms)	23.15	—	Unverified
3	AlexNet – Quantised	Inference Time (ms)	5.23	—	Unverified
4	MobileNet – Quantised	Inference Time (ms)	4.74	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	FFN-ShapleyPruned	Avg #Steps	12.05	—	Unverified