MUSCO: Multi-Stage Compression of neural networks
2019-03-24Code Available0· sign in to hype
Julia Gusak, Maksym Kholiavchenko, Evgeny Ponomarev, Larisa Markeeva, Ivan Oseledets, Andrzej Cichocki
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/juliagusak/muscoOfficialIn paperpytorch★ 0
- github.com/musco-ai/musco-tftf★ 0
- github.com/musco-ai/musco-pytorchpytorch★ 0
Abstract
The low-rank tensor approximation is very promising for the compression of deep neural networks. We propose a new simple and efficient iterative approach, which alternates low-rank factorization with a smart rank selection and fine-tuning. We demonstrate the efficiency of our method comparing to non-iterative ones. Our approach improves the compression rate while maintaining the accuracy for a variety of tasks.