The AL_0CORE Tensor Decomposition for Sparse Count Data
John Hood, Aaron Schein
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/jhood3/allocoreOfficialIn papernone★ 5
Abstract
This paper introduces AL_0CORE, a new form of probabilistic non-negative tensor decomposition. AL_0CORE is a Tucker decomposition where the number of non-zero elements (i.e., the _0-norm) of the core tensor is constrained to a preset value Q much smaller than the size of the core. While the user dictates the total budget Q, the locations and values of the non-zero elements are latent variables and allocated across the core tensor during inference. AL_0CORE -- i.e., allocated _0-constrained core-- thus enjoys both the computational tractability of CP decomposition and the qualitatively appealing latent structure of Tucker. In a suite of real-data experiments, we demonstrate that AL_0CORE typically requires only tiny fractions (e.g.,~1%) of the full core to achieve the same results as full Tucker decomposition at only a correspondingly tiny fraction of the cost.