Revisiting the Approximate Carathéodory Problem via the Frank-Wolfe Algorithm
Cyrille W. Combettes, Sebastian Pokutta
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/cyrillewcombettes/approxcaraOfficialIn papernone★ 0
Abstract
The approximate Carath\'eodory theorem states that given a compact convex set CR^n and p[2,+[, each point x^*C can be approximated to -accuracy in the _p-norm as the convex combination of O(pD_p^2/^2) vertices of C, where D_p is the diameter of C in the _p-norm. A solution satisfying these properties can be built using probabilistic arguments or by applying mirror descent to the dual problem. We revisit the approximate Carath\'eodory problem by solving the primal problem via the Frank-Wolfe algorithm, providing a simplified analysis and leading to an efficient practical method. Furthermore, improved cardinality bounds are derived naturally using existing convergence rates of the Frank-Wolfe algorithm in different scenarios, when x^* is in the interior of C, when x^* is the convex combination of a subset of vertices with small diameter, or when C is uniformly convex. We also propose cardinality bounds when p[1,2[\+\ via a nonsmooth variant of the algorithm. Lastly, we address the problem of finding sparse approximate projections onto C in the _p-norm, p[1,+].