Normalized Gradients for All

Abstract

In this short note, I show how to adapt to H\"older smoothness using normalized gradients in a black-box way. Moreover, the bound will depend on a novel notion of local H\"older smoothness. The main idea directly comes from Levy [2017].

Tasks

Reproductions