Minimax Optimal Regression over Sobolev Spaces via Laplacian Regularization on Neighborhood Graphs

Abstract

In this paper we study the statistical properties of Laplacian smoothing, a graph-based approach to nonparametric regression. Under standard regularity conditions, we establish upper bounds on the error of the Laplacian smoothing estimator f, and a goodness-of-fit test also based on f. These upper bounds match the minimax optimal estimation and testing rates of convergence over the first-order Sobolev class H^1(X), for X R^d and 1 d < 4; in the estimation problem, for d = 4, they are optimal modulo a n factor. Additionally, we prove that Laplacian smoothing is manifold-adaptive: if X R^d is an m-dimensional manifold with m < d, then the error rate of Laplacian smoothing (in either estimation or testing) depends only on m, in the same way it would if X were a full-dimensional set in R^d.

Tasks

Reproductions