Effect of shapes of activation functions on predictability in the echo state network

Abstract

We investigate prediction accuracy for time series of Echo state networks with respect to several kinds of activation functions. As a result, we found that some kinds of activation functions with an appropriate nonlinearity show high performance compared to the conventional sigmoid function.

Tasks

Reproductions