SOTAVerified

Second-order methods

Use second-order statistics to process data.

Papers

Showing 151175 of 181 papers

TitleStatusHype
A Homogenization Approach for Gradient-Dominated Stochastic Optimization0
Alternating direction method of multipliers for regularized multiclass support vector machines0
A Mini-Block Fisher Method for Deep Neural Networks0
Amortized Proximal Optimization0
A Newton-CG based barrier method for finding a second-order stationary point of nonconvex conic optimization with complexity guarantees0
A Novel Fast Exact Subproblem Solver for Stochastic Quasi-Newton Cubic Regularized Optimization0
Approximate Newton Methods and Their Local Convergence0
A scaled gradient projection method for Bayesian learning in dynamical systems0
A survey of deep learning optimizers -- first and second order methods0
A Survey of Optimization Methods for Training DL Models: Theoretical Perspective on Convergence and Generalization0
Basis Matters: Better Communication-Efficient Second Order Methods for Federated Learning0
Bilinear Parameterization For Differentiable Rank-Regularization0
Bilinear Parameterization for Non-Separable Singular Value Penalties0
Biologically inspired protection of deep networks from adversarial attacks0
Block-diagonal Hessian-free Optimization for Training Neural Networks0
Component-Wise Natural Gradient Descent -- An Efficient Neural Network Optimization0
Convolutions and More as Einsum: A Tensor Network Perspective with Advances for Second-Order Methods0
Critical Point-Finding Methods Reveal Gradient-Flat Regions of Deep Network Losses0
Curvature-corrected learning dynamics in deep neural networks0
Learning Rates as a Function of Batch Size: A Random Matrix Theory Approach to Neural Network Training0
Debiasing Distributed Second Order Optimization with Surrogate Sketching and Scaled Regularization0
Decentralized Riemannian Conjugate Gradient Method on the Stiefel Manifold0
DDPNOpt: Differential Dynamic Programming Neural Optimizer0
Distributed Quasi-Newton Method for Fair and Fast Federated Learning0
Distributed Second Order Methods with Fast Rates and Compressed Communication0
Show:102550
← PrevPage 7 of 8Next →

No leaderboard results yet.