SOTAVerified

Second-order methods

Use second-order statistics to process data.

Papers

Showing 1120 of 181 papers

TitleStatusHype
Communication-Efficient Stochastic Zeroth-Order Optimization for Federated LearningCode1
Structured Inverse-Free Natural Gradient: Memory-Efficient & Numerically-Stable KFACCode1
M-FAC: Efficient Matrix-Free Approximations of Second-Order InformationCode1
Low Rank Saddle Free Newton: A Scalable Method for Stochastic Nonconvex OptimizationCode1
MKOR: Momentum-Enabled Kronecker-Factor-Based Optimizer Using Rank-1 UpdatesCode1
Second-Order Neural ODE OptimizerCode1
Can We Remove the Square-Root in Adaptive Gradient Methods? A Second-Order PerspectiveCode1
Adaptive Consensus Optimization Method for GANsCode0
Error Feedback Can Accurately Compress PreconditionersCode0
Adapting Newton's Method to Neural Networks through a Summary of Higher-Order DerivativesCode0
Show:102550
← PrevPage 2 of 19Next →

No leaderboard results yet.