SOTAVerified

Second-order methods

Use second-order statistics to process data.

Papers

Showing 110 of 181 papers

TitleStatusHype
NysAct: A Scalable Preconditioned Gradient Descent using Nystrom ApproximationCode0
KOALA++: Efficient Kalman-Based Optimization of Neural Networks with Gradient-Covariance Products0
Accelerated Training of Federated Learning via Second-Order Methods0
Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information AnalysisCode2
Representation Meets Optimization: Training PINNs and PIKANs for Gray-Box Discovery in Systems Pharmacology0
FedOSAA: Improving Federated Learning with One-Step Anderson Acceleration0
SASSHA: Sharpness-aware Adaptive Second-order Optimization with Stable Hessian ApproximationCode1
Online Covariance Matrix Estimation in Sketched Newton MethodsCode0
A Survey of Optimization Methods for Training DL Models: Theoretical Perspective on Convergence and Generalization0
Distributed Quasi-Newton Method for Fair and Fast Federated Learning0
Show:102550
← PrevPage 1 of 19Next →

No leaderboard results yet.