SOTAVerified

Second-order methods

Use second-order statistics to process data.

Papers

Showing 2650 of 181 papers

TitleStatusHype
Preconditioners for the Stochastic Training of Neural Fields0
GP-FL: Model-Based Hessian Estimation for Second-Order Over-the-Air Federated Learning0
A Learn-to-Optimize Approach for Coordinate-Wise Step Sizes for Quasi-Newton Methods0
Gradient Norm Regularization Second-Order Algorithms for Solving Nonconvex-Strongly Concave Minimax Problems0
Don't Be So Positive: Negative Step Sizes in Second-Order Methods0
Exact, Tractable Gauss-Newton Optimization in Deep Reversible Architectures Reveal Poor GeneralizationCode0
Improving Stochastic Cubic Newton with Momentum0
Second-Order Min-Max Optimization with Lazy Hessians0
Unlocking FedNL: Self-Contained Compute-Optimized Implementation0
Adversarial Vulnerability as a Consequence of On-Manifold Inseparibility0
FLeNS: Federated Learning with Enhanced Nesterov-Newton SketchCode0
Alternating Iteratively Reweighted _1 and Subspace Newton Algorithms for Nonconvex Sparse OptimizationCode0
Fed-Sophia: A Communication-Efficient Second-Order Federated Learning Algorithm0
Adaptive and Optimal Second-order Optimistic Methods for Minimax Optimization0
Stochastic Newton Proximal Extragradient Method0
Kronecker-Factored Approximate Curvature for Physics-Informed Neural Networks0
A Gauss-Newton Approach for Min-Max Optimization in Generative Adversarial NetworksCode0
Inverse-Free Fast Natural Gradient Descent Method for Deep Learning0
SGD with Partial Hessian for Deep Neural Networks OptimizationCode0
Second Order Methods for Bandit Optimization and Control0
The Challenges of the Nonlinear Regime for Physics-Informed Neural Networks0
On The Temporal Domain of Differential Equation Inspired Graph Neural Networks0
Krylov Cubic Regularized Newton: A Subspace Second-Order Method with Dimension-Free Convergence Rate0
Adapting Newton's Method to Neural Networks through a Summary of Higher-Order DerivativesCode0
A Computationally Efficient Sparsified Online Newton MethodCode0
Show:102550
← PrevPage 2 of 8Next →

No leaderboard results yet.