SOTAVerified

Second-order methods

Use second-order statistics to process data.

Papers

Showing 151181 of 181 papers

TitleStatusHype
Newtonian Monte Carlo: single-site MCMC meets second-order gradient methodsCode0
Asymptotic Analysis of Conditioned Stochastic Gradient DescentCode0
FLeNS: Federated Learning with Enhanced Nesterov-Newton SketchCode0
FOSI: Hybrid First and Second Order OptimizationCode0
Generalized Optimistic Methods for Convex-Concave Saddle Point ProblemsCode0
Alternating Iteratively Reweighted _1 and Subspace Newton Algorithms for Nonconvex Sparse OptimizationCode0
Studying K-FAC Heuristics by Viewing Adam through a Second-Order LensCode0
Nonlinear matrix recovery using optimization on the Grassmann manifoldCode0
NysAct: A Scalable Preconditioned Gradient Descent using Nystrom ApproximationCode0
A Gauss-Newton Approach for Min-Max Optimization in Generative Adversarial NetworksCode0
Online Covariance Matrix Estimation in Sketched Newton MethodsCode0
Online Second Order Methods for Non-Convex Stochastic OptimizationsCode0
Improving SGD convergence by online linear regression of gradients in multiple statistically relevant directionsCode0
Tensor Normal Training for Deep Learning ModelsCode0
Stochastic Trust Region Inexact Newton Method for Large-scale Machine LearningCode0
ISAAC Newton: Input-based Approximate Curvature for Newton's MethodCode0
On the Promise of the Stochastic Generalized Gauss-Newton Method for Training DNNsCode0
Stochastic Variance-Reduced Newton: Accelerating Finite-Sum Minimization with Large BatchesCode0
Optimization Methods for Supervised Machine Learning: From Linear Models to Deep LearningCode0
Adapting Newton's Method to Neural Networks through a Summary of Higher-Order DerivativesCode0
Stochastic Newton and Cubic Newton Methods with Simple Local Linear-Quadratic RatesCode0
Large batch size training of neural networks with adversarial training and second-order informationCode0
A Computationally Efficient Sparsified Online Newton MethodCode0
The Hypervolume Indicator Hessian Matrix: Analytical Expression, Computational Time Complexity, and SparsityCode0
Limitations of the Empirical Fisher Approximation for Natural Gradient DescentCode0
LocoProp: Enhancing BackProp via Local Loss OptimizationCode0
Error Feedback Can Accurately Compress PreconditionersCode0
AdaSub: Stochastic Optimization Using Second-Order Information in Low-Dimensional SubspacesCode0
Differentially Private Image Classification from FeaturesCode0
LIBS2ML: A Library for Scalable Second Order Machine Learning AlgorithmsCode0
Adaptive Consensus Optimization Method for GANsCode0
Show:102550
← PrevPage 4 of 4Next →

No leaderboard results yet.