SOTAVerified

Second-order methods

Use second-order statistics to process data.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–25 of 181 papers

TitleStatusHype
Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian OptimizationCode2
Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information AnalysisCode2
Automatic Gradient Descent: Deep Learning without HyperparametersCode2
M-FAC: Efficient Matrix-Free Approximations of Second-Order InformationCode1
Symmetry Teleportation for Accelerated OptimizationCode1
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine LearningCode1
Second-Order Stochastic Optimization for Machine Learning in Linear TimeCode1
MKOR: Momentum-Enabled Kronecker-Factor-Based Optimizer Using Rank-1 UpdatesCode1
SASSHA: Sharpness-aware Adaptive Second-order Optimization with Stable Hessian ApproximationCode1
Second-Order Neural ODE OptimizerCode1
MiLeNAS: Efficient Neural Architecture Search via Mixed-Level ReformulationCode1
Near out-of-distribution detection for low-resolution radar micro-Doppler signaturesCode1
Structured Inverse-Free Natural Gradient: Memory-Efficient & Numerically-Stable KFACCode1
Revisiting Scalable Hessian Diagonal Approximations for Applications in Reinforcement LearningCode1
Communication-Efficient Stochastic Zeroth-Order Optimization for Federated LearningCode1
Low Rank Saddle Free Newton: A Scalable Method for Stochastic Nonconvex OptimizationCode1
Can We Remove the Square-Root in Adaptive Gradient Methods? A Second-Order PerspectiveCode1
Adaptive Consensus Optimization Method for GANsCode0
Generalized Optimistic Methods for Convex-Concave Saddle Point ProblemsCode0
Improving SGD convergence by online linear regression of gradients in multiple statistically relevant directionsCode0
Adapting Newton's Method to Neural Networks through a Summary of Higher-Order DerivativesCode0
Fast and Furious Convergence: Stochastic Second Order Methods under InterpolationCode0
Studying K-FAC Heuristics by Viewing Adam through a Second-Order LensCode0
FLeNS: Federated Learning with Enhanced Nesterov-Newton SketchCode0
FOSI: Hybrid First and Second Order OptimizationCode0
Show:102550
← PrevPage 1 of 8Next →

No leaderboard results yet.