SOTAVerified

Second-order methods

Use second-order statistics to process data.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–25 of 181 papers

TitleStatusHype
Automatic Gradient Descent: Deep Learning without HyperparametersCode2
Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information AnalysisCode2
Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian OptimizationCode2
Symmetry Teleportation for Accelerated OptimizationCode1
Second-Order Stochastic Optimization for Machine Learning in Linear TimeCode1
M-FAC: Efficient Matrix-Free Approximations of Second-Order InformationCode1
MKOR: Momentum-Enabled Kronecker-Factor-Based Optimizer Using Rank-1 UpdatesCode1
MiLeNAS: Efficient Neural Architecture Search via Mixed-Level ReformulationCode1
SASSHA: Sharpness-aware Adaptive Second-order Optimization with Stable Hessian ApproximationCode1
Second-Order Neural ODE OptimizerCode1
Near out-of-distribution detection for low-resolution radar micro-Doppler signaturesCode1
Structured Inverse-Free Natural Gradient: Memory-Efficient & Numerically-Stable KFACCode1
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine LearningCode1
Revisiting Scalable Hessian Diagonal Approximations for Applications in Reinforcement LearningCode1
Communication-Efficient Stochastic Zeroth-Order Optimization for Federated LearningCode1
Low Rank Saddle Free Newton: A Scalable Method for Stochastic Nonconvex OptimizationCode1
Can We Remove the Square-Root in Adaptive Gradient Methods? A Second-Order PerspectiveCode1
Adaptive Consensus Optimization Method for GANsCode0
FOSI: Hybrid First and Second Order OptimizationCode0
Generalized Optimistic Methods for Convex-Concave Saddle Point ProblemsCode0
Adapting Newton's Method to Neural Networks through a Summary of Higher-Order DerivativesCode0
Exact, Tractable Gauss-Newton Optimization in Deep Reversible Architectures Reveal Poor GeneralizationCode0
Studying K-FAC Heuristics by Viewing Adam through a Second-Order LensCode0
Fast and Furious Convergence: Stochastic Second Order Methods under InterpolationCode0
FLeNS: Federated Learning with Enhanced Nesterov-Newton SketchCode0
Show:102550
← PrevPage 1 of 8Next →

No leaderboard results yet.