| Sharpened Lazy Incremental Quasi-Newton Method | May 26, 2023 | Second-order methods | CodeCode Available | 0 |
| Faster Differentially Private Convex Optimization via Second-Order Methods | May 22, 2023 | Second-order methods | —Unverified | 0 |
| ISAAC Newton: Input-based Approximate Curvature for Newton's Method | May 1, 2023 | Second-order methods | CodeCode Available | 0 |
| Adaptive Consensus Optimization Method for GANs | Apr 20, 2023 | Image GenerationSecond-order methods | CodeCode Available | 0 |
| Automatic Gradient Descent: Deep Learning without Hyperparameters | Apr 11, 2023 | Deep LearningSecond-order methods | CodeCode Available | 2 |
| Gradient-Boosted Based Structured and Unstructured Learning | Feb 28, 2023 | Second-order methods | —Unverified | 0 |
| FOSI: Hybrid First and Second Order Optimization | Feb 16, 2023 | Audio ClassificationLanguage Modelling | CodeCode Available | 0 |
| Stochastic Dimension-reduced Second-order Methods for Policy Optimization | Jan 28, 2023 | Policy Gradient MethodsSecond-order methods | —Unverified | 0 |
| On backpropagating Hessians through ODEs | Jan 19, 2023 | Second-order methods | —Unverified | 0 |
| A survey of deep learning optimizers -- first and second order methods | Nov 28, 2022 | Deep LearningSecond-order methods | —Unverified | 0 |
| Differentially Private Image Classification from Features | Nov 24, 2022 | Classificationimage-classification | CodeCode Available | 0 |
| The Hypervolume Indicator Hessian Matrix: Analytical Expression, Computational Time Complexity, and Sparsity | Nov 8, 2022 | Multiobjective OptimizationSecond-order methods | CodeCode Available | 0 |
| Extra-Newton: A First Approach to Noise-Adaptive Accelerated Second-Order Methods | Nov 3, 2022 | Second-order methods | —Unverified | 0 |
| Explicit Second-Order Min-Max Optimization Methods with Optimal Convergence Guarantee | Oct 23, 2022 | Second-order methods | —Unverified | 0 |
| Component-Wise Natural Gradient Descent -- An Efficient Neural Network Optimization | Oct 11, 2022 | Efficient Neural NetworkSecond-order methods | —Unverified | 0 |
| Mirror Prox Algorithm for Large-Scale Cell-Free Massive MIMO Uplink Power Control | Sep 20, 2022 | FairnessSecond-order methods | —Unverified | 0 |
| Adaptive Second Order Coresets for Data-efficient Machine Learning | Jul 28, 2022 | BIG-bench Machine LearningSecond-order methods | —Unverified | 0 |
| SP2: A Second Order Stochastic Polyak Method | Jul 17, 2022 | Matrix CompletionSecond-order methods | —Unverified | 0 |
| A Newton-CG based barrier method for finding a second-order stationary point of nonconvex conic optimization with complexity guarantees | Jul 12, 2022 | Second-order methods | —Unverified | 0 |
| Stochastic Variance-Reduced Newton: Accelerating Finite-Sum Minimization with Large Batches | Jun 6, 2022 | Second-order methods | CodeCode Available | 0 |
| Statistical Inference of Constrained Stochastic Optimization via Sketched Sequential Quadratic Programming | May 27, 2022 | Second-order methodsStochastic Optimization | CodeCode Available | 0 |
| Stochastic Second-Order Methods Improve Best-Known Sample Complexity of SGD for Gradient-Dominated Function | May 25, 2022 | Policy Gradient MethodsReinforcement Learning (RL) | —Unverified | 0 |
| Symmetry Teleportation for Accelerated Optimization | May 21, 2022 | Second-order methods | CodeCode Available | 1 |
| On the efficiency of Stochastic Quasi-Newton Methods for Deep Learning | May 18, 2022 | NavigateSecond-order methods | —Unverified | 0 |
| Near out-of-distribution detection for low-resolution radar micro-Doppler signatures | May 12, 2022 | Contrastive LearningGeometry-aware processing | CodeCode Available | 1 |
| A Novel Fast Exact Subproblem Solver for Stochastic Quasi-Newton Cubic Regularized Optimization | Apr 19, 2022 | ARCSecond-order methods | —Unverified | 0 |
| Accelerating Stochastic Probabilistic Inference | Mar 15, 2022 | Second-order methodsStochastic Optimization | —Unverified | 0 |
| Amortized Proximal Optimization | Feb 28, 2022 | image-classificationImage Classification | —Unverified | 0 |
| Generalized Optimistic Methods for Convex-Concave Saddle Point Problems | Feb 19, 2022 | Second-order methods | CodeCode Available | 0 |
| A Mini-Block Fisher Method for Deep Neural Networks | Feb 8, 2022 | Second-order methods | —Unverified | 0 |
| Communication-Efficient Stochastic Zeroth-Order Optimization for Federated Learning | Jan 24, 2022 | Federated LearningSecond-order methods | CodeCode Available | 1 |
| Accelerated Projected Gradient Method for the Optimization of Cell-Free Massive MIMO Downlink | Jan 12, 2022 | Second-order methods | —Unverified | 0 |
| SCORE: Approximating Curvature Information under Self-Concordant Regularization | Dec 14, 2021 | Second-order methods | —Unverified | 0 |
| Newton methods based convolution neural networks using parallel processing | Dec 2, 2021 | Second-order methods | —Unverified | 0 |
| Basis Matters: Better Communication-Efficient Second Order Methods for Federated Learning | Nov 2, 2021 | Distributed OptimizationFederated Learning | —Unverified | 0 |
| Provable Regret Bounds for Deep Online Learning and Control | Oct 15, 2021 | Deep LearningSecond-order methods | —Unverified | 0 |
| KKT Conditions, First-Order and Second-Order Optimization, and Distributed Optimization: Tutorial and Survey | Oct 5, 2021 | Distributed OptimizationMultiobjective Optimization | —Unverified | 0 |
| SLIM-QN: A Stochastic, Light, Momentumized Quasi-Newton Optimizer for Deep Neural Networks | Sep 29, 2021 | Second-order methods | —Unverified | 0 |
| Second-Order Neural ODE Optimizer | Sep 29, 2021 | image-classificationImage Classification | CodeCode Available | 1 |
| Nonlinear matrix recovery using optimization on the Grassmann manifold | Sep 13, 2021 | Riemannian optimizationSecond-order methods | CodeCode Available | 0 |
| Doubly Adaptive Scaled Algorithm for Machine Learning Using Second-Order Information | Sep 11, 2021 | BIG-bench Machine LearningSecond-order methods | —Unverified | 0 |
| Structured second-order methods via natural gradient descent | Jul 22, 2021 | Second-order methods | —Unverified | 0 |
| M-FAC: Efficient Matrix-Free Approximations of Second-Order Information | Jul 7, 2021 | Network PruningSecond-order methods | CodeCode Available | 1 |
| Bilinear Parameterization for Non-Separable Singular Value Penalties | Jun 19, 2021 | Second-order methods | —Unverified | 0 |
| LocoProp: Enhancing BackProp via Local Loss Optimization | Jun 11, 2021 | Second-order methods | CodeCode Available | 0 |
| Tensor Normal Training for Deep Learning Models | Jun 5, 2021 | Deep LearningSecond-order methods | CodeCode Available | 0 |
| FedNL: Making Newton-Type Methods Applicable to Federated Learning | Jun 5, 2021 | Federated LearningModel Compression | —Unverified | 0 |
| Exact Stochastic Second Order Deep Learning | Apr 8, 2021 | Deep LearningSecond-order methods | —Unverified | 0 |
| Quasi-Newton Quasi-Monte Carlo for variational Bayes | Apr 7, 2021 | Second-order methods | —Unverified | 0 |
| Research of Damped Newton Stochastic Gradient Descent Method for Neural Network Training | Mar 31, 2021 | regressionSecond-order methods | —Unverified | 0 |