SOTAVerified

Stochastic Optimization

Stochastic Optimization is the task of optimizing certain objective functional by generating and using stochastic random variables. Usually the Stochastic Optimization is an iterative process of generating random variables that progressively finds out the minima or the maxima of the objective functional. Stochastic Optimization is usually applied in the non-convex functional spaces where the usual deterministic optimization such as linear or quadratic programming or their variants cannot be used.

Source: ASOC: An Adaptive Parameter-free Stochastic Optimization Techinique for Continuous Variables

Papers

Showing 12511300 of 1387 papers

TitleStatusHype
Unsupervised Submodular Rank Aggregation on Score-based PermutationsCode0
A Contrastive Divergence for Combining Variational Inference and MCMCCode0
Sequential Quadratic Optimization for Nonlinear Equality Constrained Stochastic OptimizationCode0
Data-Pooling in Stochastic OptimizationCode0
Recursive Monte Carlo and Variational Inference with Auxiliary VariablesCode0
On the Convergence of Adam and BeyondCode0
Enhancing Trade-offs in Privacy, Utility, and Computational Efficiency through MUltistage Sampling Technique (MUST)Code0
Averaged Adam accelerates stochastic optimization in the training of deep neural network approximations for partial differential equation and optimal control problemsCode0
Likelihood-based inference and forecasting for trawl processes: a stochastic optimization approachCode0
Limited-Memory Matrix Adaptation for Large Scale Black-box OptimizationCode0
Linear Speedup in Personalized Collaborative LearningCode0
Serverless Federated AUPRC Optimization for Multi-Party Collaborative Imbalanced Data MiningCode0
Estimate-Then-Optimize versus Integrated-Estimation-Optimization versus Sample Average Approximation: A Stochastic Dominance PerspectiveCode0
Comparing Two Samples Through Stochastic Dominance: A Graphical ApproachCode0
Reducing the variance in online optimization by transporting past gradientsCode0
Private Federated Learning Without a Trusted Server: Optimal Algorithms for Convex LossesCode0
Sever: A Robust Meta-Algorithm for Stochastic OptimizationCode0
Eve: A Gradient Based Optimization Method with Locally and Globally Adaptive Learning RatesCode0
The Step Decay Schedule: A Near Optimal, Geometrically Decaying Learning Rate Procedure For Least SquaresCode0
SGD for robot motion? The effectiveness of stochastic optimization on a new benchmark for biped locomotion tasksCode0
Constrained Deep Networks: Lagrangian Optimization via Log-Barrier ExtensionsCode0
Log Barriers for Safe Black-box Optimization with Application to Safe Reinforcement LearningCode0
Expectigrad: Fast Stochastic Optimization with Robust Convergence PropertiesCode0
CoolMomentum: A Method for Stochastic Optimization by Langevin Dynamics with Simulated AnnealingCode0
On the insufficiency of existing momentum schemes for Stochastic OptimizationCode0
Exploiting Uncertainty of Loss Landscape for Stochastic OptimizationCode0
Communication Efficient Distributed Optimization using an Approximate Newton-type MethodCode0
Exploring the Algorithm-Dependent Generalization of AUPRC Optimization with List StabilityCode0
A Second look at Exponential and Cosine Step Sizes: Simplicity, Adaptivity, and PerformanceCode0
Asynchronous stochastic convex optimizationCode0
Statistical Inference of Constrained Stochastic Optimization via Sketched Sequential Quadratic ProgrammingCode0
Fair and Welfare-Efficient Constrained Multi-matchings under UncertaintyCode0
Adaptive Methods for Nonconvex OptimizationCode0
SGDLibrary: A MATLAB library for stochastic gradient descent algorithmsCode0
On the stability of gradient descent with second order dynamics for time-varying cost functionsCode0
Fast and Scalable Bayesian Deep Learning by Weight-Perturbation in AdamCode0
Reparameterizable Subset Sampling via Continuous RelaxationsCode0
Bridging the Gap between Stochastic Gradient MCMC and Stochastic OptimizationCode0
Reparameterization Gradients through Acceptance-Rejection Sampling AlgorithmsCode0
An Online Stochastic Optimization Approach for Insulin Intensification in Type 2 Diabetes with Attention to Pseudo-HypoglycemiaCode0
Optimal Adaptive and Accelerated Stochastic Gradient DescentCode0
Stochastic Frank-Wolfe for Composite Convex MinimizationCode0
Tuning-Free Coreset Markov Chain Monte Carlo via Hot DoGCode0
SGEM: stochastic gradient with energy and momentumCode0
Stochastic Optimization for Spectral Risk MeasuresCode0
Annealing Optimization for Progressive Learning with Stochastic ApproximationCode0
Communication-Censored Distributed Stochastic Gradient DescentCode0
A Generic Acceleration Framework for Stochastic Composite OptimizationCode0
Maximizing Invariant Data Perturbation with Stochastic OptimizationCode0
Target-based Surrogates for Stochastic OptimizationCode0
Show:102550
← PrevPage 26 of 28Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AvaGradAccuracy81.24Unverified
2AdaShiftAccuracy81.12Unverified
3Adam (eps-adjusted)Accuracy81.04Unverified
4SGDAccuracy80.95Unverified
5AdamWAccuracy79.87Unverified
6AdaBoundAccuracy77.24Unverified
#ModelMetricClaimedVerifiedStatus
1Adam (eps-adjusted)Accuracy96.36Unverified
2AvaGradAccuracy96.2Unverified
3SGDAccuracy96.14Unverified
4AdaShiftAccuracy95.92Unverified
5AdamWAccuracy95.89Unverified
6AdaBoundAccuracy94.6Unverified
#ModelMetricClaimedVerifiedStatus
1SGD - cosine LR scheduleAccuracy95.55Unverified
2LookaheadAccuracy95.27Unverified
3SGDAccuracy95.23Unverified
4ADAMAccuracy94.84Unverified
#ModelMetricClaimedVerifiedStatus
1AvaGradTop 1 Accuracy76.51Unverified
2SGDTop 1 Accuracy75.99Unverified
3AdamWTop 1 Accuracy72.9Unverified
4AdaBoundTop 1 Accuracy72.01Unverified
#ModelMetricClaimedVerifiedStatus
1AdaBoundBit per Character (BPC)2.86Unverified
2AdaShiftBit per Character (BPC)1.27Unverified
3AdamWBit per Character (BPC)1.23Unverified
4AvaGradBit per Character (BPC)1.18Unverified
#ModelMetricClaimedVerifiedStatus
1Resnet18Accuracy (max)86.85Unverified
2Resnet34Accuracy (max)86.14Unverified
#ModelMetricClaimedVerifiedStatus
1Resnet18Accuracy (max)58.48Unverified
2Resnet34Accuracy (max)54.5Unverified
#ModelMetricClaimedVerifiedStatus
1SGDTop 5 Accuracy92.15Unverified
2LookaheadTop 1 Accuracy75.13Unverified
#ModelMetricClaimedVerifiedStatus
1LookaheadTop 1 Accuracy75.49Unverified
2SGDTop 1 Accuracy75.15Unverified
#ModelMetricClaimedVerifiedStatus
1BertAccuracy (max)93.99Unverified
#ModelMetricClaimedVerifiedStatus
1BertAccuracy (max)86.34Unverified
#ModelMetricClaimedVerifiedStatus
1MLPNLL0.05Unverified