Stochastic Optimization

Stochastic Optimization is the task of optimizing certain objective functional by generating and using stochastic random variables. Usually the Stochastic Optimization is an iterative process of generating random variables that progressively finds out the minima or the maxima of the objective functional. Stochastic Optimization is usually applied in the non-convex functional spaces where the usual deterministic optimization such as linear or quadratic programming or their variants cannot be used.

Source: ASOC: An Adaptive Parameter-free Stochastic Optimization Techinique for Continuous Variables

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 426–450 of 1387 papers

Title	Date	Tasks	Status
Dual Averaging is Surprisingly Effective for Deep Learning Optimization	Oct 20, 2020	Deep LearningStochastic Optimization	—Unverified
Adaptive Importance Sampling for Finite-Sum Optimization and Sampling with Decreasing Step-Sizes	Mar 23, 2021	Stochastic Optimization	—Unverified
Dual Iterative Hard Thresholding: From Non-convex Sparse Minimization to Non-smooth Concave Maximization	Mar 1, 2017	Computational EfficiencyStochastic Optimization	—Unverified
Fast Distributed Stochastic Scheduling for A Multi-Energy Industrial Park	Oct 27, 2021	energy managementManagement	—Unverified
Dyna: A Method of Momentum for Stochastic Optimization	May 13, 2018	Computational EfficiencyStochastic Optimization	—Unverified
Distributed Stochastic Optimization With Unbounded Subgradients Over Randomly Time-Varying Networks	Aug 20, 2020	Stochastic Optimization	—Unverified
Dynamic Edge Computing empowered by Reconfigurable Intelligent Surfaces	Dec 21, 2021	CPUEdge-computing	—Unverified
Distributed stochastic optimization with large delays	Jul 6, 2021	Distributed ComputingStochastic Optimization	—Unverified
Dynamic Matching with Post-allocation Service and its Application to Refugee Resettlement	Oct 30, 2024	Stochastic Optimization	—Unverified
Distributed stochastic optimization with gradient tracking over strongly-connected networks	Mar 18, 2019	Stochastic Optimization	—Unverified
Minimizing the AoI in Resource-Constrained Multi-Source Relaying Systems: Dynamic and Learning-based Scheduling	Mar 10, 2022	Deep Reinforcement LearningScheduling	—Unverified
Dynamic Scheduling for Vehicle-to-Vehicle Communications Enhanced Federated Learning	Jun 25, 2024	Federated Learningimage-classification	—Unverified
Dynamic Stochastic Approximation for Multi-stage Stochastic Optimization	Jul 11, 2017	Stochastic Optimization	—Unverified
A Variational Inequality Approach to Bayesian Regression Games	Mar 24, 2021	regressionStochastic Optimization	—Unverified
A Half-Space Stochastic Projected Gradient Method for Group Sparsity Regularization	Jan 1, 2021	compressed sensingfeature selection	—Unverified
Distributed Stochastic Optimization via Adaptive SGD	Feb 16, 2018	Stochastic Optimization	—Unverified
Effective Blind Source Separation Based on the Adam Algorithm	May 25, 2016	blind source separationStochastic Optimization	—Unverified
Distributed stochastic optimization via matrix exponential learning	Jun 3, 2016	Stochastic Optimizationvalid	—Unverified
Effect of Random Learning Rate: Theoretical Analysis of SGD Dynamics in Non-Convex Optimization via Stationary Distribution	Jun 23, 2024	Stochastic Optimization	—Unverified
Efficiency Ordering of Stochastic Gradient Descent	Sep 15, 2022	Stochastic Optimization	—Unverified
Automated Market Makers: A Stochastic Optimization Approach for Profitable Liquidity Concentration	Apr 23, 2025	Stochastic Optimization	—Unverified
Efficient Debiased Evidence Estimation by Multilevel Monte Carlo Sampling	Jan 14, 2020	Bayesian InferenceStochastic Optimization	—Unverified
Efficient Distributed SGD with Variance Reduction	Dec 9, 2015	Stochastic Optimization	—Unverified
Distributed Stochastic Optimization under a General Variance Condition	Jan 30, 2023	Stochastic Optimization	—Unverified
Distributed Stochastic Optimization of the Regularized Risk	Jun 17, 2014	Stochastic Optimization	—Unverified

Show:10 25 50

← PrevPage 18 of 56Next →

All datasets CIFAR-100 WRN-28-10 - 200 Epochs CIFAR-10 WRN-28-10 - 200 Epochs CIFAR-10 ResNet-18 - 200 Epochs ImageNet ResNet-50 - 90 Epochs Penn Treebank (Character Level) 3x1000 LSTM - 500 Epochs CIFAR-10 CIFAR-100 ImageNet ResNet-50 - 50 Epochs ImageNet ResNet-50 - 60 Epochs AG News CoLA MNIST

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	AvaGrad	Accuracy	81.24	—	Unverified
2	AdaShift	Accuracy	81.12	—	Unverified
3	Adam (eps-adjusted)	Accuracy	81.04	—	Unverified
4	SGD	Accuracy	80.95	—	Unverified
5	AdamW	Accuracy	79.87	—	Unverified
6	AdaBound	Accuracy	77.24	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Adam (eps-adjusted)	Accuracy	96.36	—	Unverified
2	AvaGrad	Accuracy	96.2	—	Unverified
3	SGD	Accuracy	96.14	—	Unverified
4	AdaShift	Accuracy	95.92	—	Unverified
5	AdamW	Accuracy	95.89	—	Unverified
6	AdaBound	Accuracy	94.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SGD - cosine LR schedule	Accuracy	95.55	—	Unverified
2	Lookahead	Accuracy	95.27	—	Unverified
3	SGD	Accuracy	95.23	—	Unverified
4	ADAM	Accuracy	94.84	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AvaGrad	Top 1 Accuracy	76.51	—	Unverified
2	SGD	Top 1 Accuracy	75.99	—	Unverified
3	AdamW	Top 1 Accuracy	72.9	—	Unverified
4	AdaBound	Top 1 Accuracy	72.01	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AdaBound	Bit per Character (BPC)	2.86	—	Unverified
2	AdaShift	Bit per Character (BPC)	1.27	—	Unverified
3	AdamW	Bit per Character (BPC)	1.23	—	Unverified
4	AvaGrad	Bit per Character (BPC)	1.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Resnet18	Accuracy (max)	86.85	—	Unverified
2	Resnet34	Accuracy (max)	86.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Resnet18	Accuracy (max)	58.48	—	Unverified
2	Resnet34	Accuracy (max)	54.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SGD	Top 5 Accuracy	92.15	—	Unverified
2	Lookahead	Top 1 Accuracy	75.13	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Lookahead	Top 1 Accuracy	75.49	—	Unverified
2	SGD	Top 1 Accuracy	75.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Bert	Accuracy (max)	93.99	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Bert	Accuracy (max)	86.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MLP	NLL	0.05	—	Unverified