Stochastic Optimization

Stochastic Optimization is the task of optimizing certain objective functional by generating and using stochastic random variables. Usually the Stochastic Optimization is an iterative process of generating random variables that progressively finds out the minima or the maxima of the objective functional. Stochastic Optimization is usually applied in the non-convex functional spaces where the usual deterministic optimization such as linear or quadratic programming or their variants cannot be used.

Source: ASOC: An Adaptive Parameter-free Stochastic Optimization Techinique for Continuous Variables

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 401–425 of 1387 papers

Title	Date	Tasks	Status
Distributed stochastic optimization via matrix exponential learning	Jun 3, 2016	Stochastic Optimizationvalid	—Unverified
Distributed Stochastic Optimization via Adaptive SGD	Feb 16, 2018	Stochastic Optimization	—Unverified
Distributed stochastic optimization with gradient tracking over strongly-connected networks	Mar 18, 2019	Stochastic Optimization	—Unverified
Distributed stochastic optimization with large delays	Jul 6, 2021	Distributed ComputingStochastic Optimization	—Unverified
Fair Incentives for Repeated Engagement	Oct 28, 2021	Decision MakingFairness	—Unverified
Fast Distributed Stochastic Scheduling for A Multi-Energy Industrial Park	Oct 27, 2021	energy managementManagement	—Unverified
Compositional federated learning: Applications in distributionally robust averaging and meta learning	Jun 21, 2021	BIG-bench Machine LearningFederated Learning	—Unverified
Complexity of Stochastic Dual Dynamic Programming	Dec 16, 2019	Decision MakingReinforcement Learning	—Unverified
Complexity Lower Bounds of Adaptive Gradient Algorithms for Non-convex Stochastic Optimization under Relaxed Smoothness	May 7, 2025	Stochastic Optimization	—Unverified
Distributionally Robust Optimization with Correlated Data from Vector Autoregressive Processes	Sep 8, 2019	Stochastic Optimization	—Unverified
Distributionally Time-Varying Online Stochastic Optimization under Polyak-Łojasiewicz Condition with Application in Conditional Value-at-Risk Statistical Learning	Sep 18, 2023	Stochastic Optimization	—Unverified
Distribution-Dependent Analysis of Gibbs-ERM Principle	Feb 5, 2019	Stochastic Optimization	—Unverified
Distribution free M-estimation	May 28, 2025	Learning TheoryStochastic Optimization	—Unverified
Divergence Results and Convergence of a Variance Reduced Version of ADAM	Oct 11, 2022	Stochastic Optimization	—Unverified
Discontinuous Computation Offloading for Energy-Efficient Mobile Edge Computing	Aug 8, 2020	Edge-computingStochastic Optimization	—Unverified
Does Momentum Help? A Sample Complexity Analysis	Oct 29, 2021	Stochastic Optimization	—Unverified
A Hybrid Variance-Reduced Method for Decentralized Stochastic Non-Convex Optimization	Feb 12, 2021	Stochastic Optimization	—Unverified
Don't Forget Your Teacher: A Corrective Reinforcement Learning Framework	May 30, 2019	reinforcement-learningReinforcement Learning	—Unverified
A Deep Learning Perspective on Network Routing	Mar 1, 2023	Deep LearningStochastic Optimization	—Unverified
Doubly stochastic large scale kernel learning with the empirical kernel map	Sep 2, 2016	Stochastic Optimization	—Unverified
Doubly-stochastic mining for heterogeneous retrieval	Apr 23, 2020	RetrievalStochastic Optimization	—Unverified
Bandit Algorithms for Prophet Inequality and Pandora's Box	Nov 16, 2022	Multi-Armed BanditsStochastic Optimization	—Unverified
Stochastic Model Pruning via Weight Dropping Away and Back	Dec 5, 2018	Model CompressionStochastic Optimization	—Unverified
DS-FACTO: Doubly Separable Factorization Machines	Apr 29, 2020	Recommendation SystemsStochastic Optimization	—Unverified
Complexity-Aware Training of Deep Neural Networks for Optimal Structure Discovery	Nov 14, 2024	Network PruningStochastic Optimization	—Unverified

Show:10 25 50

← PrevPage 17 of 56Next →

All datasets CIFAR-100 WRN-28-10 - 200 Epochs CIFAR-10 WRN-28-10 - 200 Epochs CIFAR-10 ResNet-18 - 200 Epochs ImageNet ResNet-50 - 90 Epochs Penn Treebank (Character Level) 3x1000 LSTM - 500 Epochs CIFAR-10 CIFAR-100 ImageNet ResNet-50 - 50 Epochs ImageNet ResNet-50 - 60 Epochs AG News CoLA MNIST

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	AvaGrad	Accuracy	81.24	—	Unverified
2	AdaShift	Accuracy	81.12	—	Unverified
3	Adam (eps-adjusted)	Accuracy	81.04	—	Unverified
4	SGD	Accuracy	80.95	—	Unverified
5	AdamW	Accuracy	79.87	—	Unverified
6	AdaBound	Accuracy	77.24	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Adam (eps-adjusted)	Accuracy	96.36	—	Unverified
2	AvaGrad	Accuracy	96.2	—	Unverified
3	SGD	Accuracy	96.14	—	Unverified
4	AdaShift	Accuracy	95.92	—	Unverified
5	AdamW	Accuracy	95.89	—	Unverified
6	AdaBound	Accuracy	94.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SGD - cosine LR schedule	Accuracy	95.55	—	Unverified
2	Lookahead	Accuracy	95.27	—	Unverified
3	SGD	Accuracy	95.23	—	Unverified
4	ADAM	Accuracy	94.84	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AvaGrad	Top 1 Accuracy	76.51	—	Unverified
2	SGD	Top 1 Accuracy	75.99	—	Unverified
3	AdamW	Top 1 Accuracy	72.9	—	Unverified
4	AdaBound	Top 1 Accuracy	72.01	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AdaBound	Bit per Character (BPC)	2.86	—	Unverified
2	AdaShift	Bit per Character (BPC)	1.27	—	Unverified
3	AdamW	Bit per Character (BPC)	1.23	—	Unverified
4	AvaGrad	Bit per Character (BPC)	1.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Resnet18	Accuracy (max)	86.85	—	Unverified
2	Resnet34	Accuracy (max)	86.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Resnet18	Accuracy (max)	58.48	—	Unverified
2	Resnet34	Accuracy (max)	54.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SGD	Top 5 Accuracy	92.15	—	Unverified
2	Lookahead	Top 1 Accuracy	75.13	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Lookahead	Top 1 Accuracy	75.49	—	Unverified
2	SGD	Top 1 Accuracy	75.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Bert	Accuracy (max)	93.99	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Bert	Accuracy (max)	86.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MLP	NLL	0.05	—	Unverified