Stochastic Optimization

Stochastic Optimization is the task of optimizing certain objective functional by generating and using stochastic random variables. Usually the Stochastic Optimization is an iterative process of generating random variables that progressively finds out the minima or the maxima of the objective functional. Stochastic Optimization is usually applied in the non-convex functional spaces where the usual deterministic optimization such as linear or quadratic programming or their variants cannot be used.

Source: ASOC: An Adaptive Parameter-free Stochastic Optimization Techinique for Continuous Variables

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 851–875 of 1387 papers

Title	Date	Tasks	Status
Stochastic Autograd	Jan 17, 2022	Stochastic OptimizationVariational Inference	—Unverified
Stochastic batch size for adaptive regularization in deep network optimization	Apr 14, 2020	image-classificationImage Classification	—Unverified
Stochastic Bias-Reduced Gradient Methods	Jun 17, 2021	Stochastic Optimization	—Unverified
Stochastic Bound Majorization	Sep 22, 2013	Stochastic Optimization	—Unverified
Stochastic Canonical Correlation Analysis	Feb 21, 2017	Stochastic Optimization	—Unverified
Stochastic Compositional Gradient Descent under Compositional Constraints	Dec 17, 2020	General Classificationregression	—Unverified
Stochastic Conditional Gradient++	Feb 19, 2019	Stochastic Optimization	—Unverified
Stochastic Conditional Gradient Methods: From Convex Minimization to Submodular Maximization	Apr 24, 2018	Stochastic Optimization	—Unverified
Stochastic-Constrained Stochastic Optimization with Markovian Data	Dec 7, 2023	FairnessStochastic Optimization	—Unverified
Stochastic Convex Optimization: Faster Local Growth Implies Faster Global Convergence	Aug 1, 2017	Stochastic Optimization	—Unverified
Stochastic Convex Optimization with Multiple Objectives	Dec 1, 2013	Stochastic Optimization	—Unverified
Stochastic DCA for minimizing a large sum of DC functions with application to Multi-class Logistic Regression	Nov 10, 2019	Multi-Task LearningStochastic Optimization	—Unverified
A stochastic first-order method with multi-extrapolated momentum for highly smooth unconstrained optimization	Dec 19, 2024	Stochastic Optimization	—Unverified
Stochastic First-Order Methods with Non-smooth and Non-Euclidean Proximal Terms for Nonconvex High-Dimensional Stochastic Optimization	Jun 27, 2024	Stochastic Optimization	—Unverified
Stochastic Flight Plan Optimization	Jul 27, 2023	Stochastic Optimization	—Unverified
Stochastic Flows and Geometric Optimization on the Orthogonal Group	Mar 30, 2020	Metric LearningReinforcement Learning	—Unverified
Stochastic gradient algorithms from ODE splitting perspective	Apr 19, 2020	regressionStochastic Optimization	—Unverified
Stochastic Gradient Descent for Spectral Embedding with Implicit Orthogonality Constraint	Dec 13, 2018	ClusteringGraph Clustering	—Unverified
Stochastic Gradient Descent Revisited	Dec 8, 2024	Stochastic Optimization	—Unverified
Stochastic Gradient Descent with Dependent Data for Offline Reinforcement Learning	Feb 6, 2022	Q-Learningreinforcement-learning	—Unverified
Stochastic gradient-free descents	Dec 31, 2019	Stochastic Optimization	—Unverified
Stochastic Gradient Langevin with Delayed Gradients	Jun 12, 2020	Stochastic Optimization	—Unverified
Stochastic Heavy Ball	Sep 14, 2016	Second-order methodsStochastic Optimization	—Unverified
Stochastic Hybrid Approximation for Uncertainty Management in Gas-Electric Systems	Mar 23, 2021	ManagementStochastic Optimization	—Unverified
Stochastic Hybrid Combining Design for Quantized Massive MIMO Systems	Aug 24, 2020	QuantizationStochastic Optimization	—Unverified

Show:10 25 50

← PrevPage 35 of 56Next →

All datasets CIFAR-100 WRN-28-10 - 200 Epochs CIFAR-10 WRN-28-10 - 200 Epochs CIFAR-10 ResNet-18 - 200 Epochs ImageNet ResNet-50 - 90 Epochs Penn Treebank (Character Level) 3x1000 LSTM - 500 Epochs CIFAR-10 CIFAR-100 ImageNet ResNet-50 - 50 Epochs ImageNet ResNet-50 - 60 Epochs AG News CoLA MNIST

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	AvaGrad	Accuracy	81.24	—	Unverified
2	AdaShift	Accuracy	81.12	—	Unverified
3	Adam (eps-adjusted)	Accuracy	81.04	—	Unverified
4	SGD	Accuracy	80.95	—	Unverified
5	AdamW	Accuracy	79.87	—	Unverified
6	AdaBound	Accuracy	77.24	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Adam (eps-adjusted)	Accuracy	96.36	—	Unverified
2	AvaGrad	Accuracy	96.2	—	Unverified
3	SGD	Accuracy	96.14	—	Unverified
4	AdaShift	Accuracy	95.92	—	Unverified
5	AdamW	Accuracy	95.89	—	Unverified
6	AdaBound	Accuracy	94.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SGD - cosine LR schedule	Accuracy	95.55	—	Unverified
2	Lookahead	Accuracy	95.27	—	Unverified
3	SGD	Accuracy	95.23	—	Unverified
4	ADAM	Accuracy	94.84	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AvaGrad	Top 1 Accuracy	76.51	—	Unverified
2	SGD	Top 1 Accuracy	75.99	—	Unverified
3	AdamW	Top 1 Accuracy	72.9	—	Unverified
4	AdaBound	Top 1 Accuracy	72.01	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AdaBound	Bit per Character (BPC)	2.86	—	Unverified
2	AdaShift	Bit per Character (BPC)	1.27	—	Unverified
3	AdamW	Bit per Character (BPC)	1.23	—	Unverified
4	AvaGrad	Bit per Character (BPC)	1.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Resnet18	Accuracy (max)	86.85	—	Unverified
2	Resnet34	Accuracy (max)	86.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Resnet18	Accuracy (max)	58.48	—	Unverified
2	Resnet34	Accuracy (max)	54.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SGD	Top 5 Accuracy	92.15	—	Unverified
2	Lookahead	Top 1 Accuracy	75.13	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Lookahead	Top 1 Accuracy	75.49	—	Unverified
2	SGD	Top 1 Accuracy	75.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Bert	Accuracy (max)	93.99	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Bert	Accuracy (max)	86.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MLP	NLL	0.05	—	Unverified