Stochastic Optimization

Stochastic Optimization is the task of optimizing certain objective functional by generating and using stochastic random variables. Usually the Stochastic Optimization is an iterative process of generating random variables that progressively finds out the minima or the maxima of the objective functional. Stochastic Optimization is usually applied in the non-convex functional spaces where the usual deterministic optimization such as linear or quadratic programming or their variants cannot be used.

Source: ASOC: An Adaptive Parameter-free Stochastic Optimization Techinique for Continuous Variables

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 351–375 of 1387 papers

Title	Date	Tasks	Status
Block-Randomized Stochastic Proximal Gradient for Low-Rank Tensor Factorization	Jan 16, 2019	Stochastic Optimization	—Unverified
A Mean-Field Theory for Learning the Schönberg Measure of Radial Basis Functions	Jun 23, 2020	ClusteringImage Retrieval	—Unverified
Adaptive Sequential Machine Learning	Apr 4, 2019	BIG-bench Machine LearningModel Selection	—Unverified
Accelerated Reinforcement Learning	Oct 23, 2017	Policy Gradient Methodsreinforcement-learning	—Unverified
A Machine Learning Approach for Prosumer Management in Intraday Electricity Markets	Mar 11, 2022	BIG-bench Machine LearningManagement	—Unverified
Adaptive Sampling Strategies for Stochastic Optimization	Oct 30, 2017	regressionStochastic Optimization	—Unverified
ALS: Augmented Lagrangian Sketching Methods for Linear Systems	Aug 12, 2022	Stochastic Optimization	—Unverified
Biased Stochastic First-Order Methods for Conditional Stochastic Optimization and Applications in Meta Learning	Feb 25, 2020	Causal InferenceMeta-Learning	—Unverified
AlphaZero Based Post-Storm Repair Crew Dispatch for Distribution Grid Restoration	Oct 14, 2020	NavigateStochastic Optimization	—Unverified
Adaptive Sampling Quasi-Newton Methods for Zeroth-Order Stochastic Optimization	Sep 24, 2021	Reinforcement Learning (RL)Stochastic Optimization	—Unverified
A Class of Short-term Recurrence Anderson Mixing Methods and Their Applications	Sep 29, 2021	image-classificationImage Classification	—Unverified
BFE and AdaBFE: A New Approach in Learning Rate Automation for Stochastic Optimization	Jul 6, 2022	Stochastic Optimization	—Unverified
A Local Convergence Theory for the Stochastic Gradient Descent Method in Non-Convex Optimization With Non-isolated Local Minima	Mar 21, 2022	Stochastic Optimization	—Unverified
Beyond Volumetric Albedo -- A Surface Optimization Framework for Non-Line-Of-Sight Imaging	Jun 1, 2019	Stochastic Optimization	—Unverified
Beyond variance reduction: Understanding the true impact of baselines on policy optimization	Aug 31, 2020	Reinforcement Learning (RL)Stochastic Optimization	—Unverified
A Linearly Convergent Conditional Gradient Algorithm with Applications to Online and Stochastic Optimization	Jan 20, 2013	Open-Ended Question AnsweringStochastic Optimization	—Unverified
Adaptive Sampling Quasi-Newton Methods for Derivative-Free Stochastic Optimization	Oct 29, 2019	reinforcement-learningReinforcement Learning	—Unverified
Beyond Suspension: A Two-phase Methodology for Concluding Sports Leagues	Mar 29, 2024	SchedulingStochastic Optimization	—Unverified
Beyond Single-Model Views for Deep Learning: Optimization versus Generalizability of Stochastic Optimization Algorithms	Mar 1, 2024	BenchmarkingStochastic Optimization	—Unverified
Algorithms for stochastic optimization with functional or expectation constraints	Apr 13, 2016	Stochastic Optimization	—Unverified
Beyond Adaptive Submodularity: Approximation Guarantees of Greedy Policy with Adaptive Submodularity Ratio	Apr 24, 2019	Decision Makingfeature selection	—Unverified
Algorithmic Stability of Heavy-Tailed Stochastic Gradient Descent on Least Squares	Jun 2, 2022	Stochastic Optimization	—Unverified
Adaptive Online Estimation of Piecewise Polynomial Trends	Sep 30, 2020	2kregression	—Unverified
Accurate Neural Network Pruning Requires Rethinking Sparse Optimization	Aug 3, 2023	Model CompressionNetwork Pruning	—Unverified
Accelerated Randomized Coordinate Descent Algorithms for Stochastic Optimization and Online Learning	Jun 5, 2018	Stochastic Optimization	—Unverified

Show:10 25 50

← PrevPage 15 of 56Next →

All datasets CIFAR-100 WRN-28-10 - 200 Epochs CIFAR-10 WRN-28-10 - 200 Epochs CIFAR-10 ResNet-18 - 200 Epochs ImageNet ResNet-50 - 90 Epochs Penn Treebank (Character Level) 3x1000 LSTM - 500 Epochs CIFAR-10 CIFAR-100 ImageNet ResNet-50 - 50 Epochs ImageNet ResNet-50 - 60 Epochs AG News CoLA MNIST

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	AvaGrad	Accuracy	81.24	—	Unverified
2	AdaShift	Accuracy	81.12	—	Unverified
3	Adam (eps-adjusted)	Accuracy	81.04	—	Unverified
4	SGD	Accuracy	80.95	—	Unverified
5	AdamW	Accuracy	79.87	—	Unverified
6	AdaBound	Accuracy	77.24	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Adam (eps-adjusted)	Accuracy	96.36	—	Unverified
2	AvaGrad	Accuracy	96.2	—	Unverified
3	SGD	Accuracy	96.14	—	Unverified
4	AdaShift	Accuracy	95.92	—	Unverified
5	AdamW	Accuracy	95.89	—	Unverified
6	AdaBound	Accuracy	94.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SGD - cosine LR schedule	Accuracy	95.55	—	Unverified
2	Lookahead	Accuracy	95.27	—	Unverified
3	SGD	Accuracy	95.23	—	Unverified
4	ADAM	Accuracy	94.84	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AvaGrad	Top 1 Accuracy	76.51	—	Unverified
2	SGD	Top 1 Accuracy	75.99	—	Unverified
3	AdamW	Top 1 Accuracy	72.9	—	Unverified
4	AdaBound	Top 1 Accuracy	72.01	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AdaBound	Bit per Character (BPC)	2.86	—	Unverified
2	AdaShift	Bit per Character (BPC)	1.27	—	Unverified
3	AdamW	Bit per Character (BPC)	1.23	—	Unverified
4	AvaGrad	Bit per Character (BPC)	1.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Resnet18	Accuracy (max)	86.85	—	Unverified
2	Resnet34	Accuracy (max)	86.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Resnet18	Accuracy (max)	58.48	—	Unverified
2	Resnet34	Accuracy (max)	54.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SGD	Top 5 Accuracy	92.15	—	Unverified
2	Lookahead	Top 1 Accuracy	75.13	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Lookahead	Top 1 Accuracy	75.49	—	Unverified
2	SGD	Top 1 Accuracy	75.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Bert	Accuracy (max)	93.99	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Bert	Accuracy (max)	86.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MLP	NLL	0.05	—	Unverified