Stochastic Optimization

Stochastic Optimization is the task of optimizing certain objective functional by generating and using stochastic random variables. Usually the Stochastic Optimization is an iterative process of generating random variables that progressively finds out the minima or the maxima of the objective functional. Stochastic Optimization is usually applied in the non-convex functional spaces where the usual deterministic optimization such as linear or quadratic programming or their variants cannot be used.

Source: ASOC: An Adaptive Parameter-free Stochastic Optimization Techinique for Continuous Variables

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 726–750 of 1387 papers

Title	Date	Tasks	Status	Hype
Progressive Batching for Efficient Non-linear Least Squares	Oct 21, 2020	Stochastic Optimization	CodeCode Available	0
Dual Averaging is Surprisingly Effective for Deep Learning Optimization	Oct 20, 2020	Deep LearningStochastic Optimization	—Unverified	0
Bi-level Score Matching for Learning Energy-based Latent Variable Models	Oct 15, 2020	Rolling Shutter CorrectionStochastic Optimization	CodeCode Available	1
AlphaZero Based Post-Storm Repair Crew Dispatch for Distribution Grid Restoration	Oct 14, 2020	NavigateStochastic Optimization	—Unverified	0
Regret minimization in stochastic non-convex learning via a proximal-gradient approach	Oct 13, 2020	Stochastic Optimization	—Unverified	0
Three-Dimensional Swarming Using Cyclic Stochastic Optimization	Oct 11, 2020	Stochastic Optimization	—Unverified	0
Online Learning and Distributed Control for Residential Demand Response	Oct 11, 2020	Stochastic OptimizationThompson Sampling	—Unverified	0
Practical Precoding via Asynchronous Stochastic Successive Convex Approximation	Oct 3, 2020	Stochastic Optimization	CodeCode Available	0
Learning the Step-size Policy for the Limited-Memory Broyden-Fletcher-Goldfarb-Shanno Algorithm	Oct 3, 2020	Stochastic Optimization	—Unverified	0
Expectigrad: Fast Stochastic Optimization with Robust Convergence Properties	Oct 3, 2020	Stochastic Optimization	CodeCode Available	0
Deep FPF: Gain function approximation in high-dimensional setting	Oct 2, 2020	Stochastic OptimizationVocal Bursts Intensity Prediction	—Unverified	0
Variance-Reduced Methods for Machine Learning	Oct 2, 2020	BIG-bench Machine LearningStochastic Optimization	—Unverified	0
Adaptive Online Estimation of Piecewise Polynomial Trends	Sep 30, 2020	2kregression	—Unverified	0
Data augmentation as stochastic optimization	Sep 28, 2020	Data Augmentationregression	—Unverified	0
Apollo: An Adaptive Parameter-wise Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization	Sep 28, 2020	Stochastic Optimization	CodeCode Available	1
f-Divergence Variational Inference	Sep 28, 2020	Stochastic OptimizationVariational Inference	—Unverified	0
Escaping Saddle-Points Faster under Interpolation-like Conditions	Sep 28, 2020	Stochastic Optimization	—Unverified	0
Scheduling and Power Control for Wireless Multicast Systems via Deep Reinforcement Learning	Sep 27, 2020	Deep Reinforcement Learningreinforcement-learning	—Unverified	0
Stochastic Learning-Based Robust Beamforming Design for RIS-Aided Millimeter-Wave Systems in the Presence of Random Blockages	Sep 21, 2020	Stochastic Optimization	—Unverified	0
Finding Acceptable Parameter Regions of Stochastic Hill functions for Multisite Phosphorylation Mechanism	Sep 14, 2020	Stochastic Optimizationvalid	—Unverified	0
Variance-Reduced Off-Policy Memory-Efficient Policy Search	Sep 14, 2020	Reinforcement Learning (RL)Stochastic Optimization	—Unverified	0
Generalized Multi-Output Gaussian Process Censored Regression	Sep 10, 2020	regressionStochastic Optimization	CodeCode Available	0
GTAdam: Gradient Tracking with Adaptive Momentum for Distributed Online Optimization	Sep 3, 2020	Distributed OptimizationGeneral Classification	—Unverified	0
Cost-aware Feature Selection for IoT Device Classification	Sep 2, 2020	BIG-bench Machine LearningClassification	—Unverified	0
Robust, Accurate Stochastic Optimization for Variational Inference	Sep 1, 2020	DiagnosticStochastic Optimization	—Unverified	0

Show:10 25 50

← PrevPage 30 of 56Next →

All datasets CIFAR-100 WRN-28-10 - 200 Epochs CIFAR-10 WRN-28-10 - 200 Epochs CIFAR-10 ResNet-18 - 200 Epochs ImageNet ResNet-50 - 90 Epochs Penn Treebank (Character Level) 3x1000 LSTM - 500 Epochs CIFAR-10 CIFAR-100 ImageNet ResNet-50 - 50 Epochs ImageNet ResNet-50 - 60 Epochs AG News CoLA MNIST

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	AvaGrad	Accuracy	81.24	—	Unverified
2	AdaShift	Accuracy	81.12	—	Unverified
3	Adam (eps-adjusted)	Accuracy	81.04	—	Unverified
4	SGD	Accuracy	80.95	—	Unverified
5	AdamW	Accuracy	79.87	—	Unverified
6	AdaBound	Accuracy	77.24	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Adam (eps-adjusted)	Accuracy	96.36	—	Unverified
2	AvaGrad	Accuracy	96.2	—	Unverified
3	SGD	Accuracy	96.14	—	Unverified
4	AdaShift	Accuracy	95.92	—	Unverified
5	AdamW	Accuracy	95.89	—	Unverified
6	AdaBound	Accuracy	94.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SGD - cosine LR schedule	Accuracy	95.55	—	Unverified
2	Lookahead	Accuracy	95.27	—	Unverified
3	SGD	Accuracy	95.23	—	Unverified
4	ADAM	Accuracy	94.84	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AvaGrad	Top 1 Accuracy	76.51	—	Unverified
2	SGD	Top 1 Accuracy	75.99	—	Unverified
3	AdamW	Top 1 Accuracy	72.9	—	Unverified
4	AdaBound	Top 1 Accuracy	72.01	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AdaBound	Bit per Character (BPC)	2.86	—	Unverified
2	AdaShift	Bit per Character (BPC)	1.27	—	Unverified
3	AdamW	Bit per Character (BPC)	1.23	—	Unverified
4	AvaGrad	Bit per Character (BPC)	1.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Resnet18	Accuracy (max)	86.85	—	Unverified
2	Resnet34	Accuracy (max)	86.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Resnet18	Accuracy (max)	58.48	—	Unverified
2	Resnet34	Accuracy (max)	54.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SGD	Top 5 Accuracy	92.15	—	Unverified
2	Lookahead	Top 1 Accuracy	75.13	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Lookahead	Top 1 Accuracy	75.49	—	Unverified
2	SGD	Top 1 Accuracy	75.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Bert	Accuracy (max)	93.99	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Bert	Accuracy (max)	86.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MLP	NLL	0.05	—	Unverified