Stochastic Optimization

Stochastic Optimization is the task of optimizing certain objective functional by generating and using stochastic random variables. Usually the Stochastic Optimization is an iterative process of generating random variables that progressively finds out the minima or the maxima of the objective functional. Stochastic Optimization is usually applied in the non-convex functional spaces where the usual deterministic optimization such as linear or quadratic programming or their variants cannot be used.

Source: ASOC: An Adaptive Parameter-free Stochastic Optimization Techinique for Continuous Variables

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 926–950 of 1387 papers

Title	Date	Tasks	Status
Proactive Optimization with Machine Learning: Femto-caching with Future Content Popularity	Oct 29, 2019	BIG-bench Machine LearningStochastic Optimization	—Unverified
Adaptive Sampling Quasi-Newton Methods for Derivative-Free Stochastic Optimization	Oct 29, 2019	reinforcement-learningReinforcement Learning	—Unverified
An Adaptive and Momental Bound Method for Stochastic Learning	Oct 27, 2019	Stochastic Optimization	CodeCode Available
Prior Specification for Bayesian Matrix Factorization via Prior Predictive Matching	Oct 27, 2019	Bayesian OptimizationHyperparameter Optimization	CodeCode Available
Katyusha Acceleration for Convex Finite-Sum Compositional Optimization	Oct 24, 2019	Stochastic Optimization	—Unverified
Gradient Sparification for Asynchronous Distributed Training	Oct 24, 2019	Federated LearningStochastic Optimization	—Unverified
The Practicality of Stochastic Optimization in Imaging Inverse Problems	Oct 22, 2019	DeblurringImage Deblurring	—Unverified
Robust Distributed Accelerated Stochastic Gradient Methods for Multi-Agent Networks	Oct 19, 2019	Stochastic Optimization	—Unverified
Robust Learning Rate Selection for Stochastic Optimization via Splitting Diagnostic	Oct 18, 2019	DiagnosticStochastic Optimization	—Unverified
Improving the Sample and Communication Complexity for Decentralized Non-Convex Optimization: A Joint Gradient Estimation and Tracking Approach	Oct 13, 2019	Stochastic Optimization	—Unverified
Projection-free nonconvex stochastic optimization on Riemannian manifolds	Oct 9, 2019	Stochastic Optimization	—Unverified
Variance-Reduced Decentralized Stochastic Optimization with Gradient Tracking -- Part II: GT-SVRG	Oct 8, 2019	Stochastic Optimization	—Unverified
FIS-GAN: GAN with Flow-based Importance Sampling	Oct 6, 2019	Density EstimationStochastic Optimization	—Unverified
Tightening Bounds for Variational Inference by Revisiting Perturbation Theory	Sep 30, 2019	Gaussian ProcessesStochastic Optimization	—Unverified
Model Predictive Control-Based Battery Scheduling and Incentives to Manipulate Demand Response Baselines	Sep 26, 2019	Model Predictive ControlScheduling	—Unverified
A Non-asymptotic comparison of SVRG and SGD: tradeoffs between compute and speed	Sep 25, 2019	Computational Efficiencyregression	—Unverified
α^α-Rank: Practically Scaling α-Rank through Stochastic Optimisation	Sep 25, 2019	Stochastic Optimization	—Unverified
Statistical Adaptive Stochastic Optimization	Sep 25, 2019	SchedulingStochastic Optimization	—Unverified
Accelerating First-Order Optimization Algorithms	Sep 25, 2019	Stochastic Optimization	—Unverified
Learning to Anneal and Prune Proximity Graphs for Similarity Search	Sep 25, 2019	Stochastic Optimization	—Unverified
Localizing and Amortizing: Efficient Inference for Gaussian Processes	Sep 25, 2019	Gaussian ProcessesStochastic Optimization	—Unverified
Geometry, Computation, and Optimality in Stochastic Optimization	Sep 23, 2019	Stochastic Optimization	—Unverified
Using Statistics to Automate Stochastic Optimization	Sep 21, 2019	Stochastic Optimization	—Unverified
Robust Opponent Modeling via Adversarial Ensemble Reinforcement Learning in Asymmetric Imperfect-Information Games	Sep 18, 2019	reinforcement-learningReinforcement Learning	—Unverified
Communication-Censored Distributed Stochastic Gradient Descent	Sep 9, 2019	QuantizationStochastic Optimization	CodeCode Available

Show:10 25 50

← PrevPage 38 of 56Next →

All datasets CIFAR-100 WRN-28-10 - 200 Epochs CIFAR-10 WRN-28-10 - 200 Epochs CIFAR-10 ResNet-18 - 200 Epochs ImageNet ResNet-50 - 90 Epochs Penn Treebank (Character Level) 3x1000 LSTM - 500 Epochs CIFAR-10 CIFAR-100 ImageNet ResNet-50 - 50 Epochs ImageNet ResNet-50 - 60 Epochs AG News CoLA MNIST

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	AvaGrad	Accuracy	81.24	—	Unverified
2	AdaShift	Accuracy	81.12	—	Unverified
3	Adam (eps-adjusted)	Accuracy	81.04	—	Unverified
4	SGD	Accuracy	80.95	—	Unverified
5	AdamW	Accuracy	79.87	—	Unverified
6	AdaBound	Accuracy	77.24	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Adam (eps-adjusted)	Accuracy	96.36	—	Unverified
2	AvaGrad	Accuracy	96.2	—	Unverified
3	SGD	Accuracy	96.14	—	Unverified
4	AdaShift	Accuracy	95.92	—	Unverified
5	AdamW	Accuracy	95.89	—	Unverified
6	AdaBound	Accuracy	94.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SGD - cosine LR schedule	Accuracy	95.55	—	Unverified
2	Lookahead	Accuracy	95.27	—	Unverified
3	SGD	Accuracy	95.23	—	Unverified
4	ADAM	Accuracy	94.84	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AvaGrad	Top 1 Accuracy	76.51	—	Unverified
2	SGD	Top 1 Accuracy	75.99	—	Unverified
3	AdamW	Top 1 Accuracy	72.9	—	Unverified
4	AdaBound	Top 1 Accuracy	72.01	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AdaBound	Bit per Character (BPC)	2.86	—	Unverified
2	AdaShift	Bit per Character (BPC)	1.27	—	Unverified
3	AdamW	Bit per Character (BPC)	1.23	—	Unverified
4	AvaGrad	Bit per Character (BPC)	1.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Resnet18	Accuracy (max)	86.85	—	Unverified
2	Resnet34	Accuracy (max)	86.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Resnet18	Accuracy (max)	58.48	—	Unverified
2	Resnet34	Accuracy (max)	54.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SGD	Top 5 Accuracy	92.15	—	Unverified
2	Lookahead	Top 1 Accuracy	75.13	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Lookahead	Top 1 Accuracy	75.49	—	Unverified
2	SGD	Top 1 Accuracy	75.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Bert	Accuracy (max)	93.99	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Bert	Accuracy (max)	86.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MLP	NLL	0.05	—	Unverified