Stochastic Optimization

Stochastic Optimization is the task of optimizing certain objective functional by generating and using stochastic random variables. Usually the Stochastic Optimization is an iterative process of generating random variables that progressively finds out the minima or the maxima of the objective functional. Stochastic Optimization is usually applied in the non-convex functional spaces where the usual deterministic optimization such as linear or quadratic programming or their variants cannot be used.

Source: ASOC: An Adaptive Parameter-free Stochastic Optimization Techinique for Continuous Variables

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1051–1075 of 1387 papers

Title	Date	Tasks	Status
Proximal Reinforcement Learning: A New Theory of Sequential Decision Making in Primal-Dual Spaces	May 26, 2014	Decision Makingreinforcement-learning	—Unverified
Proximodistal Exploration in Motor Learning as an Emergent Property of Optimization	Dec 14, 2017	Stochastic Optimization	—Unverified
Public-data Assisted Private Stochastic Optimization: Power and Limitations	Mar 6, 2024	Stochastic Optimization	—Unverified
Quadruply Stochastic Gradients for Large Scale Nonlinear Semi-Supervised AUC Optimization	Jul 29, 2019	Stochastic Optimization	—Unverified
Quantization enabled Privacy Protection in Decentralized Stochastic Optimization	Aug 7, 2022	global-optimizationQuantization	—Unverified
Quantized Frank-Wolfe: Faster Optimization, Lower Communication, and Projection Free	Feb 17, 2019	Distributed OptimizationQuantization	—Unverified
Quantum Annealing for Dirichlet Process Mixture Models with Applications to Network Clustering	May 19, 2013	ClusteringStochastic Optimization	—Unverified
Query Complexity of Least Absolute Deviation Regression via Robust Uniform Convergence	Feb 3, 2021	Learning Theoryregression	—Unverified
Achieving Linear Speedup with ProxSkip in Distributed Stochastic Optimization	Oct 12, 2023	Distributed OptimizationFederated Learning	—Unverified
Random gradient extrapolation for distributed and stochastic optimization	Nov 15, 2017	Stochastic Optimization	—Unverified
Randomized Block Coordinate Descent for Online and Stochastic Optimization	Jul 1, 2014	Stochastic Optimization	—Unverified
Randomized Pairwise Learning with Adaptive Sampling: A PAC-Bayes Analysis	Apr 3, 2025	Metric LearningStochastic Optimization	—Unverified
Randomized Stochastic Variance-Reduced Methods for Multi-Task Stochastic Bilevel Optimization	May 5, 2021	Bilevel OptimizationStochastic Optimization	—Unverified
α^α-Rank: Practically Scaling α-Rank through Stochastic Optimisation	Sep 25, 2019	Stochastic Optimization	—Unverified
Realtime and Robust Hand Tracking from Depth	Jun 1, 2014	GPUStochastic Optimization	—Unverified
Recht-Ré Noncommutative Arithmetic-Geometric Mean Conjecture is False	Jun 2, 2020	Stochastic Optimization	—Unverified
Recht-Re Noncommutative Arithmetic-Geometric Mean Conjecture is False	Jan 1, 2020	Stochastic Optimization	—Unverified
Recht-Re Noncommutative Arithmetic-Geometric Mean Conjecture is False	Jan 1, 2020	Stochastic Optimization	—Unverified
Reducing the Model Order of Deep Neural Networks Using Information Theory	May 16, 2016	General ClassificationNetwork Pruning	—Unverified
Regret minimization in stochastic non-convex learning via a proximal-gradient approach	Oct 13, 2020	Stochastic Optimization	—Unverified
Regret Minimization with Noisy Observations	Jul 19, 2022	Stochastic Optimization	—Unverified
Reinforcement Learning Approaches for the Orienteering Problem with Stochastic and Dynamic Release Dates	Jul 2, 2022	Decision Makingreinforcement-learning	—Unverified
Removing Data Heterogeneity Influence Enhances Network Topology Dependence of Decentralized SGD	May 17, 2021	Stochastic Optimization	—Unverified
Renyi Differential Privacy of the Subsampled Shuffle Model in Distributed Learning	Jul 19, 2021	Federated LearningStochastic Optimization	—Unverified
Representation of forward performance criteria with random endowment via FBSDE and application to forward optimized certainty equivalent	Dec 29, 2023	Stochastic Optimization	—Unverified

Show:10 25 50

← PrevPage 43 of 56Next →

All datasets CIFAR-100 WRN-28-10 - 200 Epochs CIFAR-10 WRN-28-10 - 200 Epochs CIFAR-10 ResNet-18 - 200 Epochs ImageNet ResNet-50 - 90 Epochs Penn Treebank (Character Level) 3x1000 LSTM - 500 Epochs CIFAR-10 CIFAR-100 ImageNet ResNet-50 - 50 Epochs ImageNet ResNet-50 - 60 Epochs AG News CoLA MNIST

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	AvaGrad	Accuracy	81.24	—	Unverified
2	AdaShift	Accuracy	81.12	—	Unverified
3	Adam (eps-adjusted)	Accuracy	81.04	—	Unverified
4	SGD	Accuracy	80.95	—	Unverified
5	AdamW	Accuracy	79.87	—	Unverified
6	AdaBound	Accuracy	77.24	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Adam (eps-adjusted)	Accuracy	96.36	—	Unverified
2	AvaGrad	Accuracy	96.2	—	Unverified
3	SGD	Accuracy	96.14	—	Unverified
4	AdaShift	Accuracy	95.92	—	Unverified
5	AdamW	Accuracy	95.89	—	Unverified
6	AdaBound	Accuracy	94.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SGD - cosine LR schedule	Accuracy	95.55	—	Unverified
2	Lookahead	Accuracy	95.27	—	Unverified
3	SGD	Accuracy	95.23	—	Unverified
4	ADAM	Accuracy	94.84	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AvaGrad	Top 1 Accuracy	76.51	—	Unverified
2	SGD	Top 1 Accuracy	75.99	—	Unverified
3	AdamW	Top 1 Accuracy	72.9	—	Unverified
4	AdaBound	Top 1 Accuracy	72.01	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AdaBound	Bit per Character (BPC)	2.86	—	Unverified
2	AdaShift	Bit per Character (BPC)	1.27	—	Unverified
3	AdamW	Bit per Character (BPC)	1.23	—	Unverified
4	AvaGrad	Bit per Character (BPC)	1.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Resnet18	Accuracy (max)	86.85	—	Unverified
2	Resnet34	Accuracy (max)	86.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Resnet18	Accuracy (max)	58.48	—	Unverified
2	Resnet34	Accuracy (max)	54.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SGD	Top 5 Accuracy	92.15	—	Unverified
2	Lookahead	Top 1 Accuracy	75.13	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Lookahead	Top 1 Accuracy	75.49	—	Unverified
2	SGD	Top 1 Accuracy	75.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Bert	Accuracy (max)	93.99	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Bert	Accuracy (max)	86.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MLP	NLL	0.05	—	Unverified