Stochastic Optimization

Stochastic Optimization is the task of optimizing certain objective functional by generating and using stochastic random variables. Usually the Stochastic Optimization is an iterative process of generating random variables that progressively finds out the minima or the maxima of the objective functional. Stochastic Optimization is usually applied in the non-convex functional spaces where the usual deterministic optimization such as linear or quadratic programming or their variants cannot be used.

Source: ASOC: An Adaptive Parameter-free Stochastic Optimization Techinique for Continuous Variables

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1001–1025 of 1387 papers

Title	Date	Tasks	Status
Two-Stage Stochastic Optimization for Low-Carbon Dispatch in a Combined Energy System	Nov 11, 2024	SchedulingStochastic Optimization	—Unverified
Two-Stage Stochastic Optimization via Primal-Dual Decomposition and Deep Unrolling	May 5, 2021	Rolling Shutter CorrectionStochastic Optimization	—Unverified
Two-Tailed Averaging: Anytime, Adaptive, Once-in-a-While Optimal Weight Averaging for Better Generalization	Sep 26, 2022	Stochastic Optimization	—Unverified
Two-timescale Resource Allocation for Automated Networks in IIoT	Mar 24, 2022	channel selectionenergy management	—Unverified
UAdam: Unified Adam-Type Algorithmic Framework for Non-Convex Stochastic Optimization	May 9, 2023	Stochastic OptimizationVocal Bursts Type Prediction	—Unverified
UAV Formation and Resource Allocation Optimization for Communication-Assisted 3D InSAR Sensing	Jul 9, 2024	Stochastic Optimization	—Unverified
UFO-BLO: Unbiased First-Order Bilevel Optimization	Jun 5, 2020	Adversarial RobustnessBilevel Optimization	—Unverified
Uncertainty Informed Optimal Resource Allocation with Gaussian Process based Bayesian Inference	Jun 30, 2023	Bayesian InferenceGaussian Processes	—Unverified
Underage Detection through a Multi-Task and MultiAge Approach for Screening Minors in Unconstrained Imagery	Jun 12, 2025	Age EstimationOverall - Test	—Unverified
Understanding and Detecting Convergence for Stochastic Gradient Descent with Momentum	Aug 27, 2020	DiagnosticStochastic Optimization	—Unverified
Understanding the Generalization Error of Markov algorithms through Poissonization	Feb 11, 2025	Generalization BoundsStochastic Optimization	—Unverified
Uniform-in-Time Wasserstein Stability Bounds for (Noisy) Stochastic Gradient Descent	May 20, 2023	Generalization BoundsLearning Theory	—Unverified
Uniform-in-Time Weak Error Analysis for Stochastic Gradient Descent Algorithms via Diffusion Approximation	Feb 2, 2019	Stochastic Optimization	—Unverified
Unit Tests for Stochastic Optimization	Dec 20, 2013	Stochastic Optimization	—Unverified
Universal Convexification via Risk-Aversion	Jun 3, 2014	Stochastic Optimization	—Unverified
Universal discriminative quantum neural networks	May 22, 2018	Quantum Machine LearningStochastic Optimization	—Unverified
Unsupervised Alignment of Distributional Word Embeddings	Mar 9, 2022	Bilingual Lexicon InductionMachine Translation	—Unverified
Urban Fire Station Location Planning using Predicted Demand and Service Quality Index	Sep 5, 2021	Stochastic Optimization	—Unverified
Using Large Ensembles of Control Variates for Variational Inference	Oct 30, 2018	Stochastic OptimizationVariational Inference	—Unverified
Variable Selection via Thompson Sampling	Jul 1, 2020	BIG-bench Machine LearningInterpretable Machine Learning	—Unverified
Variance-Reduced and Projection-Free Stochastic Optimization	Feb 5, 2016	Stochastic Optimization	—Unverified
Variance-Reduced Decentralized Stochastic Optimization with Gradient Tracking -- Part II: GT-SVRG	Oct 8, 2019	Stochastic Optimization	—Unverified
Variance-reduced first-order methods for deterministically constrained stochastic nonconvex optimization with strong convergence guarantees	Sep 16, 2024	Stochastic Optimization	—Unverified
Variance-Reduced Methods for Machine Learning	Oct 2, 2020	BIG-bench Machine LearningStochastic Optimization	—Unverified
Variance-Reduced Off-Policy Memory-Efficient Policy Search	Sep 14, 2020	Reinforcement Learning (RL)Stochastic Optimization	—Unverified

Show:10 25 50

← PrevPage 41 of 56Next →

All datasets CIFAR-100 WRN-28-10 - 200 Epochs CIFAR-10 WRN-28-10 - 200 Epochs CIFAR-10 ResNet-18 - 200 Epochs ImageNet ResNet-50 - 90 Epochs Penn Treebank (Character Level) 3x1000 LSTM - 500 Epochs CIFAR-10 CIFAR-100 ImageNet ResNet-50 - 50 Epochs ImageNet ResNet-50 - 60 Epochs AG News CoLA MNIST

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	AvaGrad	Accuracy	81.24	—	Unverified
2	AdaShift	Accuracy	81.12	—	Unverified
3	Adam (eps-adjusted)	Accuracy	81.04	—	Unverified
4	SGD	Accuracy	80.95	—	Unverified
5	AdamW	Accuracy	79.87	—	Unverified
6	AdaBound	Accuracy	77.24	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Adam (eps-adjusted)	Accuracy	96.36	—	Unverified
2	AvaGrad	Accuracy	96.2	—	Unverified
3	SGD	Accuracy	96.14	—	Unverified
4	AdaShift	Accuracy	95.92	—	Unverified
5	AdamW	Accuracy	95.89	—	Unverified
6	AdaBound	Accuracy	94.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SGD - cosine LR schedule	Accuracy	95.55	—	Unverified
2	Lookahead	Accuracy	95.27	—	Unverified
3	SGD	Accuracy	95.23	—	Unverified
4	ADAM	Accuracy	94.84	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AvaGrad	Top 1 Accuracy	76.51	—	Unverified
2	SGD	Top 1 Accuracy	75.99	—	Unverified
3	AdamW	Top 1 Accuracy	72.9	—	Unverified
4	AdaBound	Top 1 Accuracy	72.01	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AdaBound	Bit per Character (BPC)	2.86	—	Unverified
2	AdaShift	Bit per Character (BPC)	1.27	—	Unverified
3	AdamW	Bit per Character (BPC)	1.23	—	Unverified
4	AvaGrad	Bit per Character (BPC)	1.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Resnet18	Accuracy (max)	86.85	—	Unverified
2	Resnet34	Accuracy (max)	86.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Resnet18	Accuracy (max)	58.48	—	Unverified
2	Resnet34	Accuracy (max)	54.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SGD	Top 5 Accuracy	92.15	—	Unverified
2	Lookahead	Top 1 Accuracy	75.13	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Lookahead	Top 1 Accuracy	75.49	—	Unverified
2	SGD	Top 1 Accuracy	75.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Bert	Accuracy (max)	93.99	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Bert	Accuracy (max)	86.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MLP	NLL	0.05	—	Unverified