Stochastic Optimization

Stochastic Optimization is the task of optimizing certain objective functional by generating and using stochastic random variables. Usually the Stochastic Optimization is an iterative process of generating random variables that progressively finds out the minima or the maxima of the objective functional. Stochastic Optimization is usually applied in the non-convex functional spaces where the usual deterministic optimization such as linear or quadratic programming or their variants cannot be used.

Source: ASOC: An Adaptive Parameter-free Stochastic Optimization Techinique for Continuous Variables

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 676–700 of 1387 papers

Title	Date	Tasks	Status
Private Federated Learning Without a Trusted Server: Optimal Algorithms for Convex Losses	Jun 17, 2021	Federated LearningStochastic Optimization	CodeCode Available
Joint Client Scheduling and Resource Allocation under Channel Uncertainty in Federated Learning	Jun 12, 2021	Federated LearningScheduling	—Unverified
Stochastic Optimization-Aided Energy-Efficient Information Collection in Internet of Underwater Things Networks	Jun 10, 2021	Stochastic Optimization	CodeCode Available
High Probability Complexity Bounds for Non-Smooth Stochastic Optimization with Heavy-Tailed Noise	Jun 10, 2021	Stochastic Optimization	CodeCode Available
Memory-Based Optimization Methods for Model-Agnostic Meta-Learning and Personalized Federated Learning	Jun 9, 2021	Continual LearningFederated Learning	CodeCode Available
Fractal Structure and Generalization Properties of Stochastic Optimization Algorithms	Jun 9, 2021	Generalization BoundsLearning Theory	—Unverified
A novel Deep Neural Network architecture for non-linear system identification	Jun 6, 2021	Inductive BiasStochastic Optimization	—Unverified
Escaping Saddle Points Faster with Stochastic Momentum	Jun 5, 2021	Open-Ended Question AnsweringStochastic Optimization	—Unverified
Bandwidth-based Step-Sizes for Non-Convex Stochastic Optimization	Jun 5, 2021	Stochastic Optimization	—Unverified
An Even More Optimal Stochastic Optimization Algorithm: Minibatching and Interpolation Learning	Jun 4, 2021	Stochastic Optimization	—Unverified
Stochastic Iterative Graph Matching	Jun 4, 2021	Graph MatchingStochastic Optimization	CodeCode Available
Stochastic Collapsed Variational Inference for Structured Gaussian Process Regression Network	Jun 1, 2021	ImputationMissing Values	—Unverified
Combining resampling and reweighting for faithful stochastic optimization	May 31, 2021	Computational chemistryStochastic Optimization	—Unverified
Polygonal Unadjusted Langevin Algorithms: Creating stable and efficient adaptive algorithms for neural networks	May 28, 2021	Deep LearningStochastic Optimization	CodeCode Available
Last iterate convergence of SGD for Least-Squares in the Interpolation regime.	May 21, 2021	Stochastic Optimization	—Unverified
Stochastic optimization under time drift: iterate averaging, step-decay schedules, and high probability guarantees	May 21, 2021	Stochastic Optimizationvalid	—Unverified
Gradient Clipping Helps in Non-Smooth Stochastic Optimization with Heavy-Tailed Noise	May 21, 2021	Stochastic Optimization	—Unverified
Dynamic Trajectory and Offloading Control of UAV-enabled MEC under User Mobility	May 19, 2021	Stochastic Optimization	—Unverified
Removing Data Heterogeneity Influence Enhances Network Topology Dependence of Decentralized SGD	May 17, 2021	Stochastic Optimization	—Unverified
How to effectively use machine learning models to predict the solutions for optimization problems: lessons from loss function	May 14, 2021	BIG-bench Machine LearningStochastic Optimization	—Unverified
Scalable Projection-Free Optimization	May 7, 2021	Stochastic Optimization	—Unverified
Randomized Stochastic Variance-Reduced Methods for Multi-Task Stochastic Bilevel Optimization	May 5, 2021	Bilevel OptimizationStochastic Optimization	—Unverified
Two-Stage Stochastic Optimization via Primal-Dual Decomposition and Deep Unrolling	May 5, 2021	Rolling Shutter CorrectionStochastic Optimization	—Unverified
Learning swimming escape patterns for larval fish under energy constraints	May 3, 2021	reinforcement-learningReinforcement Learning	—Unverified
Fast Power Control Adaptation via Meta-Learning for Random Edge Graph Neural Networks	May 2, 2021	Graph Neural NetworkMeta-Learning	—Unverified

Show:10 25 50

← PrevPage 28 of 56Next →

All datasets CIFAR-100 WRN-28-10 - 200 Epochs CIFAR-10 WRN-28-10 - 200 Epochs CIFAR-10 ResNet-18 - 200 Epochs ImageNet ResNet-50 - 90 Epochs Penn Treebank (Character Level) 3x1000 LSTM - 500 Epochs CIFAR-10 CIFAR-100 ImageNet ResNet-50 - 50 Epochs ImageNet ResNet-50 - 60 Epochs AG News CoLA MNIST

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	AvaGrad	Accuracy	81.24	—	Unverified
2	AdaShift	Accuracy	81.12	—	Unverified
3	Adam (eps-adjusted)	Accuracy	81.04	—	Unverified
4	SGD	Accuracy	80.95	—	Unverified
5	AdamW	Accuracy	79.87	—	Unverified
6	AdaBound	Accuracy	77.24	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Adam (eps-adjusted)	Accuracy	96.36	—	Unverified
2	AvaGrad	Accuracy	96.2	—	Unverified
3	SGD	Accuracy	96.14	—	Unverified
4	AdaShift	Accuracy	95.92	—	Unverified
5	AdamW	Accuracy	95.89	—	Unverified
6	AdaBound	Accuracy	94.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SGD - cosine LR schedule	Accuracy	95.55	—	Unverified
2	Lookahead	Accuracy	95.27	—	Unverified
3	SGD	Accuracy	95.23	—	Unverified
4	ADAM	Accuracy	94.84	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AvaGrad	Top 1 Accuracy	76.51	—	Unverified
2	SGD	Top 1 Accuracy	75.99	—	Unverified
3	AdamW	Top 1 Accuracy	72.9	—	Unverified
4	AdaBound	Top 1 Accuracy	72.01	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AdaBound	Bit per Character (BPC)	2.86	—	Unverified
2	AdaShift	Bit per Character (BPC)	1.27	—	Unverified
3	AdamW	Bit per Character (BPC)	1.23	—	Unverified
4	AvaGrad	Bit per Character (BPC)	1.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Resnet18	Accuracy (max)	86.85	—	Unverified
2	Resnet34	Accuracy (max)	86.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Resnet18	Accuracy (max)	58.48	—	Unverified
2	Resnet34	Accuracy (max)	54.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SGD	Top 5 Accuracy	92.15	—	Unverified
2	Lookahead	Top 1 Accuracy	75.13	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Lookahead	Top 1 Accuracy	75.49	—	Unverified
2	SGD	Top 1 Accuracy	75.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Bert	Accuracy (max)	93.99	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Bert	Accuracy (max)	86.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MLP	NLL	0.05	—	Unverified