Stochastic Optimization

Stochastic Optimization is the task of optimizing certain objective functional by generating and using stochastic random variables. Usually the Stochastic Optimization is an iterative process of generating random variables that progressively finds out the minima or the maxima of the objective functional. Stochastic Optimization is usually applied in the non-convex functional spaces where the usual deterministic optimization such as linear or quadratic programming or their variants cannot be used.

Source: ASOC: An Adaptive Parameter-free Stochastic Optimization Techinique for Continuous Variables

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 601–625 of 1387 papers

Title	Date	Tasks	Status
Distributed and Stochastic Optimization Methods with Gradient Compression and Local Steps	Dec 20, 2021	Stochastic Optimization	—Unverified
Correlated Product of Experts for Sparse Gaussian Process Regression	Dec 17, 2021	Gaussian Processesregression	—Unverified
Mathematical models of COVID-19 spread	Dec 10, 2021	ClassificationStochastic Optimization	—Unverified
A Continuous-time Stochastic Gradient Descent Method for Continuous Data	Dec 7, 2021	Stochastic OptimizationVariational Inference	—Unverified
MDPGT: Momentum-based Decentralized Policy Gradient Tracking	Dec 6, 2021	Multi-agent Reinforcement LearningPolicy Gradient Methods	CodeCode Available
Taming Communication and Sample Complexities in Decentralized Policy Evaluation for Cooperative Multi-Agent Reinforcement Learning	Dec 1, 2021	Multi-agent Reinforcement LearningReinforcement Learning (RL)	—Unverified
On the Bias-Variance-Cost Tradeoff of Stochastic Optimization	Dec 1, 2021	Bilevel OptimizationStochastic Optimization	—Unverified
Neural Stochastic Dual Dynamic Programming	Dec 1, 2021	Stochastic Optimization	—Unverified
Convergence of adaptive algorithms for constrained weakly convex optimization	Dec 1, 2021	Stochastic Optimization	—Unverified
Test-Time Classifier Adjustment Module for Model-Agnostic Domain Generalization	Dec 1, 2021	Domain GeneralizationStochastic Optimization	—Unverified
Adaptive First- and Second-Order Algorithms for Large-Scale Machine Learning	Nov 29, 2021	BIG-bench Machine LearningDeep Learning	—Unverified
Distributed Policy Gradient with Variance Reduction in Multi-Agent Reinforcement Learning	Nov 25, 2021	Multi-agent Reinforcement Learningreinforcement-learning	—Unverified
Learning to Schedule Heuristics for the Simultaneous Stochastic Optimization of Mining Complexes	Nov 24, 2021	Combinatorial OptimizationReinforcement Learning (RL)	—Unverified
PredProp: Bidirectional Stochastic Optimization with Precision Weighted Predictive Coding	Nov 16, 2021	DecoderStochastic Optimization	—Unverified
Efficient Projection-Free Online Convex Optimization with Membership Oracle	Nov 10, 2021	Stochastic Optimization	—Unverified
Linear Speedup in Personalized Collaborative Learning	Nov 10, 2021	Federated LearningStochastic Optimization	CodeCode Available
Does Momentum Help? A Sample Complexity Analysis	Oct 29, 2021	Stochastic Optimization	—Unverified
Fair Incentives for Repeated Engagement	Oct 28, 2021	Decision MakingFairness	—Unverified
Fast Distributed Stochastic Scheduling for A Multi-Energy Industrial Park	Oct 27, 2021	energy managementManagement	—Unverified
Projection-Free Algorithm for Stochastic Bi-level Optimization	Oct 22, 2021	DenoisingMatrix Completion	—Unverified
Variational Wasserstein Barycenters with c-Cyclical Monotonicity	Oct 22, 2021	Stochastic Optimization	—Unverified
Predictive machine learning for prescriptive applications: a coupled training-validating approach	Oct 22, 2021	BIG-bench Machine LearningDecision Making	—Unverified
Stochastic Learning Rate Optimization in the Stochastic Approximation and Online Learning Settings	Oct 20, 2021	Stochastic Optimization	—Unverified
Multilevel Stochastic Optimization for Imputation in Massive Medical Data Records	Oct 19, 2021	ImputationStochastic Optimization	—Unverified
A Q-Learning-based Approach for Distributed Beam Scheduling in mmWave Networks	Oct 17, 2021	ManagementQ-Learning	—Unverified

Show:10 25 50

← PrevPage 25 of 56Next →

All datasets CIFAR-100 WRN-28-10 - 200 Epochs CIFAR-10 WRN-28-10 - 200 Epochs CIFAR-10 ResNet-18 - 200 Epochs ImageNet ResNet-50 - 90 Epochs Penn Treebank (Character Level) 3x1000 LSTM - 500 Epochs CIFAR-10 CIFAR-100 ImageNet ResNet-50 - 50 Epochs ImageNet ResNet-50 - 60 Epochs AG News CoLA MNIST

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	AvaGrad	Accuracy	81.24	—	Unverified
2	AdaShift	Accuracy	81.12	—	Unverified
3	Adam (eps-adjusted)	Accuracy	81.04	—	Unverified
4	SGD	Accuracy	80.95	—	Unverified
5	AdamW	Accuracy	79.87	—	Unverified
6	AdaBound	Accuracy	77.24	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Adam (eps-adjusted)	Accuracy	96.36	—	Unverified
2	AvaGrad	Accuracy	96.2	—	Unverified
3	SGD	Accuracy	96.14	—	Unverified
4	AdaShift	Accuracy	95.92	—	Unverified
5	AdamW	Accuracy	95.89	—	Unverified
6	AdaBound	Accuracy	94.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SGD - cosine LR schedule	Accuracy	95.55	—	Unverified
2	Lookahead	Accuracy	95.27	—	Unverified
3	SGD	Accuracy	95.23	—	Unverified
4	ADAM	Accuracy	94.84	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AvaGrad	Top 1 Accuracy	76.51	—	Unverified
2	SGD	Top 1 Accuracy	75.99	—	Unverified
3	AdamW	Top 1 Accuracy	72.9	—	Unverified
4	AdaBound	Top 1 Accuracy	72.01	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AdaBound	Bit per Character (BPC)	2.86	—	Unverified
2	AdaShift	Bit per Character (BPC)	1.27	—	Unverified
3	AdamW	Bit per Character (BPC)	1.23	—	Unverified
4	AvaGrad	Bit per Character (BPC)	1.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Resnet18	Accuracy (max)	86.85	—	Unverified
2	Resnet34	Accuracy (max)	86.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Resnet18	Accuracy (max)	58.48	—	Unverified
2	Resnet34	Accuracy (max)	54.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SGD	Top 5 Accuracy	92.15	—	Unverified
2	Lookahead	Top 1 Accuracy	75.13	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Lookahead	Top 1 Accuracy	75.49	—	Unverified
2	SGD	Top 1 Accuracy	75.15	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Bert	Accuracy (max)	93.99	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Bert	Accuracy (max)	86.34	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MLP	NLL	0.05	—	Unverified