SOTAVerified

Stochastic Optimization

Stochastic Optimization is the task of optimizing certain objective functional by generating and using stochastic random variables. Usually the Stochastic Optimization is an iterative process of generating random variables that progressively finds out the minima or the maxima of the objective functional. Stochastic Optimization is usually applied in the non-convex functional spaces where the usual deterministic optimization such as linear or quadratic programming or their variants cannot be used.

Source: ASOC: An Adaptive Parameter-free Stochastic Optimization Techinique for Continuous Variables

Papers

Showing 851900 of 1387 papers

TitleStatusHype
Adaptivity of Stochastic Gradient Methods for Nonconvex OptimizationCode1
A Second look at Exponential and Cosine Step Sizes: Simplicity, Adaptivity, and PerformanceCode0
Stochastic Online Optimization using Kalman Recursion0
A Diffusion Theory For Deep Learning Dynamics: Stochastic Gradient Descent Exponentially Favors Flat Minima0
Developing a Hybrid Data-Driven, Mechanistic Virtual Flow Meter -- a Case Study0
Macroscopic Traffic Flow Modeling with Physics Regularized Gaussian Process: A New Insight into Machine Learning Applications0
Self-Directed Online Machine Learning for Topology OptimizationCode1
A Kernel Mean Embedding Approach to Reducing Conservativeness in Stochastic Programming and ControlCode0
Stochastic Optimization of Plain Convolutional Neural Networks with Simple methodsCode0
Zeroth-Order Algorithms for Nonconvex Minimax Problems with Improved Complexities0
Dual Stochastic Natural Gradient Descent and convergence of interior half-space gradient approximations0
Adaptive Stochastic Optimization0
On the Trend-corrected Variant of Adaptive Stochastic Optimization Methods0
Efficient Debiased Evidence Estimation by Multilevel Monte Carlo Sampling0
Recht-Re Noncommutative Arithmetic-Geometric Mean Conjecture is False0
Self-Modulating Nonparametric Event-Tensor Factorization0
Improving the Sample and Communication Complexity for Decentralized Non-Convex Optimization: Joint Gradient Estimation and Tracking0
Recht-Re Noncommutative Arithmetic-Geometric Mean Conjecture is False0
A Dynamic Sampling Adaptive-SGD Method for Machine Learning0
Stochastic Recursive Variance Reduction for Efficient Smooth Non-Convex Compositional Optimization0
Stochastic gradient-free descents0
CProp: Adaptive Learning Rate Scaling from Past Gradient ConformityCode0
Zeroth-order Stochastic Compositional Algorithms for Risk-Aware Learning0
Bridging the Gap between Community and Node Representations: Graph Embedding via Community DetectionCode0
Cyanure: An Open-Source Toolbox for Empirical Risk Minimization for Python, C++, and soon moreCode0
Complexity of Stochastic Dual Dynamic Programming0
From Reinforcement Learning to Optimal Control: A unified framework for sequential decisions0
Scalable Variational Bayesian Kernel Selection for Sparse Gaussian Process Regression0
Lower Bounds for Non-Convex Stochastic Optimization0
Domain-independent Dominance of Adaptive MethodsCode0
Efficient Relaxed Gradient Support Pursuit for Sparsity Constrained Non-convex Optimization0
Identifying Cognitive Radars -- Inverse Reinforcement Learning using Revealed Preferences0
Thinning for Accelerating the Learning of Point Processes0
Think out of the "Box": Generically-Constrained Asynchronous Composite Optimization and Hedging0
Efficient Smooth Non-Convex Stochastic Compositional Optimization via Stochastic Recursive Gradient Descent0
A Communication Efficient Stochastic Multi-Block Alternating Direction Method of Multipliers0
Online Structured Sparsity-based Moving Object Detection from Satellite Videos0
Learning Neural Search Policies for Classical Planning0
ORL: Reinforcement Learning Benchmarks for Online Stochastic Optimization ProblemsCode1
A Sub-sampled Tensor Method for Non-convex Optimization0
Parameter-Free Locally Differentially Private Stochastic Subgradient Descent0
Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case GeneralizationCode1
Gamifying the Vehicle Routing Problem with Stochastic Requests0
Stochastic DCA for minimizing a large sum of DC functions with application to Multi-class Logistic Regression0
Community Detection for Power Systems Network Aggregation Considering Renewable Variability0
Continual Multi-task Gaussian ProcessesCode0
Mixing of Stochastic Accelerated Gradient Descent0
SPARQ-SGD: Event-Triggered and Compressed Communication in Decentralized Stochastic Optimization0
Linear Speedup in Saddle-Point Escape for Decentralized Non-Convex Optimization0
Understanding the Role of Momentum in Stochastic Gradient MethodsCode0
Show:102550
← PrevPage 18 of 28Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AvaGradAccuracy81.24Unverified
2AdaShiftAccuracy81.12Unverified
3Adam (eps-adjusted)Accuracy81.04Unverified
4SGDAccuracy80.95Unverified
5AdamWAccuracy79.87Unverified
6AdaBoundAccuracy77.24Unverified
#ModelMetricClaimedVerifiedStatus
1Adam (eps-adjusted)Accuracy96.36Unverified
2AvaGradAccuracy96.2Unverified
3SGDAccuracy96.14Unverified
4AdaShiftAccuracy95.92Unverified
5AdamWAccuracy95.89Unverified
6AdaBoundAccuracy94.6Unverified
#ModelMetricClaimedVerifiedStatus
1SGD - cosine LR scheduleAccuracy95.55Unverified
2LookaheadAccuracy95.27Unverified
3SGDAccuracy95.23Unverified
4ADAMAccuracy94.84Unverified
#ModelMetricClaimedVerifiedStatus
1AvaGradTop 1 Accuracy76.51Unverified
2SGDTop 1 Accuracy75.99Unverified
3AdamWTop 1 Accuracy72.9Unverified
4AdaBoundTop 1 Accuracy72.01Unverified
#ModelMetricClaimedVerifiedStatus
1AdaBoundBit per Character (BPC)2.86Unverified
2AdaShiftBit per Character (BPC)1.27Unverified
3AdamWBit per Character (BPC)1.23Unverified
4AvaGradBit per Character (BPC)1.18Unverified
#ModelMetricClaimedVerifiedStatus
1Resnet18Accuracy (max)86.85Unverified
2Resnet34Accuracy (max)86.14Unverified
#ModelMetricClaimedVerifiedStatus
1Resnet18Accuracy (max)58.48Unverified
2Resnet34Accuracy (max)54.5Unverified
#ModelMetricClaimedVerifiedStatus
1SGDTop 5 Accuracy92.15Unverified
2LookaheadTop 1 Accuracy75.13Unverified
#ModelMetricClaimedVerifiedStatus
1LookaheadTop 1 Accuracy75.49Unverified
2SGDTop 1 Accuracy75.15Unverified
#ModelMetricClaimedVerifiedStatus
1BertAccuracy (max)93.99Unverified
#ModelMetricClaimedVerifiedStatus
1BertAccuracy (max)86.34Unverified
#ModelMetricClaimedVerifiedStatus
1MLPNLL0.05Unverified