SOTAVerified

Stochastic Optimization

Stochastic Optimization is the task of optimizing certain objective functional by generating and using stochastic random variables. Usually the Stochastic Optimization is an iterative process of generating random variables that progressively finds out the minima or the maxima of the objective functional. Stochastic Optimization is usually applied in the non-convex functional spaces where the usual deterministic optimization such as linear or quadratic programming or their variants cannot be used.

Source: ASOC: An Adaptive Parameter-free Stochastic Optimization Techinique for Continuous Variables

Papers

Showing 651700 of 1387 papers

TitleStatusHype
Stochastic Optimization under Distributional DriftCode0
Low-Complexity Algorithm for Restless Bandits with Imperfect Observations0
Stochastic Subgradient Descent Escapes Active Strict Saddles on Weakly Convex Functions0
Generalization Bounds using Lower Tail Exponents in Stochastic Optimizers0
A survey of Monte Carlo methods for noisy and costly densities with application to reinforcement learning and ABC0
Performance assessment and tuning of PID control using TLBO: the single-loop case and PI/P cascade case0
Towards a Sustainable Power Grid: Stochastic Hierarchical Planning for High Renewable Integration0
High Dimensional Differentially Private Stochastic Optimization with Heavy-tailed Data0
Differentiable Annealed Importance Sampling and the Perils of Gradient Noise0
ByPE-VAE: Bayesian Pseudocoresets Exemplar VAECode0
Renyi Differential Privacy of the Subsampled Shuffle Model in Distributed Learning0
Non-asymptotic estimates for TUSLA algorithm for non-convex learning with applications to neural networks with ReLU activation functionCode0
Improved Learning Rates for Stochastic Optimization: Two Theoretical Viewpoints0
Differentially Private Stochastic Optimization: New Results in Convex and Non-Convex Settings0
KOALA: A Kalman Optimization Algorithm with Loss Adaptivity0
Distributed stochastic optimization with large delays0
Momentum Accelerates the Convergence of Stochastic AUPRC Maximization0
High-probability Bounds for Non-Convex Stochastic Optimization with Heavy Tails0
Robust Distributed Optimization With Randomly Corrupted Gradients0
Bayesian Joint Chance Constrained Optimization: Approximations and Statistical Consistency0
Solving Stochastic Optimization with Expectation Constraints Efficiently by a Stochastic Augmented Lagrangian-Type Algorithm0
Asynchronous Stochastic Optimization Robust to Arbitrary Delays0
Compositional federated learning: Applications in distributionally robust averaging and meta learning0
The Perils of Learning Before Optimizing0
Stochastic Bias-Reduced Gradient Methods0
Private Federated Learning Without a Trusted Server: Optimal Algorithms for Convex LossesCode0
Joint Client Scheduling and Resource Allocation under Channel Uncertainty in Federated Learning0
Stochastic Optimization-Aided Energy-Efficient Information Collection in Internet of Underwater Things NetworksCode0
High Probability Complexity Bounds for Non-Smooth Stochastic Optimization with Heavy-Tailed NoiseCode0
Memory-Based Optimization Methods for Model-Agnostic Meta-Learning and Personalized Federated LearningCode0
Fractal Structure and Generalization Properties of Stochastic Optimization Algorithms0
A novel Deep Neural Network architecture for non-linear system identification0
Escaping Saddle Points Faster with Stochastic Momentum0
Bandwidth-based Step-Sizes for Non-Convex Stochastic Optimization0
An Even More Optimal Stochastic Optimization Algorithm: Minibatching and Interpolation Learning0
Stochastic Iterative Graph MatchingCode0
Stochastic Collapsed Variational Inference for Structured Gaussian Process Regression Network0
Combining resampling and reweighting for faithful stochastic optimization0
Polygonal Unadjusted Langevin Algorithms: Creating stable and efficient adaptive algorithms for neural networksCode0
Last iterate convergence of SGD for Least-Squares in the Interpolation regime.0
Stochastic optimization under time drift: iterate averaging, step-decay schedules, and high probability guarantees0
Gradient Clipping Helps in Non-Smooth Stochastic Optimization with Heavy-Tailed Noise0
Dynamic Trajectory and Offloading Control of UAV-enabled MEC under User Mobility0
Removing Data Heterogeneity Influence Enhances Network Topology Dependence of Decentralized SGD0
How to effectively use machine learning models to predict the solutions for optimization problems: lessons from loss function0
Scalable Projection-Free Optimization0
Randomized Stochastic Variance-Reduced Methods for Multi-Task Stochastic Bilevel Optimization0
Two-Stage Stochastic Optimization via Primal-Dual Decomposition and Deep Unrolling0
Learning swimming escape patterns for larval fish under energy constraints0
Fast Power Control Adaptation via Meta-Learning for Random Edge Graph Neural Networks0
Show:102550
← PrevPage 14 of 28Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AvaGradAccuracy81.24Unverified
2AdaShiftAccuracy81.12Unverified
3Adam (eps-adjusted)Accuracy81.04Unverified
4SGDAccuracy80.95Unverified
5AdamWAccuracy79.87Unverified
6AdaBoundAccuracy77.24Unverified
#ModelMetricClaimedVerifiedStatus
1Adam (eps-adjusted)Accuracy96.36Unverified
2AvaGradAccuracy96.2Unverified
3SGDAccuracy96.14Unverified
4AdaShiftAccuracy95.92Unverified
5AdamWAccuracy95.89Unverified
6AdaBoundAccuracy94.6Unverified
#ModelMetricClaimedVerifiedStatus
1SGD - cosine LR scheduleAccuracy95.55Unverified
2LookaheadAccuracy95.27Unverified
3SGDAccuracy95.23Unverified
4ADAMAccuracy94.84Unverified
#ModelMetricClaimedVerifiedStatus
1AvaGradTop 1 Accuracy76.51Unverified
2SGDTop 1 Accuracy75.99Unverified
3AdamWTop 1 Accuracy72.9Unverified
4AdaBoundTop 1 Accuracy72.01Unverified
#ModelMetricClaimedVerifiedStatus
1AdaBoundBit per Character (BPC)2.86Unverified
2AdaShiftBit per Character (BPC)1.27Unverified
3AdamWBit per Character (BPC)1.23Unverified
4AvaGradBit per Character (BPC)1.18Unverified
#ModelMetricClaimedVerifiedStatus
1Resnet18Accuracy (max)86.85Unverified
2Resnet34Accuracy (max)86.14Unverified
#ModelMetricClaimedVerifiedStatus
1Resnet18Accuracy (max)58.48Unverified
2Resnet34Accuracy (max)54.5Unverified
#ModelMetricClaimedVerifiedStatus
1SGDTop 5 Accuracy92.15Unverified
2LookaheadTop 1 Accuracy75.13Unverified
#ModelMetricClaimedVerifiedStatus
1LookaheadTop 1 Accuracy75.49Unverified
2SGDTop 1 Accuracy75.15Unverified
#ModelMetricClaimedVerifiedStatus
1BertAccuracy (max)93.99Unverified
#ModelMetricClaimedVerifiedStatus
1BertAccuracy (max)86.34Unverified
#ModelMetricClaimedVerifiedStatus
1MLPNLL0.05Unverified