SOTAVerified

Stochastic Optimization

Stochastic Optimization is the task of optimizing certain objective functional by generating and using stochastic random variables. Usually the Stochastic Optimization is an iterative process of generating random variables that progressively finds out the minima or the maxima of the objective functional. Stochastic Optimization is usually applied in the non-convex functional spaces where the usual deterministic optimization such as linear or quadratic programming or their variants cannot be used.

Source: ASOC: An Adaptive Parameter-free Stochastic Optimization Techinique for Continuous Variables

Papers

Showing 301350 of 1387 papers

TitleStatusHype
Deep learning with Elastic Averaging SGDCode0
Learning From Scenarios for Stochastic Repairable SchedulingCode0
Continual Multi-task Gaussian ProcessesCode0
A deep generative model for gene expression profiles from single-cell RNA sequencingCode0
Cauchy noise loss for stochastic optimization of random matrix models via free deterministic equivalentsCode0
Continuous-time Models for Stochastic Optimization AlgorithmsCode0
DeepOBS: A Deep Learning Optimizer Benchmark SuiteCode0
Log Barriers for Safe Black-box Optimization with Application to Safe Reinforcement LearningCode0
CatCMA with Margin: Stochastic Optimization for Continuous, Integer, and Categorical VariablesCode0
Stochastic regularized majorization-minimization with weakly convex and multi-convex surrogatesCode0
Active Probabilistic Inference on Matrices for Pre-Conditioning in Stochastic OptimizationCode0
Minimax AUC Fairness: Efficient Algorithm with Provable ConvergenceCode0
CatCMA : Stochastic Optimization for Mixed-Category ProblemsCode0
A Nearly Optimal Single Loop Algorithm for Stochastic Bilevel Optimization under Unbounded SmoothnessCode0
Deep Stochastic Optimization in FinanceCode0
Navigating Demand Uncertainty in Container Shipping: Deep Reinforcement Learning for Enabling Adaptive and Feasible Master Stowage PlanningCode0
Towards Faster Decentralized Stochastic Optimization with Communication CompressionCode0
High Probability Complexity Bounds for Non-Smooth Stochastic Optimization with Heavy-Tailed NoiseCode0
Decentralized Stochastic Optimization and Gossip Algorithms with Compressed CommunicationCode0
Convolutional Sketch InversionCode0
CoolMomentum: A Method for Stochastic Optimization by Langevin Dynamics with Simulated AnnealingCode0
An Efficient Stochastic Algorithm for Decentralized Nonconvex-Strongly-Concave Minimax OptimizationCode0
Decision-Dependent Stochastic Optimization: The Role of Distribution DynamicsCode0
Better SGD using Second-order MomentumCode0
Nonparametric Stochastic Compositional Gradient Descent for Q-Learning in Continuous Markov Decision ProblemsCode0
n-Step Temporal Difference Learning with Optimal nCode0
DeepType: Multilingual Entity Linking by Neural Type System EvolutionCode0
Coupling Adaptive Batch Sizes with Learning RatesCode0
CProp: Adaptive Learning Rate Scaling from Past Gradient ConformityCode0
On-Demand Sampling: Learning Optimally from Multiple DistributionsCode0
Cyanure: An Open-Source Toolbox for Empirical Risk Minimization for Python, C++, and soon moreCode0
CYCLADES: Conflict-free Asynchronous Machine LearningCode0
Effectively Leveraging Momentum Terms in Stochastic Line Search Frameworks for Fast Optimization of Finite-Sum ProblemsCode0
Graph Pattern Mining and Learning through User-defined Relations (Extended Version)Code0
Non-asymptotic estimates for TUSLA algorithm for non-convex learning with applications to neural networks with ReLU activation functionCode0
DADAM: A Consensus-based Distributed Adaptive Gradient Method for Online OptimizationCode0
Sampling from a k-DPP without looking at all itemsCode0
An Algorithm with Optimal Dimension-Dependence for Zero-Order Nonsmooth Nonconvex Stochastic Optimization0
Buying Information for Stochastic Optimization0
Building Proteins in a Day: Efficient 3D Molecular Reconstruction0
An adaptive volatility method for probabilistic forecasting and its application to the M6 financial forecasting competition0
Adaptive Single-Pass Stochastic Gradient Descent in Input Sparsity Time0
Adaptive Gradient Regularization: A Faster and Generalizable Optimization Technique for Deep Neural Networks0
Breaking the Lower Bound with (Little) Structure: Acceleration in Non-Convex Stochastic Optimization with Heavy-Tailed Noise0
Adaptive Shells for Efficient Neural Radiance Field Rendering0
A Communication-Efficient Adaptive Algorithm for Federated Learning under Cumulative Regret0
Faster Stochastic Variance Reduction Methods for Compositional MiniMax Optimization0
Breaking (Global) Barriers in Parallel Stochastic Optimization with Wait-Avoiding Group Averaging0
A Multi-Stage Algorithm for Acoustic Physical Model Parameters Estimation0
Branching model with state dependent offspring distribution for Chlamydia spread0
Show:102550
← PrevPage 7 of 28Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AvaGradAccuracy81.24Unverified
2AdaShiftAccuracy81.12Unverified
3Adam (eps-adjusted)Accuracy81.04Unverified
4SGDAccuracy80.95Unverified
5AdamWAccuracy79.87Unverified
6AdaBoundAccuracy77.24Unverified
#ModelMetricClaimedVerifiedStatus
1Adam (eps-adjusted)Accuracy96.36Unverified
2AvaGradAccuracy96.2Unverified
3SGDAccuracy96.14Unverified
4AdaShiftAccuracy95.92Unverified
5AdamWAccuracy95.89Unverified
6AdaBoundAccuracy94.6Unverified
#ModelMetricClaimedVerifiedStatus
1SGD - cosine LR scheduleAccuracy95.55Unverified
2LookaheadAccuracy95.27Unverified
3SGDAccuracy95.23Unverified
4ADAMAccuracy94.84Unverified
#ModelMetricClaimedVerifiedStatus
1AvaGradTop 1 Accuracy76.51Unverified
2SGDTop 1 Accuracy75.99Unverified
3AdamWTop 1 Accuracy72.9Unverified
4AdaBoundTop 1 Accuracy72.01Unverified
#ModelMetricClaimedVerifiedStatus
1AdaBoundBit per Character (BPC)2.86Unverified
2AdaShiftBit per Character (BPC)1.27Unverified
3AdamWBit per Character (BPC)1.23Unverified
4AvaGradBit per Character (BPC)1.18Unverified
#ModelMetricClaimedVerifiedStatus
1Resnet18Accuracy (max)86.85Unverified
2Resnet34Accuracy (max)86.14Unverified
#ModelMetricClaimedVerifiedStatus
1Resnet18Accuracy (max)58.48Unverified
2Resnet34Accuracy (max)54.5Unverified
#ModelMetricClaimedVerifiedStatus
1SGDTop 5 Accuracy92.15Unverified
2LookaheadTop 1 Accuracy75.13Unverified
#ModelMetricClaimedVerifiedStatus
1LookaheadTop 1 Accuracy75.49Unverified
2SGDTop 1 Accuracy75.15Unverified
#ModelMetricClaimedVerifiedStatus
1BertAccuracy (max)93.99Unverified
#ModelMetricClaimedVerifiedStatus
1BertAccuracy (max)86.34Unverified
#ModelMetricClaimedVerifiedStatus
1MLPNLL0.05Unverified