SOTAVerified

Stochastic Optimization

Stochastic Optimization is the task of optimizing certain objective functional by generating and using stochastic random variables. Usually the Stochastic Optimization is an iterative process of generating random variables that progressively finds out the minima or the maxima of the objective functional. Stochastic Optimization is usually applied in the non-convex functional spaces where the usual deterministic optimization such as linear or quadratic programming or their variants cannot be used.

Source: ASOC: An Adaptive Parameter-free Stochastic Optimization Techinique for Continuous Variables

Papers

Showing 801850 of 1387 papers

TitleStatusHype
A fast and simple modification of Newton's method helping to avoid saddle pointsCode0
Recht-Ré Noncommutative Arithmetic-Geometric Mean Conjecture is False0
Online Stochastic Convex Optimization: Wasserstein Distance Variation0
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine LearningCode1
The Power of Factorial Powers: New Parameter settings for (Stochastic) Optimization0
Momentum-based variance-reduced proximal stochastic gradient method for composite nonconvex stochastic optimization0
CoolMomentum: A Method for Stochastic Optimization by Langevin Dynamics with Simulated AnnealingCode0
Convergence Analysis of Riemannian Stochastic Approximation Schemes0
Stochastic Optimization with Heavy-Tailed Noise via Accelerated Gradient ClippingCode0
k-sums: another side of k-meansCode0
Adaptive First-and Zeroth-order Methods for Weakly Convex Stochastic Optimization Problems0
Unbiased MLMC stochastic gradient-based optimization of Bayesian experimental designsCode0
Scaling-up Distributed Processing of Data Streams for Machine Learning0
An Analysis of the Adaptation Speed of Causal ModelsCode1
Tiering as a Stochastic Submodular Optimization Problem0
S-ADDOPT: Decentralized stochastic first-order optimization over directed graphsCode0
Learning to Estimate Driver Drowsiness from Car Acceleration Sensors using Weakly Labeled Data0
Byzantine-Robust Decentralized Stochastic Optimization over Static and Time-Varying NetworksCode0
Distributionally Robust Neural NetworksCode1
Online and stochastic optimization beyond Lipschitz continuity: A Riemannian approach0
Breaking (Global) Barriers in Parallel Stochastic Optimization with Wait-Avoiding Group Averaging0
DS-FACTO: Doubly Separable Factorization Machines0
Doubly-stochastic mining for heterogeneous retrieval0
Disjoint principal component analysis by constrained binary particle swarm optimizationCode0
Stochastic gradient algorithms from ODE splitting perspective0
Stochastic batch size for adaptive regularization in deep network optimization0
Client Selection and Bandwidth Allocation in Wireless Federated Learning Networks: A Long-Term Perspective0
Generating Tertiary Protein Structures via an Interpretative Variational AutoencoderCode0
Convergence rates and approximation results for SGD and its continuous-time counterpart0
Weighted Aggregating Stochastic Gradient Descent for Parallel Deep Learning0
Direct loss minimization algorithms for sparse Gaussian processesCode0
Non-Convex Optimization via Non-Reversible Stochastic Gradient Langevin Dynamics0
Stochastic Proximal Gradient Algorithm with Minibatches. Application to Large Scale Learning Models0
Stochastic Flows and Geometric Optimization on the Orthogonal Group0
Pipelined Backpropagation at Scale: Training Large Models without Batches0
A Unified Theory of Decentralized SGD with Changing Topology and Local Updates0
Large Scale Many-Objective Optimization Driven by Distributional Adversarial Networks0
Many-Objective Estimation of Distribution Optimization Algorithm Based on WGAN-GP0
On Hyper-parameter Tuning for Stochastic Optimization Algorithms0
Conjugate-gradient-based Adam for stochastic optimization and its application to deep learning0
Affinity guided Geometric Semi-Supervised Metric Learning0
IRS-aided Large-Scale MIMO Systems with Passive Constant Envelope Precoding0
Non-asymptotic bounds for stochastic optimization with biased noisy gradient oracles0
Biased Stochastic First-Order Methods for Conditional Stochastic Optimization and Applications in Meta Learning0
Adversarial Radar Inference. From Inverse Tracking to Inverse Reinforcement Learning of Cognitive Radar0
Stochastic Optimization for Regularized Wasserstein Estimators0
Progressive Identification of True Labels for Partial-Label LearningCode1
Weakly-supervised Multi-output Regression via Correlated Gaussian Processes0
PolyFold: an interactive visual simulator for distance-based protein foldingCode1
PACOH: Bayes-Optimal Meta-Learning with PAC-GuaranteesCode1
Show:102550
← PrevPage 17 of 28Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AvaGradAccuracy81.24Unverified
2AdaShiftAccuracy81.12Unverified
3Adam (eps-adjusted)Accuracy81.04Unverified
4SGDAccuracy80.95Unverified
5AdamWAccuracy79.87Unverified
6AdaBoundAccuracy77.24Unverified
#ModelMetricClaimedVerifiedStatus
1Adam (eps-adjusted)Accuracy96.36Unverified
2AvaGradAccuracy96.2Unverified
3SGDAccuracy96.14Unverified
4AdaShiftAccuracy95.92Unverified
5AdamWAccuracy95.89Unverified
6AdaBoundAccuracy94.6Unverified
#ModelMetricClaimedVerifiedStatus
1SGD - cosine LR scheduleAccuracy95.55Unverified
2LookaheadAccuracy95.27Unverified
3SGDAccuracy95.23Unverified
4ADAMAccuracy94.84Unverified
#ModelMetricClaimedVerifiedStatus
1AvaGradTop 1 Accuracy76.51Unverified
2SGDTop 1 Accuracy75.99Unverified
3AdamWTop 1 Accuracy72.9Unverified
4AdaBoundTop 1 Accuracy72.01Unverified
#ModelMetricClaimedVerifiedStatus
1AdaBoundBit per Character (BPC)2.86Unverified
2AdaShiftBit per Character (BPC)1.27Unverified
3AdamWBit per Character (BPC)1.23Unverified
4AvaGradBit per Character (BPC)1.18Unverified
#ModelMetricClaimedVerifiedStatus
1Resnet18Accuracy (max)86.85Unverified
2Resnet34Accuracy (max)86.14Unverified
#ModelMetricClaimedVerifiedStatus
1Resnet18Accuracy (max)58.48Unverified
2Resnet34Accuracy (max)54.5Unverified
#ModelMetricClaimedVerifiedStatus
1SGDTop 5 Accuracy92.15Unverified
2LookaheadTop 1 Accuracy75.13Unverified
#ModelMetricClaimedVerifiedStatus
1LookaheadTop 1 Accuracy75.49Unverified
2SGDTop 1 Accuracy75.15Unverified
#ModelMetricClaimedVerifiedStatus
1BertAccuracy (max)93.99Unverified
#ModelMetricClaimedVerifiedStatus
1BertAccuracy (max)86.34Unverified
#ModelMetricClaimedVerifiedStatus
1MLPNLL0.05Unverified