SOTAVerified

Stochastic Optimization

Stochastic Optimization is the task of optimizing certain objective functional by generating and using stochastic random variables. Usually the Stochastic Optimization is an iterative process of generating random variables that progressively finds out the minima or the maxima of the objective functional. Stochastic Optimization is usually applied in the non-convex functional spaces where the usual deterministic optimization such as linear or quadratic programming or their variants cannot be used.

Source: ASOC: An Adaptive Parameter-free Stochastic Optimization Techinique for Continuous Variables

Papers

Showing 13011350 of 1387 papers

TitleStatusHype
Task-based End-to-end Model Learning in Stochastic OptimizationCode0
MDPGT: Momentum-based Decentralized Policy Gradient TrackingCode0
ACMo: Angle-Calibrated Moment Methods for Stochastic OptimizationCode0
Bridging the Gap between Community and Node Representations: Graph Embedding via Community DetectionCode0
Memory-Based Optimization Methods for Model-Agnostic Meta-Learning and Personalized Federated LearningCode0
Convolutional Sketch InversionCode0
A Stochastic Optimization Framework for Private and Fair Learning From Decentralized DataCode0
Stochastic Differentially Private and Fair LearningCode0
Convex Optimization: Algorithms and ComplexityCode0
f-FERM: A Scalable Framework for Robust Fair Empirical Risk MinimizationCode0
Stochastic First-Order Learning for Large-Scale Flexibly Tied Gaussian Mixture ModelCode0
RFFNet: Large-Scale Interpretable Kernel Methods via Random Fourier FeaturesCode0
Outlier-robust neural network training: variation regularization meets trimmed loss to prevent functional breakdownCode0
SIM-Shapley: A Stable and Computationally Efficient Approach to Shapley Value ApproximationCode0
Minimax AUC Fairness: Efficient Algorithm with Provable ConvergenceCode0
MaxVA: Fast Adaptation of Step Sizes by Maximizing Observed Variance of GradientsCode0
Breaking the Heavy-Tailed Noise Barrier in Stochastic Optimization ProblemsCode0
Mining the manifolds of deep generative models for multiple data-consistent solutions of ill-posed tomographic imaging problemsCode0
Training Deep Neural Networks via Branch-and-BoundCode0
Understanding the Role of Momentum in Stochastic Gradient MethodsCode0
Overshoot: Taking advantage of future gradients in momentum-based stochastic optimizationCode0
Fixed-Mean Gaussian Processes for Post-hoc Bayesian Deep LearningCode0
Mixing ADAM and SGD: a Combined Optimization MethodCode0
Rieoptax: Riemannian Optimization in JAXCode0
Boosting Adversarial Transferability through Augmentation in Hypothesis SpaceCode0
A Nearly Optimal Single Loop Algorithm for Stochastic Bilevel Optimization under Unbounded SmoothnessCode0
Supervised Robustness-preserving Data-free Neural Network PruningCode0
SketchySGD: Reliable Stochastic Optimization via Randomized Curvature EstimatesCode0
Learning from Label Proportions with Instance-wise ConsistencyCode0
An Adaptive and Momental Bound Method for Stochastic LearningCode0
Stochastic Variance-Reduced Iterative Hard Thresholding in Graph Sparsity OptimizationCode0
From Predictive to Prescriptive AnalyticsCode0
Black Box Variational Inference with a Deterministic Objective: Faster, More Accurate, and Even More Black BoxCode0
From Text to Test: AI-Generated Control Software for Materials Science InstrumentsCode0
COCO Denoiser: Using Co-Coercivity for Variance Reduction in Stochastic Convex OptimizationCode0
Cauchy noise loss for stochastic optimization of random matrix models via free deterministic equivalentsCode0
Variance-based regularization with convex objectivesCode0
A fast and simple modification of Newton's method helping to avoid saddle pointsCode0
Generalization Bounds for Heavy-Tailed SDEs through the Fractional Fokker-Planck EquationCode0
PASOA- PArticle baSed Bayesian Optimal Adaptive designCode0
Minimizing robust density power-based divergences for general parametric density modelsCode0
Generalized Multi-Output Gaussian Process Censored RegressionCode0
Generating Tertiary Protein Structures via an Interpretative Variational AutoencoderCode0
Ordered SGD: A New Stochastic Optimization Framework for Empirical Risk MinimizationCode0
Generic Inference in Latent Gaussian Process ModelsCode0
Stochastic Optimization of Plain Convolutional Neural Networks with Simple methodsCode0
Socially Fair Mitigation of Misinformation on Social Networks via Constraint Stochastic OptimizationCode0
Personalized Treatment Selection using Causal HeterogeneityCode0
Personalization Improves Privacy-Accuracy Tradeoffs in Federated LearningCode0
Black Box Variational InferenceCode0
Show:102550
← PrevPage 27 of 28Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AvaGradAccuracy81.24Unverified
2AdaShiftAccuracy81.12Unverified
3Adam (eps-adjusted)Accuracy81.04Unverified
4SGDAccuracy80.95Unverified
5AdamWAccuracy79.87Unverified
6AdaBoundAccuracy77.24Unverified
#ModelMetricClaimedVerifiedStatus
1Adam (eps-adjusted)Accuracy96.36Unverified
2AvaGradAccuracy96.2Unverified
3SGDAccuracy96.14Unverified
4AdaShiftAccuracy95.92Unverified
5AdamWAccuracy95.89Unverified
6AdaBoundAccuracy94.6Unverified
#ModelMetricClaimedVerifiedStatus
1SGD - cosine LR scheduleAccuracy95.55Unverified
2LookaheadAccuracy95.27Unverified
3SGDAccuracy95.23Unverified
4ADAMAccuracy94.84Unverified
#ModelMetricClaimedVerifiedStatus
1AvaGradTop 1 Accuracy76.51Unverified
2SGDTop 1 Accuracy75.99Unverified
3AdamWTop 1 Accuracy72.9Unverified
4AdaBoundTop 1 Accuracy72.01Unverified
#ModelMetricClaimedVerifiedStatus
1AdaBoundBit per Character (BPC)2.86Unverified
2AdaShiftBit per Character (BPC)1.27Unverified
3AdamWBit per Character (BPC)1.23Unverified
4AvaGradBit per Character (BPC)1.18Unverified
#ModelMetricClaimedVerifiedStatus
1Resnet18Accuracy (max)86.85Unverified
2Resnet34Accuracy (max)86.14Unverified
#ModelMetricClaimedVerifiedStatus
1Resnet18Accuracy (max)58.48Unverified
2Resnet34Accuracy (max)54.5Unverified
#ModelMetricClaimedVerifiedStatus
1SGDTop 5 Accuracy92.15Unverified
2LookaheadTop 1 Accuracy75.13Unverified
#ModelMetricClaimedVerifiedStatus
1LookaheadTop 1 Accuracy75.49Unverified
2SGDTop 1 Accuracy75.15Unverified
#ModelMetricClaimedVerifiedStatus
1BertAccuracy (max)93.99Unverified
#ModelMetricClaimedVerifiedStatus
1BertAccuracy (max)86.34Unverified
#ModelMetricClaimedVerifiedStatus
1MLPNLL0.05Unverified