SOTAVerified

Stochastic Optimization

Stochastic Optimization is the task of optimizing certain objective functional by generating and using stochastic random variables. Usually the Stochastic Optimization is an iterative process of generating random variables that progressively finds out the minima or the maxima of the objective functional. Stochastic Optimization is usually applied in the non-convex functional spaces where the usual deterministic optimization such as linear or quadratic programming or their variants cannot be used.

Source: ASOC: An Adaptive Parameter-free Stochastic Optimization Techinique for Continuous Variables

Papers

Showing 901950 of 1387 papers

TitleStatusHype
Bridging the Gap between Community and Node Representations: Graph Embedding via Community DetectionCode0
Cyanure: An Open-Source Toolbox for Empirical Risk Minimization for Python, C++, and soon moreCode0
Complexity of Stochastic Dual Dynamic Programming0
From Reinforcement Learning to Optimal Control: A unified framework for sequential decisions0
Lower Bounds for Non-Convex Stochastic Optimization0
Scalable Variational Bayesian Kernel Selection for Sparse Gaussian Process Regression0
Domain-independent Dominance of Adaptive MethodsCode0
Efficient Relaxed Gradient Support Pursuit for Sparsity Constrained Non-convex Optimization0
A Communication Efficient Stochastic Multi-Block Alternating Direction Method of Multipliers0
Thinning for Accelerating the Learning of Point Processes0
Efficient Smooth Non-Convex Stochastic Compositional Optimization via Stochastic Recursive Gradient Descent0
Identifying Cognitive Radars -- Inverse Reinforcement Learning using Revealed Preferences0
Think out of the "Box": Generically-Constrained Asynchronous Composite Optimization and Hedging0
Online Structured Sparsity-based Moving Object Detection from Satellite Videos0
Learning Neural Search Policies for Classical Planning0
A Sub-sampled Tensor Method for Non-convex Optimization0
Parameter-Free Locally Differentially Private Stochastic Subgradient Descent0
Gamifying the Vehicle Routing Problem with Stochastic Requests0
Stochastic DCA for minimizing a large sum of DC functions with application to Multi-class Logistic Regression0
Community Detection for Power Systems Network Aggregation Considering Renewable Variability0
Continual Multi-task Gaussian ProcessesCode0
SPARQ-SGD: Event-Triggered and Compressed Communication in Decentralized Stochastic Optimization0
Mixing of Stochastic Accelerated Gradient Descent0
Understanding the Role of Momentum in Stochastic Gradient MethodsCode0
Linear Speedup in Saddle-Point Escape for Decentralized Non-Convex Optimization0
Proactive Optimization with Machine Learning: Femto-caching with Future Content Popularity0
Adaptive Sampling Quasi-Newton Methods for Derivative-Free Stochastic Optimization0
An Adaptive and Momental Bound Method for Stochastic LearningCode0
Prior Specification for Bayesian Matrix Factorization via Prior Predictive MatchingCode0
Katyusha Acceleration for Convex Finite-Sum Compositional Optimization0
Gradient Sparification for Asynchronous Distributed Training0
The Practicality of Stochastic Optimization in Imaging Inverse Problems0
Robust Distributed Accelerated Stochastic Gradient Methods for Multi-Agent Networks0
Robust Learning Rate Selection for Stochastic Optimization via Splitting Diagnostic0
Improving the Sample and Communication Complexity for Decentralized Non-Convex Optimization: A Joint Gradient Estimation and Tracking Approach0
Projection-free nonconvex stochastic optimization on Riemannian manifolds0
Variance-Reduced Decentralized Stochastic Optimization with Gradient Tracking -- Part II: GT-SVRG0
FIS-GAN: GAN with Flow-based Importance Sampling0
Tightening Bounds for Variational Inference by Revisiting Perturbation Theory0
Model Predictive Control-Based Battery Scheduling and Incentives to Manipulate Demand Response Baselines0
A Non-asymptotic comparison of SVRG and SGD: tradeoffs between compute and speed0
α^α-Rank: Practically Scaling α-Rank through Stochastic Optimisation0
Statistical Adaptive Stochastic Optimization0
Accelerating First-Order Optimization Algorithms0
Learning to Anneal and Prune Proximity Graphs for Similarity Search0
Localizing and Amortizing: Efficient Inference for Gaussian Processes0
Geometry, Computation, and Optimality in Stochastic Optimization0
Using Statistics to Automate Stochastic Optimization0
Robust Opponent Modeling via Adversarial Ensemble Reinforcement Learning in Asymmetric Imperfect-Information Games0
Communication-Censored Distributed Stochastic Gradient DescentCode0
Show:102550
← PrevPage 19 of 28Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AvaGradAccuracy81.24Unverified
2AdaShiftAccuracy81.12Unverified
3Adam (eps-adjusted)Accuracy81.04Unverified
4SGDAccuracy80.95Unverified
5AdamWAccuracy79.87Unverified
6AdaBoundAccuracy77.24Unverified
#ModelMetricClaimedVerifiedStatus
1Adam (eps-adjusted)Accuracy96.36Unverified
2AvaGradAccuracy96.2Unverified
3SGDAccuracy96.14Unverified
4AdaShiftAccuracy95.92Unverified
5AdamWAccuracy95.89Unverified
6AdaBoundAccuracy94.6Unverified
#ModelMetricClaimedVerifiedStatus
1SGD - cosine LR scheduleAccuracy95.55Unverified
2LookaheadAccuracy95.27Unverified
3SGDAccuracy95.23Unverified
4ADAMAccuracy94.84Unverified
#ModelMetricClaimedVerifiedStatus
1AvaGradTop 1 Accuracy76.51Unverified
2SGDTop 1 Accuracy75.99Unverified
3AdamWTop 1 Accuracy72.9Unverified
4AdaBoundTop 1 Accuracy72.01Unverified
#ModelMetricClaimedVerifiedStatus
1AdaBoundBit per Character (BPC)2.86Unverified
2AdaShiftBit per Character (BPC)1.27Unverified
3AdamWBit per Character (BPC)1.23Unverified
4AvaGradBit per Character (BPC)1.18Unverified
#ModelMetricClaimedVerifiedStatus
1Resnet18Accuracy (max)86.85Unverified
2Resnet34Accuracy (max)86.14Unverified
#ModelMetricClaimedVerifiedStatus
1Resnet18Accuracy (max)58.48Unverified
2Resnet34Accuracy (max)54.5Unverified
#ModelMetricClaimedVerifiedStatus
1SGDTop 5 Accuracy92.15Unverified
2LookaheadTop 1 Accuracy75.13Unverified
#ModelMetricClaimedVerifiedStatus
1LookaheadTop 1 Accuracy75.49Unverified
2SGDTop 1 Accuracy75.15Unverified
#ModelMetricClaimedVerifiedStatus
1BertAccuracy (max)93.99Unverified
#ModelMetricClaimedVerifiedStatus
1BertAccuracy (max)86.34Unverified
#ModelMetricClaimedVerifiedStatus
1MLPNLL0.05Unverified