SOTAVerified

Distributed Optimization

The goal of Distributed Optimization is to optimize a certain objective defined over millions of billions of data that is distributed over many machines by utilizing the computational power of these machines.

Source: Analysis of Distributed StochasticDual Coordinate Ascent

Papers

Showing 2650 of 536 papers

TitleStatusHype
Unbiased Single-scale and Multi-scale Quantizers for Distributed OptimizationCode1
Decentralized Riemannian Gradient Descent on the Stiefel ManifoldCode1
FedDANE: A Federated Newton-Type MethodCode1
ACCO: Accumulate While You Communicate for Communication-Overlapped Sharded LLM TrainingCode1
Federated Accelerated Stochastic Gradient DescentCode1
Asynchronous Local-SGD Training for Language ModelingCode1
Byzantine-Robust Learning on Heterogeneous Datasets via BucketingCode1
BAGUA: Scaling up Distributed Learning with System RelaxationsCode1
Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over NetworksCode0
Federated Learning with Compression: Unified Analysis and Sharp GuaranteesCode0
Error Feedback Shines when Features are RareCode0
A Distributed Quasi-Newton Algorithm for Primal and Dual Regularized Empirical Risk MinimizationCode0
FairSync: Ensuring Amortized Group Exposure in Distributed Recommendation RetrievalCode0
A Distributed Quasi-Newton Algorithm for Empirical Risk Minimization with Nonsmooth RegularizationCode0
Dynamic communication topologies for distributed heuristics in energy system optimization algorithmsCode0
Distributed Optimization with Arbitrary Local SolversCode0
EF-BV: A Unified Theory of Error Feedback and Variance Reduction Mechanisms for Biased and Unbiased Compression in Distributed OptimizationCode0
Efficient Randomized Subspace Embeddings for Distributed Optimization under a Communication BudgetCode0
Distributed Adversarial Training to Robustify Deep Neural Networks at ScaleCode0
Distributed Markov Chain Monte Carlo Sampling based on the Alternating Direction Method of MultipliersCode0
Differentially Private Distributed Estimation and LearningCode0
Distributed Optimization, Averaging via ADMM, and Network TopologyCode0
Adding vs. Averaging in Distributed Primal-Dual OptimizationCode0
Cooperative Tuning of Multi-Agent Optimal Control SystemsCode0
PIM-Opt: Demystifying Distributed Optimization Algorithms on a Real-World Processing-In-Memory SystemCode0
Show:102550
← PrevPage 2 of 22Next →

No leaderboard results yet.