SOTAVerified

Distributed Optimization

The goal of Distributed Optimization is to optimize a certain objective defined over millions of billions of data that is distributed over many machines by utilizing the computational power of these machines.

Source: Analysis of Distributed StochasticDual Coordinate Ascent

Papers

Showing 1120 of 536 papers

TitleStatusHype
Beyond spectral gap: The role of the topology in decentralized learningCode1
Byzantine-Robust Learning on Heterogeneous Datasets via BucketingCode1
Acceleration of Federated Learning with Alleviated Forgetting in Local TrainingCode1
ACCO: Accumulate While You Communicate for Communication-Overlapped Sharded LLM TrainingCode1
DPLib: A Standard Benchmark Library for Distributed Power System Analysis and OptimizationCode1
Beyond spectral gap (extended): The role of the topology in decentralized learningCode1
Decentralized Riemannian Gradient Descent on the Stiefel ManifoldCode1
DeepLM: Large-Scale Nonlinear Least Squares on Deep Learning Frameworks Using Stochastic Domain DecompositionCode1
BAGUA: Scaling up Distributed Learning with System RelaxationsCode1
Federated Accelerated Stochastic Gradient DescentCode1
Show:102550
← PrevPage 2 of 54Next →

No leaderboard results yet.