MARS: Unleashing the Power of Variance Reduction for Training Large Models Nov 15, 2024 Stochastic Optimization
Code Code Available Benchopt: Reproducible, efficient and collaborative optimization benchmarks Jun 27, 2022 Benchmarking image-classification
Code Code Available Smoothing Methods for Automatic Differentiation Across Conditional Branches Oct 5, 2023 Stochastic Optimization
Code Code Available Conformal Symplectic Optimization for Stable Reinforcement Learning Dec 3, 2024 Atari Games Deep Reinforcement Learning
Code Code Available Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour Jun 8, 2017 Stochastic Optimization
Code Code Available Riemannian Adaptive Optimization Methods Oct 1, 2018 Riemannian optimization Stochastic Optimization
Code Code Available Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training May 23, 2023 Language Modeling Language Modelling
Code Code Available On the Variance of the Adaptive Learning Rate and Beyond Aug 8, 2019 image-classification Image Classification
Code Code Available LIRA: Learnable, Imperceptible and Robust Backdoor Attacks Jan 1, 2021 Backdoor Attack backdoor defense
Code Code Available Optimal Planning of Hybrid Energy Storage Systems using Curtailed Renewable Energy through Deep Reinforcement Learning Dec 12, 2022 Decision Making Deep Reinforcement Learning
Code Code Available Kernel Distributionally Robust Optimization Jun 12, 2020 Stochastic Optimization
Code Code Available Learning from History for Byzantine Robust Optimization Dec 18, 2020 Federated Learning Stochastic Optimization
Code Code Available MoMo: Momentum Models for Adaptive Learning Rates May 12, 2023 Recommendation Systems Stochastic Optimization
Code Code Available Online Learning Rate Adaptation with Hypergradient Descent Mar 14, 2017 Hyperparameter Optimization Stochastic Optimization
Code Code Available Differentiable Quality Diversity Jun 7, 2021 Diversity Stochastic Optimization
Code Code Available Communication-Efficient Adaptive Federated Learning May 5, 2022 Federated Learning Quantization
Code Code Available Distributionally Robust Neural Networks May 1, 2020 L2 Regularization Natural Language Inference
Code Code Available BCD Nets: Scalable Variational Approaches for Bayesian Causal Discovery Dec 6, 2021 Causal Discovery Stochastic Optimization
Code Code Available BinaryViT: Pushing Binary Vision Transformers Towards Convolutional Models Jun 29, 2023 Binarization Image Classification
Code Code Available Combinatorial Optimization enriched Machine Learning to solve the Dynamic Vehicle Routing Problem with Time Windows Apr 3, 2023 Combinatorial Optimization Stochastic Optimization
Code Code Available Decouple Graph Neural Networks: Train Multiple Simple GNNs Simultaneously Instead of One Apr 20, 2023 Stochastic Optimization
Code Code Available Self-Directed Online Machine Learning for Topology Optimization Feb 4, 2020 BIG-bench Machine Learning Stochastic Optimization
Code Code Available Exploiting Explainable Metrics for Augmented SGD Mar 31, 2022 Stochastic Optimization
Code Code Available A Stochastic Optimization Framework for Fair Risk Minimization Feb 24, 2021 Binary Classification Fairness
Code Code Available Learning concise representations for regression by evolving networks of trees Jul 3, 2018 Disentanglement regression
Code Code Available A Novel Unified Parametric Assumption for Nonconvex Optimization Feb 17, 2025 Stochastic Optimization
Code Code Available Lookahead Optimizer: k steps forward, 1 step back Jul 19, 2019 Image Classification Machine Translation
Code Code Available ATD: Augmenting CP Tensor Decomposition by Self Supervision Jun 15, 2021 Data Augmentation Dimensionality Reduction
Code Code Available Monte Carlo Policy Gradient Method for Binary Optimization Jul 3, 2023 Combinatorial Optimization Diversity
Code Code Available Neural Inventory Control in Networks via Hindsight Differentiable Policy Optimization Jun 20, 2023 Deep Reinforcement Learning Management
Code Code Available ADMM for Efficient Deep Learning with Global Convergence May 31, 2019 Deep Learning Stochastic Optimization
Code Code Available Adaptivity without Compromise: A Momentumized, Adaptive, Dual Averaged Gradient Method for Stochastic Optimization Jan 26, 2021 Stochastic Optimization
Code Code Available Agnostic Federated Learning Feb 1, 2019 Cloud Computing Domain Adaptation
Code Code Available Adaptive Semantic Token Communication for Transformer-based Edge Inference May 23, 2025 object-detection Object Detection
Code Code Available A Better Alternative to Error Feedback for Communication-Efficient Distributed Learning Jun 19, 2020 Federated Learning Stochastic Optimization
Code Code Available Apollo: An Adaptive Parameter-wise Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization Sep 28, 2020 Stochastic Optimization
Code Code Available A Variational Perspective on Solving Inverse Problems with Diffusion Models May 7, 2023 Denoising Image Restoration
Code Code Available Averaging Weights Leads to Wider Optima and Better Generalization Mar 14, 2018 Image Classification Stochastic Optimization
Code Code Available Adafactor: Adaptive Learning Rates with Sublinear Memory Cost Apr 11, 2018 Machine Translation Stochastic Optimization
Code Code Available JaxSGMC: Modular stochastic gradient MCMC in JAX May 16, 2025 Deep Learning Stochastic Optimization
Code Code Available ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning Jun 1, 2020 BIG-bench Machine Learning Second-order methods
Code Code Available Adam: A Method for Stochastic Optimization Dec 22, 2014 Stochastic Optimization
Code Code Available Adaptivity of Stochastic Gradient Methods for Nonconvex Optimization Feb 13, 2020 Stochastic Optimization
Code Code Available Cyclical Stochastic Gradient MCMC for Bayesian Deep Learning Feb 11, 2019 Bayesian Inference Deep Learning
Code Code Available Adapting to Mixing Time in Stochastic Optimization with Markovian Data Feb 9, 2022 Stochastic Optimization
Code Code Available Deep Generalized Canonical Correlation Analysis Feb 8, 2017 Representation Learning Stochastic Optimization
Code Code Available Efficient approximation of Jacobian matrices involving a non-uniform fast Fourier transform (NUFFT) Nov 4, 2021 compressed sensing Image Reconstruction
Code Code Available End-to-End Stochastic Optimization with Energy-Based Model Nov 25, 2022 Scheduling Stochastic Optimization
Code Code Available Federated Learning over Wireless Networks: Convergence Analysis and Resource Allocation Oct 29, 2019 Federated Learning Privacy Preserving
Code Code Available An Analysis of the Adaptation Speed of Causal Models May 18, 2020 Meta-Learning Stochastic Optimization
Code Code Available 