arXiv preprint ·
Silver Rate Is (Almost) Optimal for Gradient Descent: The Strongly Convex Case
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
We study gradient descent with predetermined nonnegative stepsizes on smooth strongly convex functions. Let $p_{\mathrm{sil}}=\log_2(1+\sqrt2)$ and $κ$ be the condition number. We prove the iteration lower bound $Ω\left(κ^{\frac{1}{p_{\mathrm{sil}}}-o(1)}\log\frac1δ\right)$ for both relative squared distance and relative function error, uniformly over $0<δ<1$ and sufficiently large $κ$. This matches the polynomial exponent of $κ$ for the Silver stepsize schedule established in [Altschuler and Parrilo, 2025].
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Optimization & Control
Sample-Based Prophet Inequalities for Random Walks
ZO-COSMO: Index-Free One-Hop Mixing for Decentralized Zeroth-Order Optimization
Optimal Investment and Consumption in Financial Markets with Integrated Variance Clocks
Distributed Stochastic Approximation Algorithms and Heavy-Tailed Age of Information
Reliability Theory for AI Control
Get the few papers worth your time in Optimization & Control every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.