OpenAlex ·
Optimal Parameter-Free Second-order Acceleration with Inexact Hessians under Generalized Smoothness
- Published
- Source
- OpenAlex
- Published in
- arXiv (Cornell University)
- DOI
- 10.48550/arxiv.2609.32977
- Original
- Read it at the publisher
- Topics
Abstract
We study second-order convex optimization under generalized Hessian smoothness, where the local Hessian Lipschitz constant may grow linearly with the gradient norm. For inexact Hessians, we develop adaptive algorithms, including an accelerated Monteiro-Svaiter-type method whose complexity matches the lower bound for second-order methods with $δ$-inexact Hessians in the classical Lipschitz-Hessian setting. Our methods are parameter-free in the sense that they require no problem-specific parameters as input, including the Hessian inexactness level $δ$ and smoothness constants. Instead, their backtracking adapts a single regularization parameter that jointly captures Hessian inexactness and local Hessian smoothness. The resulting rates split into two regimes. Far from the solution, the gradient-dependent smoothness term yields geometric convergence. Near the solution, the rate is governed by the ordinary Hessian smoothness and the inexactness level $δ$, recovering the classical Lipschitz-Hessian guarantees.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Artificial Intelligence
A 51-Addition Alternative-Basis Kernel for Rank-23 $3\times3$ Matrix Multiplication
An EPTAS for Offline Temporary Tasks Assignment on Few Machines
Parity Tests under Ties: A One-Test Lifting Theorem
The Fully Depolarizing Noise Conjecture for Entangled Physical States: A Twenty-Year Perspective
Network Topology That Excludes Braess's Paradox and Maintains Monotonicity in Flows Over Time
Get the few papers worth your time in Artificial Intelligence every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.