arXiv preprint ·

Linear Last-Iterate Convergence Rates for Optimistic Learning in Harmonic Games

John Lazarsfeld, Anas Barakat, Jacob Abernethy, Vidya Muthukumar, Georgios Piliouras, Andre Wibisono and Juba Ziani

Published
Source
arXiv preprint, posted before peer review
Original
Read it at arXiv
Topics
Computer Science & Game TheoryMachine Learning

Abstract

We prove that the last iterate of Optimistic Follow-The-Regularized-Leader (OFTRL) converges at a linear rate to a Nash equilibrium in multiplayer harmonic games. Our result holds under a mild game-regularity condition and for a large family of regularizers, including entropy, Tsallis, and log-barrier. Our analysis is based on a dual perspective of OFTRL: we prove that the interaction between optimism and the global structure of harmonic games leads to the dissipation of an energy function along the dual iterates, for which we establish tight quantitative bounds. Our result also holds for the Extragradient FTRL variant.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

Read it on ReadSearch

Each opens after you create an account, and brings you back to this paper.

Already a reader? Sign in

All new papers in Computer Science & Game Theory

Get the few papers worth your time in Computer Science & Game Theory every morning.

ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.

Papers belong to their authors and publishers; every page here links to the original. All research topics