Universality and Convergence of Generative Flows

Abstract

Generative flows sample from an unnormalized target by training a flow to be balanced, and the training loss is the signal a practitioner watches. We ask what that signal is worth: whether a small loss certifies an accurate sampler, whether the loss can be driven to zero, and how fast gradient descent does so. The loss decides the first. Losses that compare the two sides of the balance by their difference bound, in total variation, the error of the sampler the flow implies, with explicit constants that do not involve the policy; flow-matching losses that compare them through a ratio admit no such bound, already on a single cycle, whenever their generator is continuous at balance. On graphs, the backward policy decides the other two. Once it is frozen, balance becomes invariance under the backward chain, so that existence is free on finite graphs, and one constant --- the norm of that chain's Green operator, which plays the role of an inverse spectral gap --- fixes the order of the curvature of the loss around the balanced flow, from above and below, and sets a floor under the rate at which training converges near it. The mechanism is that gradient descent diffuses the flow along the backward policy. For the squared-logarithm generator of detailed and trajectory balance, training the balance loss on states converges globally on every finite path-connected graph, from every positive initialization. The constant can be infinite while backward trajectories are short on average, and exact flow matching can then fail. The bounds and rates are tested by exact computation on enumerable state spaces, and every theorem carries a certification status computed from a Lean~4 development.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Machine Learning

• arXiv preprint · 4 October 2026

  When the noncommutative AM-GM inequality holds

  Yimin Zhong
• arXiv preprint · 5 October 2026

  A Superprocess-based Approach to Rough CIR Processes and Feller Random Measures

  Gordan Žitković
• arXiv preprint · 4 October 2026

  Buying at Support: The Entry Problem under Multi-Skew Brownian Motion

  Jun Maeda
• arXiv preprint · 5 October 2026

  Sharp Integrality Gaps in Calibration Distance

  Zinan Wang and Xinhao Yang
• arXiv preprint · 4 October 2026

  Poisson Autoregression on a Large Network with a Stochastic Block Model Structure

  Mahmoud Khabou, Joanna Marks, Joshua Corneck and 1 other

All new papers in Machine Learning