Langevin-Informed Transfer Learning: Replacing Target Samples by Black-Box Feedback

Abstract

Many scientific and machine learning systems, from molecular dynamics to diffusion models and beyond, are governed by stochastic dynamics with low-dimensional structure, evolving on slow timescales. However, target trajectories, used to identify and interpret such dynamics, are often inaccessible: only biased or static samples that explore the underlying manifold are available. We introduce Langevin-Informed Transfer Learning (LITL), a framework for recovering target Langevin dynamics from biased source samples using only black-box feedback. LITL learns the leading spectral structure of the target infinitesimal generator and the projected drift through Dirichlet representation learning, enabling kinetic reconstruction in spectral form and slow-manifold gradient field estimation. We further introduce a spherical variant well suited to steering normalized latent representations commonly used in learning systems toward desired objectives. We establish finite-sample guarantees for eigenvalue, eigenfunction, and projected drift estimation in Sobolev norms, thereby ensuring generalization of these quantities and their first-order derivatives. Empirically, LITL recovers physical transition timescales from biased molecular simulations, builds kinetic structure from static samples of generative models, reconstructs spherical symmetries of physical systems, and enables post-hoc latent steering of trained neural networks under black-box feedback. Together, these results position spectral operator learning as a practical framework for recovering stochastic dynamics under distribution shift and unlock applications across machine learning and the physical sciences.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Machine Learning

• arXiv preprint · 1 October 2026

  Learning Multiple Timescales for Goal-Conditioned Reinforcement Learning

  Pedro Robles Dutenhefner, Dikshant Shehmar, Wagner Meira and 1 other
• arXiv preprint · 2 October 2026

  Generalization Bounds for Flow-matching Generative Models for Intrinsically Low-dimensional Data

  Saptarshi Chakraborty, Quentin Berthet and Peter L. Bartlett
• arXiv preprint · 1 October 2026

  Block Optimism for Nonstationary Bandits with Latent Linear Dynamics

  Taehyun Hwang, Hyunjun Choi, Heesang Ann and 1 other
• arXiv preprint · 2 October 2026

  Differential Privacy of Gradient Descent on Perturbed Objectives

  Austin Watkins and Raman Arora
• arXiv preprint · 1 October 2026

  Platonic Task Arithmetic

  Junghwan Park and Woojin Cho

All new papers in Machine Learning