ENCORE: Exact Non-equilibrium COntrol with Replica Exchange for Diffusion Generation

Abstract

Inference-time control steers a pretrained generative model towards a target distribution without retraining. We study tilted targets $π_0\propto G_0\,p_0$, where $p_0$ is the sampler output distribution and $G_0$ is an evaluable reweighting function. Existing approaches rely on sequential annealing with sequential Monte Carlo (SMC) or parallel annealing with replica exchange (RE). Sequential control is exact but needs large particle populations, whereas no exact parallel control method exists: existing RE corrections approximate an intractable time reversal and are biased. We propose Exact Non-equilibrium COntrol with Replica Exchange (ENCORE), the first exact parallel control method. Each replica stores its generation trajectory, so the upward move is a truncation and the intractable time reversal is never simulated. We prove target invariance and show that the resulting dynamics are those of non-equilibrium replica exchange with the exact time reversal as forward proposal. Under regularity conditions, our diffusion analysis shows that both sequential and parallel control become unstable under refinement of the time discretisation without guidance, whereas guided proposals remain stable and yield diagnostics for tuning the schedule and the computational budget. Across synthetic targets, Boltzmann sampling of biomolecules, and image generation, ENCORE achieves competitive accuracy and diversity, remains robust to sampler perturbations, and applies to distilled samplers where existing RE corrections are unavailable.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Machine Learning (Statistics)

• arXiv preprint · 1 October 2026

  Learning Multiple Timescales for Goal-Conditioned Reinforcement Learning

  Pedro Robles Dutenhefner, Dikshant Shehmar, Wagner Meira and 1 other
• arXiv preprint · 2 October 2026

  Generalization Bounds for Flow-matching Generative Models for Intrinsically Low-dimensional Data

  Saptarshi Chakraborty, Quentin Berthet and Peter L. Bartlett
• arXiv preprint · 1 October 2026

  Block Optimism for Nonstationary Bandits with Latent Linear Dynamics

  Taehyun Hwang, Hyunjun Choi, Heesang Ann and 1 other
• arXiv preprint · 2 October 2026

  Differential Privacy of Gradient Descent on Perturbed Objectives

  Austin Watkins and Raman Arora
• arXiv preprint · 1 October 2026

  Platonic Task Arithmetic

  Junghwan Park and Woojin Cho

All new papers in Machine Learning (Statistics)