Direct Intermediate Initialization for Tilted Diffusion Samplers

Abstract

Some diffusion posterior samplers construct Gaussian-tilted intermediate distributions along the reverse process. We observe that these targets can be pulled back to clean-space posteriors with weaker conditioning, with samples transported analytically to the corresponding noisy-space target through a Gaussian bridge. For the sequential Monte Carlo (SMC) sampler MCGDiff, the effective observation variance of this pulled-back problem is up to twice the diffusion-noise variance. We exploit this structure to initialize MCGDiff directly at an intermediate time: an approximate solver samples the softened clean-space posterior, the Gaussian bridge maps these samples to the tilted target, and only the remaining SMC suffix is run. This trades asymptotic consistency for finite-particle performance. With moment-matching posterior sampling (MMPS) as the solver, the hybrid improves sliced Wasserstein distance by roughly $2\times$ at matched particle count on a structured Gaussian-mixture inverse problem, and by more than an order of magnitude when the posterior-relevant mode is rare under the prior. A prior-initialization control, which retains the bridge but drops the clean-space conditioning, shows that on MCGDiff's standard Gaussian-mixture benchmark most of the improvement is insensitive to the conditioning. Conditioning the initialization gives a further consistent gain on the structured problem, and becomes decisive on a rare-mode problem, where resampling cannot repopulate a mode absent from the initial population.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Machine Learning (Statistics)

• arXiv preprint · 5 October 2026

  Two-Sample Testing via Path-based Inference

  Eshant English, Wei-Cheng Lai, Yanfeng Yang and 3 others
• arXiv preprint · 6 October 2026

  Is $\sqrt{d}$ Separation Necessary for Gradient EM to Learn Gaussian Mixtures in High Dimensions?

  Yiran Zhang, Mo Zhou, Weihang Xu and 2 others
• arXiv preprint · 5 October 2026

  From Pixels, Without Pre-training: Joint Generative and Self-Supervised Representation Learning in One Model

  Vicente Balmaseda, Ching-Long Lin and Tianbao Yang
• arXiv preprint · 6 October 2026

  Learning a Mixture of GFlowNets

  Tiago da Silva, Amauri H. Souza and Salem Lahlou
• arXiv preprint · 5 October 2026

  Retrieval-Based In-Context Learning: A Domain Adaptation Framework

  Yilun Zhu, Naihao Deng, Yingcong Li and 2 others

All new papers in Machine Learning (Statistics)