arXiv preprint ·
SIMANF: Sample Free Learning of Unnormalized Distributions via Simulated Annealing in Normalizing Flows
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Efficiently learning and sampling from high dimensional, multimodal unnormalized distributions without target samples remains a challenging problem. Although normalizing flows can generate samples efficiently, training based on the reverse KL divergence using only the unnormalized target density may suffer from mode collapse. We introduce SIMANF, a sample free framework that integrates simulated annealing with normalizing flows. SIMANF progressively transforms the target distribution from a smooth initial form to the original target distribution and trains the flow sequentially across these stages. By transferring the learned representation between stages, the method promotes mode coverage while progressively capturing finer features of the target distribution. Following annealing, a final refinement stage combines the reverse KL divergence with an importance weighted forward KL objective using samples generated by the flow. SIMANF requires no target samples during training and uses only the unnormalized density. We demonstrate its effectiveness on Many-Well distributions and high dimensional Scalar Phi4 lattice field theory distribution.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Machine Learning
LaMET-Agent: An Agent Framework for Large-Momentum Effective Theory Analysis
Multilevel Plaquette-Space Sampling for Lattice Gauge Theories with Local Constraint Solves
MORE Thermal Gauge Theories at Finite $θ$ and $μ$ from Real-Time Quantum Simulation
FUND: Density Flow for Sampling Unnormalised Distributions
No-go theorems for dual Hamiltonians of Non-Abelian Lattice Gauge Theories
Get the few papers worth your time in Machine Learning every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.