Anchored Stein Variational Gradient Descent Algorithm for Non-smooth Sampling

Abstract

We introduce a Stein variational framework for sampling from a target density $p\propto e^{-U}$ when the target potential $U$ is possibly non-smooth. The key idea is to introduce a smoother reference potential $U_0$ and the anchor weight $a=e^{U-U_0}$. The resulting anchored Stein variational gradient descent (SVGD) algorithm is able to target $p\propto e^{-U}$ without computing the gradient of $U$ and include standard SVGD as a special case. In particular, we allow the target potential $U$ to be locally Lipschitz while the reference potential $U_0$ is continuously differentiable, along with other suitable assumptions. Under this low regularity regime, we establish a Kullback-Leibler first variation formula for anchored perturbations, identify the corresponding steepest descent direction in the reproducing kernel Hilbert space and prove a nonasymptotic convergence bound for the anchored SVGD algorithm in terms of an anchored kernelized Stein discrepancy. Finally, we also provide guidance on constructing a suitable reference potential $U_0$ based on $U$.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Machine Learning (Statistics)

• arXiv preprint · 26 October 2026

  Intrinsic Information Rates of Summaries in Simulation-Based Inference

  Vansh Bansal, Pradip Sharma Poudel and James G. Scott
• arXiv preprint · 27 October 2026

  Second-order Sinkhorn Geometry and $\sqrt{n}$-Inference

  Tristan Luca Saidi, Florian Gunsilius and Gonzalo Mena
• arXiv preprint · 26 October 2026

  Designing Customer Feedback for Subscription Boxes

  Renjun Hu, Hyun-Soo Ahn and Stefanus Jasin
• arXiv preprint · 27 October 2026

  Algorithmics for Graphical Separation Criteria

  Moisés Chavira-Flores, Sebastian Weichwald and Leonard Henckel
• arXiv preprint · 26 October 2026

  When Does Data Value Reduce to Class Balance? A Coverage View of Per-Point Data Valuation

  Yingjie Bai and Weiming Zhi

All new papers in Machine Learning (Statistics)