Exploiting Gradients in Bayesian Inference of Expensive Simulators

Abstract

Simulators based on differential equations are ubiquitous in science and engineering. They are often used in simulation-based inference to evaluate the posterior distribution of the input parameters based on real-world observations of the simulator outputs. However, inference becomes challenging when individual simulator evaluations are computationally expensive. In such cases, a Bayesian optimization-based active learning approach with Gaussian process surrogate models has been used to maximize the information obtained from a limited simulation budget. Recently, gradients of simulator outputs with respect to input parameters have become increasingly available, yet they are rarely exploited for inference. Even though we only need to learn the simulator input-output relationship, gradient information can provide an additional valuable signal to guide the active learning procedure. This is of particular interest in the case of expensive simulators, when sample efficiency is crucial. In this paper, we demonstrate how incorporating gradient information into the Gaussian process surrogate accelerates Bayesian optimization-based inference under a limited simulation budget. Our results show significant improvement in convergence speed from using gradient information. For reverse-mode differentiation, the inference efficiency gains are maintained when accounting for the additional computational cost. In contrast, for forward-mode differentiation, the inference speed-up does not outweigh the computational costs. These results indicate that gradient-enhanced surrogates are beneficial primarily in problems where the number of parameters exceeds the output dimensionality, where reverse-mode differentiation is efficient.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Machine Learning

• arXiv preprint · 8 October 2026

  Decision-Sufficient Posterior Approximation

  Sean Plummer
• arXiv preprint · 9 October 2026

  Scalable Learning of Determinantal Point Processes with Kernel-Structured Interactions

  Takahiro Kawashima and Hideitsu Hino
• arXiv preprint · 8 October 2026

  A General $\widetildeΩ(\sqrt{T γ_T})$ Lower Bound for Kernel Bandits

  Chenkai Ma and Jonathan Scarlett
• arXiv preprint · 9 October 2026

  Two-way Guidance: Simultaneous Learning of Summary Statistics for Generative Bayes

  Percy S. Zhai, Max Pachman, Peverel D. Shipley and 1 other
• arXiv preprint · 8 October 2026

  Accelerating Non-Smooth and Heavy-Tailed Sampling

  Pervez Ali, Xiaoyu Wang, Yingli Wang and 1 other

All new papers in Machine Learning