Isotonic surrogate modeling for computer experiments with many input variables

Abstract

Virtual simulators are widely used for studying complex physical phenomena, from particle collisions to rocket propulsion. Such "computer experiments" can be highly time-intensive, and a Bayesian surrogate model can be used for efficient emulation with reliable uncertainty quantification. To train accurate surrogates with a limited sample size $n$, recent work has explored the incorporation of monotonicity (or isotonicity) information, which can often be elicited from physical systems. In practical applications with many input variables, however, existing Bayesian isotonic models can face statistical and computational limitations, which may result in worse performance compared to models that do not incorporate isotonicity. We propose a new transformed additive isotonic model (TAIM), which aims to tame this "curse-of-dimensionality". TAIM makes use of a flexible transformed additive isotonic modeling framework, which leverages a data-estimated link transformation and a monotone basis model with spike-and-slab priors on basis weights. Prediction-wise, TAIM achieves (up to log factors) a posterior contraction rate of $O(n^{-1/3})$ when the true black-box function is in a transformed additive isotonic form with mild smoothness conditions. Such a rate does not depend on the input dimension $d$ for terms involving $n$, which softens the effect of dimensionality on posterior predictions. Computation-wise, TAIM allows for efficient posterior inference via a carefully designed Gibbs sampler, where each sampling iteration requires only linear work in $d$. We further present an extension of TAIM that can model potential deviations from transformed additivity. Numerical experiments and two applications show the effectiveness of TAIM for isotonic surrogate modeling with many input variables.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Methodology

• arXiv preprint · 30 September 2026

  Learn-Then-Differentiate Gradient Estimation

  Nifei Lin, Qingkai Zhang and L. Jeff Hong
• arXiv preprint · 28 September 2026

  One Proposal for Every Margin: Zero-Shot Amortized Sequential Importance Sampling for Binary Matrices

  Ruishuo Chen, Weijia Li, Xun Wang and 3 others
• arXiv preprint · 30 September 2026

  Mitigating Representation Gaps in Amortized Bayesian Inference with Auxiliary Supervision

  Hans Olischläger, Svenja Jedhoff, Šimon Kucharský and 3 others
• arXiv preprint · 28 September 2026

  FluxLite: Inference-Time Proposal Control for Discrete Diffusion Models

  Yinuo Ren, Haoxuan Chen, Grant M. Rotskoff and 2 others
• arXiv preprint · 30 September 2026

  Amortized ratio-estimation importance sampling and localized simulation-based calibration for intractable likelihoods

  Umberto Picchini

All new papers in Methodology