Active Pilot Sampling for Multi-fidelity Estimation in Stochastic Optimization

Abstract

Stochastic optimization with high-fidelity nonlinear models is often computationally prohibitive because each objective evaluation requires sampling-based uncertainty quantification inside an outer optimization loop. Multi-fidelity estimators, such as approximate control variates (ACV), can reduce this cost by exploiting cheaper low-fidelity models, but they require model-output covariance information to determine control-variate weights and sample allocations. These covariances are generally unknown and must be estimated through pilot sampling. Existing pilot-sampling strategies primarily address one-off estimation and do not exploit the structure of iterative stochastic optimization, where covariance information may vary smoothly across the design domain and can be shared across optimization queries. We propose an active pilot-sampling framework that learns a probabilistic emulator of the model-output covariance matrix using a positive-definite parameterization based on matrix-logarithm-transformed correlations and log standard deviations. The emulator provides design-specific covariance estimates for constructing ACV estimators at new optimization queries, avoiding repeated independent covariance estimation at every design. Active-learning acquisition functions allocate pilot samples to designs where covariance information is most uncertain and most relevant to the outer optimization objective. We demonstrate the method on a four-branch benchmark and a multi-fidelity Bayesian optimal experimental design application for sensor placement and measurement-time selection in a convection-diffusion system. The results show improved optimization performance relative to single-fidelity Monte Carlo and simpler pilot-sampling strategies.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Methodology

• arXiv preprint · 20 October 2026

  A Bayesian machine learning approach to direct and spillover effects in cluster-randomized trials with noncompliance

  Saurabh Bhandari, Fan Li and Michael J. Daniels
• arXiv preprint · 21 October 2026

  Lifting PCA in the Wasserstein Space

  Jérémie Bigot and Clément Bonet
• arXiv preprint · 20 October 2026

  On the Accuracy of Approximate Leave-One-Out with Blockwise Nonsmooth Regularization in High-dimensions

  Honghao Lin, Songbin Liu, Arian Maleki and 5 others
• arXiv preprint · 21 October 2026

  Mastering Model Fit: Applications of the InterModel Vigorish for Interpretable Machine Learning

  Jiani Yan, Pengyun Wang, Klint Kanopka and 2 others
• arXiv preprint · 21 October 2026

  When Reconstruction Is Not Enough: Doubly Robust Counterfactual and Interventional Mediation Analysis with Learned Multimodal Representations

  Cong Cao

All new papers in Methodology