Exploration strategies for Gaussian process bandit optimization with inference regret guarantees

Abstract

Existing cumulative regret guarantees for Bayesian optimization (BO) do not necessarily characterize the quality of the algorithm's final output. This gap is critical under noisy evaluations, where the goal is to return a single high-quality recommendation. To address it, we introduce efficient exploration strategies that can be incorporated into any BO procedure by occasionally replacing the acquisition query with an exploration query. To validate this approach, we bound the Gaussian process posterior standard deviation over the search space via the fill distance of the queries, which measures the largest region left unexplored. We then use this result to derive upper bounds on the inference regret, i.e., the gap between the global optimum and the function value at the algorithm's returned point. Empirically, these exploration strategies improve the final recommendations of existing BO algorithms on synthetic benchmarks, hyperparameter optimization, and a control task.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Machine Learning (Statistics)

• arXiv preprint · 13 October 2026

  A Randomized Approximation Algorithm for Doubly Free-Boundary Macdonald Processes

  Zhongyang Li
• arXiv preprint · 12 October 2026

  Locally adaptive step sizes for Hamiltonian Monte Carlo methods

  Jimmy Huy Tran, Tore Selland Kleppe and Nawaf Bou-Rabee
• arXiv preprint · 13 October 2026

  Theoretical and Practical Advances in Hierarchical Bayesian Deep Learning Methodology

  Neil K. Chada, Simon Cotter, Kody J. H. Law and 1 other
• arXiv preprint · 12 October 2026

  CLASSO: a practical primal path-following algorithm for the constrained LASSO

  Michael Hobson, Luke Butcher and Lindley Lentati
• arXiv preprint · 14 October 2026

  MCMC Can See Can't See

  Daniel Matsui Smola

All new papers in Machine Learning (Statistics)