Practical Advantages of Online Conformal Prediction for Data Streams

Abstract

Full conformal prediction offers finite-sample marginal coverage guarantees under exchangeability, but exact computation can be costly, while its classical guarantees do not directly extend to non-stationary data streams. We compare four sequential conformal regression procedures with a weighted full-conformal benchmark in terms of empirical coverage, prediction interval width, and computational cost. The procedures combine ordinary or forgetting-factor least squares with uniform or exponentially weighted empirical residual quantiles, or with online gradient-based quantile tracking. Experiments cover an independent and identically distributed control, two synthetic distribution-shift scenarios, and four real-world data streams. Adapting the regression model as well as the conformal threshold substantially improves the coverage--width tradeoff under drift. The quantile-tracking procedure requires $O(p^2)$ time and memory per observation, independently of stream length, although its coverage can deteriorate after abrupt changes. These results illustrate the practical tradeoffs between predictor adaptation, uncertainty quantification, and computational resources.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Computation

• arXiv preprint · 20 October 2026

  Bayesian Neural Networks via Dirichlet Process Priors on the Data-Generating Distribution for Randomized Value Functions in Deep Reinforcement Learning

  Sumit Vashishtha
• arXiv preprint · 21 October 2026

  Asynchronous, Generation-Free ABC: Streaming AMIS Reweighting for Heterogeneous Simulator Workloads on HPC

  Julian Herold, Markus Götz and Alexander Schug
• arXiv preprint · 20 October 2026

  Divide-and-Conquer Neural Bayes Estimation for Spatial and Spatiotemporal Point Process Models

  Bokgyeong Kang, Andrew Zammit-Mangion, Erin M. Schliep and 1 other
• arXiv preprint · 21 October 2026

  Generalizing Metropolis-Hastings for DAG Sampling

  Daniele Nikzad and Mikko Koivisto
• arXiv preprint · 22 October 2026

  Multichoice Modeling: Exploring Decision Configuration Space under Uncertainty

  Mariia Kozlova, Roman Stepanov, Alexander Walzer and 1 other

All new papers in Computation