Generalized Hyperrectangular Prediction Sets in Multivariate Conformal Prediction

Abstract

In multivariate conformal prediction, many nonconformity scores yield prediction sets with complex geometry (e.g., ellipsoids or density level sets) that are difficult to interpret and visualize. Hyperrectangles offer a practical alternative by providing one interval per output. We extend this notion to Cartesian products of arbitrary one-dimensional sets, which we call generalized hyperrectangles. We introduce a rectangularization framework that turns any continuous multivariate nonconformity score, or conditional density, into one yielding generalized hyperrectangular prediction sets with finite-sample coverage. We establish key geometric properties of our rectangularization framework and provide useful intuitions on generalized hyperrectangles. We further establish a representation theorem showing that a broad class of hyperrectangular conformal methods based on max-aggregated coordinate-wise scores can be interpreted as rectangularizations of implicit conditional densities. Through synthetic and real-world experiments, we quantify the efficiency cost of rectangularization, while highlighting its benefits, especially for practical applications of uncertainty quantification.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Machine Learning (Statistics)

• arXiv preprint · 3 November 2026

  Nonparametric GARCH: An Iterated Neural Estimator

  Ruizhi Deng, Guohao Shen and Ngai Hang Chan
• arXiv preprint · 4 November 2026

  Discovering like a scientist: Literature-informed dimensionless learning for physical closure of data-driven equations

  Hao Xu, Tianhao Wu and Dongxiao Zhang
• arXiv preprint · 3 November 2026

  Descending Everest, Part II: Oracle Complexity of Minimizing a Sum of Convex $(L_0,L_1)$-Smooth Functions

  Mikhail Rudomanov, Ivan Fomin, Alexander V. Gasnikov and 1 other
• arXiv preprint · 4 November 2026

  Towards the Query Complexity of Sampling under Strong Log-Concavity and Log-Sobolev Inequalities

  Huanjian Zhou and Taiji Suzuki
• arXiv preprint · 3 November 2026

  Statistical Machine Learning for Medicinal Plant Leaves Classification

  Jayani P. Gamage and Thiyanga S. Talagala

All new papers in Machine Learning (Statistics)