arXiv preprint ·

Conformal Prediction with Stable Measurement Mechanisms

Seungjin Choi

Published
Source
arXiv preprint, posted before peer review
Original
Read it at arXiv
Topics
MethodologyMachine Learning (Statistics)

Abstract

In applications such as air-quality monitoring, inexpensive sensor readings can help predict pollutant concentrations measured by a separate reference instrument. We study how to adapt conformal prediction intervals to a new population when reference outcomes are available in the source data, but only sensor readings and context, such as weather conditions, are available in the target. We assume that the measurement distribution at a given outcome and context remains stable, while context frequencies and outcome distributions may change. This model is a particular form of causal mechanism shift. Its statistical restriction has been studied as sparse joint shift. Using established marginal matching, predictive adjustment, and weighted conformal calibration, we examine what this restriction contributes to coverage and interval length for continuous outcomes. Gaussian analyses show how measurement stability can identify outcome changes and how retaining context can shorten prediction intervals. For Gaussian models with known source mechanisms, we derive exact coverage formulas in the large-calibration limit while keeping the unlabeled target sample finite. These formulas explain when sharing a correction across contexts is preferable to fitting separate corrections, and why estimating outcome variability is particularly sensitive to weakly informative measurements. Experiments on synthetic Gaussian data show a coverage gain over covariate weighting at the same mean length and a length reduction of about $8\%$ relative to pooled label adjustment at comparable coverage. On the Air Quality dataset, controlled shifts yield coverage gains with longer intervals, while spring-to-autumn and year-over-year transfers show substantial undercoverage.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

Read it on ReadSearch

Each opens after you create an account, and brings you back to this paper.

Already a reader? Sign in

All new papers in Methodology

Get the few papers worth your time in Methodology every morning.

ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.

Papers belong to their authors and publishers; every page here links to the original. All research topics