arXiv preprint ·
Weighted conformal prediction under covariate shift: process limits, estimated weights and efficiency
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Weighted split conformal prediction handles covariate shift by reweighting calibration scores with the likelihood ratio $v=dQ_X/dP_X$; its training-conditional coverage is a functional of the self-normalized weighted empirical distribution function $\hat F_m$, and we study the process $\sqrt m(\hat F_m-F_Q)$. It converges in $\ell^\infty$ to the Gaussian process $W(G(t))-F_Q(t)W(K^2)$, with $G(t)=\mathbb{E}_Q[v\mathbf{1}\{S\le t\}]$ and $K^2=1+χ^2(Q\|P)$, if and only if $χ^2(Q\|P)<\infty$ (for non-degenerate scores); $\sup v$ plays no role. The limit gives the joint law of the coverage across levels, consistent bootstraps, inflations asymptotically exact uniformly in the level, and Berry-Esseen-type rates. With estimated ratios, a uniform expansion remains valid when the estimate uses the calibration covariates; the estimation error enters through a covariance term that can reduce the variance below the oracle's, and a pairs bootstrap reproduces it. When the ratio is known, the weighted conformal threshold is semiparametrically efficient if and only if the ratio and the coverage indicator are uncorrelated under the test distribution, with an explicit efficient correction otherwise. When $χ^2(Q\|P)=\infty$, the ratio has a regularly varying tail of index $p\in(1,2)$ and the score decouples from it in the far tail, the finite-dimensional limits are $p$-stable at the rate $m^{1-1/p}$ up to a slowly varying factor.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Statistics Theory
Decorrelation Before Variable Selection: Left and Right Transforms and Their Trade-Off
Log-optimal two-sample testing by betting
FARCH: A Functional ARCH Model for Calibrated Prediction Bands
Learning the Average Dose-Response Function with a Right-Censored Treatment
Variance-adaptive confidence regions for fixed-benchmark binomial mixtures, with application to LLM evaluation
Get the few papers worth your time in Statistics Theory every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.