arXiv preprint ·
Change detection with conformal martingales: new optimal constructions, and suboptimality of existing methods
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
We study distribution-free sequential changepoint detection for independent observations with unknown and unrestricted pre- and post-change laws. We build on the conformal test martingales and associated e-detectors of Vovk(2021), which control the probability of false alarm (PFA) and the average run length (ARL) respectively. The majority of these works focus on validity, with statistical efficiency usually left for simulations. We develop a comprehensive theory of how conformal p-values behave under non-exchangeable data with a changepoint at an unknown time $T$. We use this to analyze the post-change growth and resulting detection delay of conformal martingale methods, and prove that the standard existing methods are suboptimal for PFA and ARL control, and can lead to delays that are $Ω(T)$ and $Ω(\sqrt{\text{ARL}})$ respectively. We propose different conformal e-processes and e-detectors that are provably minimax optimal, with delays $Θ(\log T)$ and $Θ(\log \text{ARL})$ respectively, and have much shorter delays in simulations.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Statistics Theory
Classical Sufficiency in Quantum Statistical Experiments
On the Sample Complexity of Active Learning with Membership Queries
Riemannian Gradient Descent for Gaussian Mixture Models with unknown diagonal covariances
Robustness of Diffusion Models under Distribution Shift
Scaffold-Constrained Subset Dynamic Programming for Exact SSE Clustering
Get the few papers worth your time in Statistics Theory every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.