arXiv preprint ·
Sequential Conditional Independence Testing with Machine Learning Models
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Conditional independence testing is a ubiquitous problem in scientific discovery. The widely employed model-X assumption shifts the modelling burden from the dependence of the output on the inputs to the dependencies within the inputs. Log-optimal e-variables have been studied in this setting, but it remains unclear how to incorporate machine learning models into their design. Other approaches test exchangeability directly, yielding an e-variable with lower power in theory but, surprisingly, higher power in practice. We explain this phenomenon by decomposing the error into null enlargement, approximation, and estimation error. The decomposition shows that GRO e-variable estimates can be beaten because of their worse approximation and estimation errors, and we explore intermediate null hypotheses between model-X conditional independence and exchangeability to reduce these errors. Moreover, the model-X assumption often only holds up to an estimation error, invalidating exact type-I error guarantees. We provide estimation error bounds that accommodate triple robustness results, achieving fast convergence rates.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Statistics Theory
Decision-Sufficient Posterior Approximation
Learning by Compression: Risk Estimates Attain the Law-of-Large-Numbers Rate
Beyond Discrepancy: Oracle Drift in Nonstationary Weighted Risk Minimization
Optimal random quantisers for spherically symmetric distributions
Prior-Informed Generalizable Low-Rank Representation Learning via Regularized Adversarial Reweighting
Get the few papers worth your time in Statistics Theory every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.