Causal Robustness from Synthetic Environments

Abstract

We study robust prediction when the training data come from a single observational distribution. Causality-oriented methods for robust prediction usually use heterogeneity across observed environments both to learn an invariant prediction function and to determine the perturbations against which it is robust. We show that both can be recovered from one distribution under a structural additive-noise mechanism for the response. Under the structural model considered here, the causal prediction function has constant conditional mean squared error given its prediction. We generate synthetic environments by reweighting the covariate distribution along the prediction and use a Cramér--von Mises criterion to measure departures from this invariance. The resulting penalised risk admits a regularised worst-case representation, linking the criterion to robustness against covariate shifts induced by reweighting observations according to their predicted values. Under an additional orthogonality condition, we identify the causal prediction function as the unique risk minimiser subject to this invariance restriction. We establish consistency and an explicit rate, derive a goodness-of-fit test for the invariance restriction, and characterise the population target under misspecification. With multiple observed environments, the construction applies environment by environment and can be combined with Distributional Robustness via Invariant Gradients (DRIG) to control two complementary classes of shifts.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Methodology

• arXiv preprint · 19 October 2026

  Federated Community Detection in Bipartite Networks

  Wanjie Wang
• arXiv preprint · 20 October 2026

  A Bayesian machine learning approach to direct and spillover effects in cluster-randomized trials with noncompliance

  Saurabh Bhandari, Fan Li and Michael J. Daniels
• arXiv preprint · 19 October 2026

  Mediation and moderation in distance-based regression with triangular fuzzy data: simulation evidence and an application to academic performance

  Fabrizio Maturo and Annamaria Porreca
• arXiv preprint · 20 October 2026

  On the Accuracy of Approximate Leave-One-Out with Blockwise Nonsmooth Regularization in High-dimensions

  Honghao Lin, Songbin Liu, Arian Maleki and 5 others
• arXiv preprint · 20 October 2026

  Active Pilot Sampling for Multi-fidelity Estimation in Stochastic Optimization

  Thomas E. Coons, Aniket Jivani and Xun Huan

All new papers in Methodology