Partial Invariance for Classification under Structural Causal Models

Abstract

Making predictions in an unseen environment from data collected across multiple training environments is challenging. This challenge is particularly pronounced when the target-generating mechanism varies across environments. In this work, we introduce environment-label separation, a form of partial environmental invariance that decomposes the target conditional distribution into an environment-invariant component and a label-invariant component. We show that this partial invariance enables estimation of the target conditional distribution in an unseen environment when using labeled training data together with unlabeled test features. Within the structural causal model framework, we provide sufficient conditions for environment-label separation. Building on these conditions, we develop an algorithm, dIMP-Classifier, which jointly minimizes an estimate of the test risk and encourages invariance across environments. We further provide finite-sample guarantees that characterize the test risk in terms of deviations from invariance, estimation error, and sample complexity. Experiments on simulated data and the real-world light tunnel Causal Chamber data demonstrate that the proposed approach can perform under interventions on the target mechanism and consistently outperforms the considered standard and invariance-based baselines.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Methodology

• arXiv preprint · 1 November 2026

  Transport for Conditional Sampling: Foundations and Applications

  Ricardo Baptista, Benjamin Bloem-Reddy and Bamdad Hosseini
• arXiv preprint · 2 November 2026

  A Scientific Claim Stability Framework for Evaluating MRI Morphometry Pipelines

  Duy-Cat Can, Dang-Duat Tran, Anh-Khang Nguyen and 6 others
• arXiv preprint · 1 November 2026

  Principled Human-AI Collaboration in Agentic Workflows

  Young Hyun Cho and Will Wei Sun
• arXiv preprint · 2 November 2026

  Diagnosing Model--Item Interactions in Language Model Benchmarks with LSIRM

  Jinwen Luo, Han Jiang, Ziang Xiao and 1 other
• arXiv preprint · 1 November 2026

  Stand-In Effects and Pooling Amplification: Design-Based Tests of Whether Biological World Models Use Actions

  Bowen Xu and Boyu Chen

All new papers in Methodology