Sufficiently Reduced Distributional Regression

Abstract

We propose Sufficiently Reduced Distributional Regression (SRDR), a generative method that combines conditional distribution estimation with nonlinear sufficient dimension reduction (SDR). It builds on a characterization of sufficiency through strictly proper scoring rules: a dimension reduction is sufficient if and only if predicting the response from the reduced covariates incurs no loss in expected score relative to the full covariates. Sufficient dimension reduction thus becomes a risk minimization problem. SRDR jointly trains a dimension reduction map and a generative prediction model by minimizing the energy score, which can be estimated by sampling without density evaluation or adversarial training. The framework extends to multi-environment data and to classification. We prove that the estimated conditional distributions converge in energy distance to the true ones, which implies that the learned representation is asymptotically sufficient. In simulations and applications to CT slice localization, superconductivity, and digit classification, SRDR recovers low-dimensional sufficient structure and matches or outperforms state-of-the-art nonlinear SDR methods in representation quality and predictive performance.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Methodology

• arXiv preprint · 24 September 2026

  Human-AI-Powered Hypothesis Testing: Cost-Aware Selective AI Scoring and Sequential Human Escalation

  Dae Woong Ham, Xuejun Zhao, Stefanus Jasin and 1 other
• arXiv preprint · 25 September 2026

  MARCEDES: Score-based causal discovery under non-Gaussianity with continuous optimization

  Anamitra Chaudhuri, Anirban Bhattacharya and Yang Ni
• arXiv preprint · 25 September 2026

  Design-Ignoring versus Design-Respecting World Models for Epidemiology

  Xiangyu Yu and Weiyu Liu
• arXiv preprint · 24 September 2026

  Shrinking-Tube Concentration for Adaptive Markovian Stochastic Approximation

  Jin Li, Ye Luo and Xiaowei Zhang
• arXiv preprint · 25 September 2026

  Structured Bayesian Modeling of Dynamic Receptive1 Fields in Salamander Retinal Ganglion Cells

  Alokesh Manna

All new papers in Methodology