Mixed Engression: Distributional Regression for Multivariate Mixed-Type Responses

Abstract

Estimating the conditional distribution of multivariate responses with continuous and binary components requires capturing their dependence, respecting their different supports, and accommodating potentially heavy-tailed continuous outcomes. We propose mixed engression, which fits a continuous generator using energy losses induced by bounded discrepancies and then thresholds its soft binary outputs to produce mixed-response samples. Because the discrepancies are bounded, the population objective remains well defined without response-moment assumptions. However, we show that the full-response energy distance for the complete response vector can tend to zero before thresholding yet remain bounded away from zero afterward as response dimensions grow. A separate energy loss on the entire binary vector captures discrepancies obscured by the full-response comparison and controls the effect of thresholding. The generator is therefore fitted using an augmented energy loss that combines the full-response and binary components. Under compositional smoothness of the structural functions and a uniform threshold-margin condition, we derive nonasymptotic bounds on the final sampler's full-response error for sparse ReLU estimators of models driven by Gaussian or Student-t structural noise, yielding polynomial convergence rates up to logarithmic factors. We also establish consistency when the covariate, response, and noise dimensions grow under suitable conditions. Simulations show improved accuracy relative to the comparison methods under the full-response energy distance, including in heavy-tailed settings. Moderate binary augmentation substantially improves binary-distribution accuracy while largely preserving full-response accuracy.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Methodology

• arXiv preprint · 23 October 2026

  Random Jump Forests

  Martin Bladt and Rasmus Frigaard Lemvig
• arXiv preprint · 24 October 2026

  Faithful Federated Tabular Data Synthesis

  Zilong Cao, Hai Zhang and Xuan Bi
• arXiv preprint · 24 October 2026

  Causal Inference in Metric Spaces via Distance Profiles

  Zheye Song and Zhiheng Zhang
• arXiv preprint · 23 October 2026

  Not All Mislabels Are Equal: Efficient Task-Aware Auditing with Confidence Sequences

  Fangyuan Lin, Noah Krever, Jakub Černý and 1 other
• arXiv preprint · 25 October 2026

  Synthetic Data Augmentation for Functional Data: Wasserstein Risk Bounds and Diffusion-Based Conditional Generation

  Yuhao Qi, Wenlin Dai and Xuehu Zhu

All new papers in Methodology