Usefulness of Quantile-Aware Diffusion Modeling for Highly Imbalanced Tabular Data

Abstract

Classification problem in the context of highly imbalanced data is a major challenge in many real-world applications (e.g., FinTech, healthcare, etc.). In these cases, the vast majority of instances belong to a single class and a small fraction represent the minority class (often the most critical class). Recently, diffusion models have emerged as powerful approaches to reduce the degree of ``imbalanced-ness'' in the dataset; they work by generating synthetic data by capturing complex data distributions using iterative transformations. However, standard diffusion models are not inherently suited to highly skewed or heavy-tailed data, due to inbuilt quadratic error loss, which lacks the structural sensitivity to capture rare, extreme values, and minority-class nuances. We propose a novel approach, namely, Quantile-TabDDPM, based on a quantile-regularized denoising objective that combines the standard quadratic error loss with a quantile loss term to explicitly capture rare events while preserving the theoretical grounding of the original denoising objective. We extensively evaluated our approach on a real-world credit card transaction dataset characterized by extreme class imbalance. The results demonstrate that the integration of diffusion-based synthetic data generation with a quantile-regularized denoising objective provides a robust and effective framework for fraud detection in highly imbalanced datasets.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Machine Learning

• arXiv preprint · 5 October 2026

  Errors of LLM-Assisted Literature Retrieval in Environmental Science: A Comparison Study of Abstract versus Full-text Based Prompts

  Yanjun Chen, Yongfeng Zhang and Lanjing Zhang
• arXiv preprint · 6 October 2026

  Trustworthy Method Comparison with AI Judges: Estimation and Design under Order, Batch, and Aggregation Effects

  Tianxi Li and Jie Ding
• arXiv preprint · 6 October 2026

  Scalable Regularized Vector Multiplicative Error Models for Positive-valued Financial Time Series

  Rohan Hemant Chhatre, Chiranjit Dutta, Nalini Ravishanker and 1 other
• arXiv preprint · 5 October 2026

  Comparing two approaches for modelling the loss given default of credit cards: Run-off triangles vs regression

  Arno Botha, Henko Crewe, Marcel Muller and 1 other
• arXiv preprint · 6 October 2026

  Learned Monotone Recurrent Features in Governed Credit Scoring: The Price of the Frame and the Necessity of Macro Conditioning

  Yew Lee Tan

All new papers in Machine Learning