Polylogarithmic Sparsity of Randomly Reweighted NPMLEs for Gaussian Mixtures

Abstract

The nonparametric maximum likelihood estimator (NPMLE) of a Gaussian location mixture maximizes the likelihood over the infinite-dimensional space of mixing distributions. The maximizing mixing distribution can be nonunique, and the classical bound on its number of atoms grows linearly with the sample size $n$. We show that a vanishingly small random perturbation of the likelihood yields exact polylogarithmic sparsity. The resulting randomly reweighted NPMLE maximizes a weighted likelihood whose independent weights, taken to be Gamma in our analysis, concentrate around one as $n$ grows. With high probability, it is unique, has $O\{(\log n/\log\log n)^d+\log n\}$ atoms in dimension $d$, nearly maximizes the ordinary likelihood, and estimates the mixture density at a Hellinger rate that is parametric up to logarithmic factors. This sparsity holds for the estimator itself, not for an approximation of it, and requires no support penalty. The proof rests on an effective-dimension principle for positive kernel mixtures: low-dimensional variation of the fitted values controls the support of every extreme point of the set of maximizers. Numerical illustrations verify that the reweighted NPMLE has Hellinger risk and support size comparable to those of the ordinary NPMLE.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Methodology

• arXiv preprint · 1 October 2026

  Gradient-Guided Density Peak Clustering

  Yikun Zhang and Yen-Chi Chen
• arXiv preprint · 2 October 2026

  Generalization Bounds for Flow-matching Generative Models for Intrinsically Low-dimensional Data

  Saptarshi Chakraborty, Quentin Berthet and Peter L. Bartlett
• arXiv preprint · 2 October 2026

  A Residual Tree Gaussian Process Modeling Framework for High-Dimensional Data

  Pulong Ma and Li Ma
• arXiv preprint · 1 October 2026

  Counterfactual Generation via Flow Matching: Coupling-Sensitive End-to-End Rates

  Yunrui Guan, Krishnakumar Balasubramanian and Shiva Prasad Kasiviswanathan
• arXiv preprint · 2 October 2026

  Cross-Fitting Under Nonregularity: Normality and Inference via Locality

  Bruno Fava

All new papers in Methodology