Product Monte Carlo: Expectation Under a Product of Densities

Abstract

Aggregating independently computed sub-sample inferences is a well-known challenge in large-scale Bayesian computation, federated learning, and opinion pooling. The core problem is to approximate a distribution whose density is proportional to a product of individual densities. We propose Product Monte Carlo (PMC), an algorithm for computing arbitrary expectations under a product of densities using only Monte Carlo draws from individual densities. We turn the intractable product expectation into a regression problem by expressing it through a family of computable conditional expectations. Besides the point estimate, our fully Bayesian regression formulation provides coherent uncertainty quantification and principled diagnostics. We establish theoretical guarantees on consistency and characterize convergence rates for the PMC estimator. Across simulated and real-data experiments varying the number, dimensionality, and heterogeneity of the component distributions, PMC achieves higher estimation accuracy, better-calibrated uncertainty coverage, and improved scalability at a lower computational cost than existing methods. In addition, PMC requires no density evaluation, making it applicable to simulation-based inference, as we demonstrate in an application with protein images.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Methodology

• arXiv preprint · 8 October 2026

  Regularized Small Area Estimation with Graph Laplacian Benchmarking priors

  Jairo Fúquene-Patiño and Brenda Betancourt
• arXiv preprint · 9 October 2026

  Two-way Guidance: Simultaneous Learning of Summary Statistics for Generative Bayes

  Percy S. Zhai, Max Pachman, Peverel D. Shipley and 1 other
• arXiv preprint · 8 October 2026

  Efficient quadratic entropy with distance sketches

  Steve Huntsman
• arXiv preprint · 9 October 2026

  Generalized Determinantal Point Processes for Attraction and Repulsion with Distinct Interaction Kernels

  Hideaki Ishibashi, Takahiro Kawashima and Hideitsu Hino
• arXiv preprint · 9 October 2026

  Spatial Prediction with Guided Diffusion

  Andrew Zammit-Mangion, Lachlan Astfalck, Raphaël Huser and 2 others

All new papers in Methodology