Self-Normalized Inference from Riemannian Stochastic Gradient Paths

Abstract

Riemannian stochastic gradient paths estimate constrained parameters, but confidence regions usually require estimating the Hessian and gradient-noise covariance. We develop self-normalized inference from one path by expressing retained iterates in a common random tangent space. Their average and centered partial sums share an unknown covariance factor that cancels in a Brownian bridge pivot. Under suitable regularity conditions, a joint expansion of the averaged estimator and integrated path controls nonlinear coordinate errors using conditional second moments. The procedure uses fixed-dimensional memory and extends to nondegenerate smooth functionals and alternative local coordinates. Numerical studies show competitive coverage relative to plug-in Wald inference while avoiding Hessian and residual-density estimation.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Machine Learning (Statistics)

• arXiv preprint · 31 October 2026

  Power-Optimal Risk Control via Standardized Margin Calibration

  Ruinan Wang, Tian Bai, Yueming Shen and 3 others
• arXiv preprint · 1 November 2026

  Variational learning of energy-stable macroscopic flow equations from microscopic laws

  Pei Ge and Huan Lei
• arXiv preprint · 31 October 2026

  Where Causal Discovery Breaks on Real Data: Measuring the Assumptions One Property at a Time

  Padmaja Jonnalagedda, Avinash Baidya, Ruocheng Guo and 1 other
• arXiv preprint · 1 November 2026

  Transport for Conditional Sampling: Foundations and Applications

  Ricardo Baptista, Benjamin Bloem-Reddy and Bamdad Hosseini
• arXiv preprint · 31 October 2026

  Representative Learning for Distributed Support Vector Machines

  Joseph A. Casey, Boxiang Wang and Keren Li

All new papers in Machine Learning (Statistics)