arXiv preprint ·
The Statistical Geometry of Latent Recovery in Hidden Markov Models
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Hidden Markov models (HMMs) offer an important capability to interpret fitted latent states and transitions. When emission distributions nearly coincide, a small observation-density error does not ensure accurate estimation of the latent quantities needed for interpretation. This motivates us to characterize convergence rates for latent recovery that account for emission separation. Our main contribution lies in deriving deterministic inverse inequalities that convert Hellinger error between fitted and true densities into bounds on latent recovery errors. We develop these bounds for multivariate Gaussian HMMs with a common, known emission covariance matrix and combine them with a Hellinger estimation guarantee for the global maximum likelihood estimator to obtain latent recovery rates. Although the joint observation distribution is a Gaussian mixture with exponentially many path components, they share the same emission centers across time. Leveraging this shared structure, we show that the separation exponents are governed by the maximum number of simultaneously approaching centers rather than the number of path components. Under exact specification, the global bounds on state-sequence probability discrepancies and the 1-Wasserstein loss for latent location distributions exhibit sharp separation exponents that do not increase with the number of selected times. Moreover, sufficiently small observation-density error guarantees unique matching between fitted and true emission centers, which yields error bounds for individual emission centers and transition rows. Under over-specification, individual split-state transition rows are not necessarily identifiable, so we quantify aggregate latent recovery errors and show that state-sequence probability bounds incur larger separation exponents compared to exact specification. We conduct synthetic experiments to validate our theoretical results.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Statistics Theory
Non-asymptotic analysis of SGLD with discontinuous stochastic gradients: a new route to portfolio CVaR minimization
Transport for Conditional Sampling: Foundations and Applications
Instance-Specific Sharp Convergence Rate of the Add-$λ$ Estimator via Feature Space Decomposition
Estimating Average Treatment Effects with Projected Instrumental Variables
Federated Estimation of Loading Spaces in Tensor Factor Models under Differential Privacy
Get the few papers worth your time in Statistics Theory every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.