arXiv preprint ·
A One-Sided McDiarmid-Type Inequality for Heavy Tails via Reverse KL Tensorization
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
We revisit McDiarmid's inequality, a central tool in statistical learning theory and algorithm analysis. We show that large deviations above the mean are exponentially unlikely for functions of independent random variables that are almost surely bounded above and satisfy a conditional moment assumption of order $p\in(1,2]$. When $p<2$, the result applies even when the function has infinite variance. Our proof relies on a new tensorization inequality for the Kullback--Leibler divergence, termed reverse KL tensorization, which may be of independent interest. Applications include concentration of the sample mean and median-of-means estimator, and one-sided uniform risk bounds for unbounded losses.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Statistics Theory
On the skew-curvature power law relationship in a stochastic volatility model with infinite variation Lévy jumps
Pathwise Shrinkage and Probabilistic Calibration of the Multiplicative Half-Cauchy Process
Recursive Operator Localization and Spectral Gap Descent via the Geometry of Local Spectral Expansion
Feeling the generalised rough SABR boundary
Polytope Sampling at the Speed of Isoperimetry
Get the few papers worth your time in Statistics Theory every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.