Autoregressive Decoding as a Martingale: Characterizing the Stochastic Dynamics of LLM Generation

Abstract

Large language models (LLMs) have achieved remarkable success across a wide range of language tasks. At their core, autoregressive LLMs are conditional probability models that learn to approximate the next-token distribution given the preceding context. Despite this probabilistic nature, the stochastic dynamics of autoregressive decoding have rarely been investigated from a rigorous probabilistic perspective. In this work, we define the per-step prediction error as the difference between the sampled token indicator and the model's conditional predictive distribution, and prove that the cumulative error process is a martingale with respect to the decoding filtration, implying that its conditional first-order moment is identically zero. Beyond this first-order property, we derive a closed-form expression for the second-order behavior of the martingale sequence: its predictable quadratic variation reduces to $\sum_t\left(1-p(y_t\mid y_{<t})\right)$, computable from realized token probabilities alone. This identity establishes a direct theoretical connection between sequence fluctuations and predictive uncertainty during autoregressive decoding. White-box experiments on Llama-3.x and Qwen2.5 families (1B to 72B parameters) verify that the empirically measured second-order moments closely match the theoretical predictions derived from our martingale analysis. These results provide a probabilistic framework for analyzing autoregressive LLM decoding, reveal intrinsic probabilistic fingerprints of different language models, and establish a rigorous mathematical foundation for LLM-generated text detection and uncertainty quantification.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Machine Learning

• arXiv preprint · 12 October 2026

  Computational Reflective Equilibrium for Agentic AI: A Rawlsian Alignment Scaffold for Governance

  Quanyan Zhu
• arXiv preprint · 13 October 2026

  Foundation Models for Event Prediction Across Heterogeneous Event Logs

  Fabian Spaeh, Sean Jaffe, Shandian Zhe and 1 other
• arXiv preprint · 12 October 2026

  When Does Compensating Inherited Quantization Error Help? Mean-Square Guarantees for Layer-Wise Quantization and Their Limits

  Tianhao Guo
• arXiv preprint · 13 October 2026

  YUBI-Real2Sim: 3DGS Scene Verification for Reliable Policy Evaluation

  Hiroki Nishizawa, Takehiko Ohkawa, Nicola Scianca and 3 others
• arXiv preprint · 12 October 2026

  Of Errors and Echoes: Responsibility-Aware Credit Assignment for Tool-Use Agents

  Xingjian Diao, Tianyu Yang, Wenjun Huang and 8 others

All new papers in Machine Learning