Weighted Ensemble Sampling for Rare-Event Estimation in Language Models

Abstract

Rare but severe failures of large language models can become practically significant at deployment scale. Estimating their probabilities with direct Monte Carlo sampling is highly inefficient, while proposal-based methods typically require auxiliary learning of an additional proposal distribution. We introduce \textbf{Weighted Ensemble (WE)}, a training-free framework for rare-event estimation in language models. WE samples exclusively from the original language model and improves upon direct Monte Carlo by periodically reallocating the sampling budget toward prefixes that appear more likely to reach the target rare event. To guide this reallocation without learning a separate proposal distribution, we exploit internal LLM representations as prefix-level signals and empirically validate their effectiveness. We provide a theoretical analysis of the proposed algorithm. Experiments on safety-related tasks spanning both small-scale and modern large-scale LLMs demonstrate that WE improves the efficiency and reliability of rare-event probability estimation.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Computation & Language / NLP

• arXiv preprint · 13 October 2026

  Everyone Was Right: Lexical Representations in Language Models Are Both Abstract and Holistic

  Zachary Nicholas Houghton, Yu Zhou, Dan Pluth and 2 others
• arXiv preprint · 14 October 2026

  TopicMerge: A Divide and Conquer Approach to Topic Modeling

  Matthew Raffel, Lizhong Chen, Sai Munikoti and 1 other
• arXiv preprint · 13 October 2026

  Many Steps into One: Reasoning Contraction and the Limits of Safe Memory Reuse for LLM Agents

  Jianghong Zhou, Hao Rong, Chen Lin and 1 other
• arXiv preprint · 14 October 2026

  LLM-jp-4 Technical Report

  LLM-jp, :, Chaoran Liu and 16 others
• arXiv preprint · 13 October 2026

  Reference Wording Shapes Retrieval of Robot Task Instructions

  Jahnavi Yelamanchi

All new papers in Computation & Language / NLP