arXiv preprint ·
Estimating Great Expectations Under Autoregressive Language Models with Potentials
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Many applications of language models hinge not on individual samples but on the expectation of a test functional under the model. Estimating such expectations reliably can be computationally expensive. In this paper, we show how to make estimation more efficient by exploiting the next-token conditional probabilities which are available as a by-product of sampling. We do so through potentials: real-valued functions on prefixes that decompose the test functional additively. We construct an estimator whose variance depends on the chosen potential, and derive conditions under which a potential reduces this variance. We then develop practical potentials for several estimands and applications, and demonstrate substantial variance reductions across several estimands at comparable computational cost.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Artificial Intelligence
Regularized Small Area Estimation with Graph Laplacian Benchmarking priors
Two-way Guidance: Simultaneous Learning of Summary Statistics for Generative Bayes
How to post-train on a surrogate: Envelope sampling mitigates reward hacking
From Imbalance to Evidence: Deep Nonparametric Testing for Complex Data under Severe Sample Imbalance
Open-ended Scientific Discovery with Possibilistic Reasoning
Get the few papers worth your time in Artificial Intelligence every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.