arXiv preprint ·
Measured Coupling for Parallel Decoding in Diffusion Language Models
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Diffusion language models can write many tokens per step, but must choose which tokens are safe to commit together. Mean-field decoding penalizes pairs of positions whose predictions look alike. We replace this proxy with the coupling itself: how much committing one token changes the model's confidence at another. Cheap probes inside the main forward pass measure it, with no training or extra model, and it plugs into the same mean-field rule. On three models and four benchmarks, our method needs far fewer steps than mean-field decoding and is faster in most settings, also with a key-value cache, at an average accuracy cost of 1.1 points. Shuffling the couplings or replacing them with a uniform bonus loses this gain.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Computation & Language / NLP
KOSMOS: Self-scheduling Persistent Kernels for Communication-Compute Overlap
When Is One Query per Template Enough? Adapting Learned Cost Models to New Hardware
A Controlled Experimental Evaluation of Configuration and Cache Architecture in LLM Serving Engines
SysPilot: Cross-Library Performance Autotuning via Library Performance Contracts
Accelerating Long-Context Decoding in Large-Scale Hybrid LLMs Without Retraining
Get the few papers worth your time in Computation & Language / NLP every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.