Training-Free Character-Length Control in Summarization with Diffusion Language Models

Abstract

Summarization with a fixed character length is important for tasks such as headline and article preview generation, where text must fit an exact space. Autoregressive language models (LMs) struggle with precise character-length control: training-based methods require task-specific fine-tuning, while zero-shot prompting strategies achieve only approximate compliance. We propose DELTA (Diffusion Expected Length Targeting Algorithm), a training-free inference-time method for masked diffusion LMs that estimates expected character length at each denoising step and dynamically inserts or removes masked positions to steer toward a target length. DELTA requires no fine-tuning and is designed for off-the-shelf masked diffusion LMs. Across three summarization benchmarks, it reduces character-length errors by an order of magnitude compared to baselines while maintaining competitive summary quality in both automatic and human evaluation.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Computation & Language / NLP

• arXiv preprint · 4 November 2026

  How Well Can Large Language Models Impersonate Individual Authors? A Comparative Evaluation

  Harshit Gupta and Shunichi Ishihara
• arXiv preprint · 5 November 2026

  HyFlash: A Prefix-Memory Prior for On-Device Speculative Decoding

  Jongwoo Ko and Pashmina Cameron
• arXiv preprint · 4 November 2026

  Phonological Knowledge of Chinese Characters in Language Models

  Xiaozhe Ji, Renfen Hu and Hai Hu
• arXiv preprint · 5 November 2026

  Encoding and Propagation of Grammatical Number in Large Language Models

  Jacob Solinsky and Serguei Pakhomov
• arXiv preprint · 4 November 2026

  Matching the Training-Time Weight Rule in Inference-Time Expert Deactivation

  Hao Cheng, Zhiyu Yang, Bo Ma and 1 other

All new papers in Computation & Language / NLP