Fork-dLLM: Avoiding the Flexibility Trap in Diffusion Language Models

Abstract

Masked diffusion language models (dLLMs) have shown strong potential for faster inference through parallel token generation when combined with confidence-based samplers. However, recent work has shown that such methods can defer unmasking high-entropy fork positions at which multiple plausible continuations exist. This results in reduced generation diversity, as shown by worse pass@k scaling, and limits gains obtainable from RL post-training. To avoid this flexibility trap, prior work advocated for autoregressive (AR) sampling. Here, we show that discarding confidence-based sampling is unnecessary and, once inference cost is taken into account, wasteful. We first propose Fork-dLLM, a simple hybrid sampler that uses AR-style ordering only at uncertain fallback steps while retaining parallel generation otherwise. We then extend the same principle to post-training with ForkGRPO, which uses Fork-dLLM rollouts and applies the GRPO objective only at fallback steps, preserving exact policy-likelihood ratios while substantially reducing rollout and optimization cost. In our experiments, Fork-dLLM matches the strong pass@k scaling of AR sampling while being 2-3x more efficient, and ForkGRPO achieves downstream performance comparable to or better than AR-based GRPO baselines at a substantially lower training cost.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Machine Learning

• arXiv preprint · 30 September 2026

  ReGain: Restoring Subject Fidelity in Personalization on Synthetic Images

  Shubhang Bhatnagar, Ishan Bhatnagar, Viraj Shah and 1 other
• arXiv preprint · 1 October 2026

  SmoothOperator: Enhancing Representations for Fine-grained Open-set Recognition via Modulated Label Smoothing

  Thiru Thillai Nadarasar Bahavan, Yu Xia, Sachith Seneviratne and 1 other
• arXiv preprint · 30 September 2026

  Code to Control: Synthesizing Parameterized Reactive Controllers

  Zergham Ahmed, Joshua B. Tenenbaum, Chris Bates and 1 other
• arXiv preprint · 1 October 2026

  Fixing a Model That Learned Worse Cancer Means Lower Risk: Monotonic Constraints in Bladder Cancer Recurrence Prediction

  Saram Abbas, David Thomas, Naeem Soomro and 3 others
• arXiv preprint · 30 September 2026

  Molecular Property Prediction under Structural Shift with Tabular Foundation Models

  Jinmo Lee, Dooho Lee, Minho Jeong and 1 other

All new papers in Machine Learning