LongZero: Enhancing Long-Context Reasoning in LLMs from Zero Data

Abstract

Reinforcement learning (RL) is an effective way to strengthen the long-context reasoning of large language models (LLMs), but it needs training data that are long, diverse, challenging, and verifiable. Human annotation of such data is expensive, naturally occurring data are too scarce to sustain RL, and existing synthesis methods depend on external corpora or stronger teacher models, which become harder to obtain as the trained models get stronger. Recently, RL from zero data, in which a model learns from tasks it proposes itself, has achieved excellent performance, but existing methods target short-context tasks. Therefore, we propose $\textbf{LongZero}$, a method that lets an LLM improve its own long-context reasoning without any external data. Instead of writing questions and answers over existing documents, LongZero first has the model synthesize the question and answer with its supporting evidence in a compact structured form, and only then separately expands the evidence into a long multi-document context. LongZero combines these self-written multi-hop reasoning tasks with self-written multi-round retrieval tasks and trains the model with GRPO. We evaluate LongZero on two LLMs across five long-context reasoning benchmarks and compare it with RL on data synthesized from external corpora. Experimental results show that LongZero can generalize to real tasks, and outperforms both baselines, suggesting a viable and promising path to improving long-context reasoning of LLMs.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Computation & Language / NLP

• arXiv preprint · 21 October 2026

  VeriEvolve: Evaluator-First Evolution for Tool-Using Agents

  Yueshen Li, Kamer Ali Yuksel, Gokhan Tur and 2 others
• arXiv preprint · 22 October 2026

  Governed Self-Evolution for Autonomous Investing: A Multi-Agent LLM System with an Invariant Core

  Yebo Feng, Jingyang Dai, Liangrui Pan and 3 others
• arXiv preprint · 21 October 2026

  Target Regeneration Shrinks the Gains of Draft-Training Objectives in Speculative Decoding

  Jungseob Lee, Hogun Seong, Euijun Choi and 1 other
• arXiv preprint · 22 October 2026

  TT-SAX: A Two-Track Time Series Symbolization for Natural Language Shape Querying

  Zhao Tan, Xianglong Bao, Zhipeng Xi and 1 other
• arXiv preprint · 21 October 2026

  Our Own Jev: Typed Decisions in One Forward Pass, from an In-House Judge to Open LoRA Models

  Yuchuan Weng, Chi Liu, Xin Chen and 1 other

All new papers in Computation & Language / NLP