Trajectory Evaluation via Rollout-Free World Model for End-to-end Autonomous Driving

Abstract

Although existing candidate trajectory evaluators have substantially improved end-to-end planning accuracy, their underlying mechanism remains suboptimal. Model-based evaluators typically make scoring future-aware by explicitly predicting candidate-conditioned future states over the planning horizon, which we term rollout. However, rollout incurs high inference cost and accumulates prediction errors. We argue that planning does not require reconstructing a full future scene for each candidate, but only future-relevant information for reliable comparison. We therefore propose RFWorld, a Rollout-Free World model for end-to-end trajectory evaluation. RFWorld constructs a shared scene memory and shapes it into a future-readable representation via lightweight training-time temporal readout with semantic supervision, keeping training overhead low. At inference time, candidate trajectories directly query the shared memory via sparse spatial readout for scoring, reducing computation by roughly the planning horizon times the number of candidate trajectories, while avoiding recursive rollout errors. Experiments on NAVSIM and Bench2Drive show that RFWorld learns a more planning-aligned world representation and achieves state-of-the-art performance.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 3 November 2026

  VARP: A Visual Adaptive Rearrangement Planner for Non-Monotone Object Rearrangement Planning

  Hanwen Ren, Meng Zheng, Zhongpai Gao and 4 others
• arXiv preprint · 4 November 2026

  Closed-Loop Adaptive Sampling on a Generative Ocean Model

  Shayesteh Hafezi and Alan Papalia
• arXiv preprint · 3 November 2026

  Online Hamilton-Jacobi Reachability Onboard the Robot Control Loop: A Real-Time GPU Solver for Safety-Critical Autonomy

  Kevin Weekly and Alexandre M. Bayen
• arXiv preprint · 4 November 2026

  ZipDrift: Generating Multimodal Short-Horizon MPC Costs with One-Step Drifting Models

  Ke Zhang
• arXiv preprint · 3 November 2026

  Say the Same, Act Differently: Diagnosing and Steering Text-Action Divergence in Reasoning VLAs

  Zihao Feng, Qingzhao Zhang, Chunyu Xia and 3 others

All new papers in Robotics