PlanContext: Benchmarking In-Context Driving Decision-Making

Abstract

Real-world driving requires context-aware decision-making. Existing end-to-end driving benchmarks primarily assess trajectory quality through safety, compliance, comfort, and driving progress, leaving context-dependent decision-making insufficiently characterized. To fill this gap, we present PlanContext, a benchmark for evaluating in-context driving decision-making. PlanContext constructs paired evaluations by varying high-level driving intentions while keeping the observed scene fixed, enabling a natural and controllable assessment of context-dependent decision-making. We further define six representative driving contexts and jointly evaluate contextual decision correctness, road compliance, and dynamic safety with class-balanced metrics. Experiments on 9,561 scene-condition instances from NAVSIM and 23 public end-to-end driving models show that high conventional driving-quality scores do not consistently correspond to strong route-level in-context driving decision-making. Further analysis shows that model behavior varies with decision timing, road structure, and traffic interaction depending on the decision required by the current context. Our results highlight in-context driving decision-making as an important complementary dimension for evaluating end-to-end driving systems.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 2 November 2026

  Late Autumn: LLM Agents Specialize a General Multi-Robot Planner for One Warehouse

  Yimin Tang, Han Zhang, Shao-Hung Chan and 3 others
• arXiv preprint · 3 November 2026

  VARP: A Visual Adaptive Rearrangement Planner for Non-Monotone Object Rearrangement Planning

  Hanwen Ren, Meng Zheng, Zhongpai Gao and 4 others
• arXiv preprint · 2 November 2026

  Learning Purposeful Co-designs of Bio-inspired Quadrupedal Robots

  Fabio Boekel, Jiatao Ding and Cosimo Della Santina
• arXiv preprint · 3 November 2026

  Online Hamilton-Jacobi Reachability Onboard the Robot Control Loop: A Real-Time GPU Solver for Safety-Critical Autonomy

  Kevin Weekly and Alexandre M. Bayen
• arXiv preprint · 2 November 2026

  To Coordinate or Not to Coordinate? Learning to Swim with Eight Soft Arms

  Junkai Chen, Dehan Yuan, Yiyuan Zhang and 4 others

All new papers in Robotics