Collision Snapshot Guided Time-Reversed Safety-Critical Scenario Generation

Abstract

The generation of safety-critical traffic scenarios is essential for training and evaluating autonomous vehicles. Prior approaches typically perturb the trajectories of existing agents in a traffic scenario using simplified adversarial objectives to induce safety-critical interactions, which can limit the plausibility and diversity of the generated scenarios. Although inserting new adversarial vehicles can alleviate this limitation, determining when and where to introduce them in a scenario-specific manner remains challenging. In this work, we introduce \underline{CO}llision \underline{S}napshot guided \underline{T}im\underline{E}-\underline{R}eversed safety-critical scenario generation (COSTER), a framework that leverages learned traffic priors to determine plausible collision times and locations. COSTER first constructs a collision snapshot by inserting a new vehicle in contact with the target vehicle at the identified collision state within a traffic scenario. Starting from this collision snapshot, a conditional variational autoencoder is used to perform a time-reversed rollout, reconstructing the trajectory of the inserted vehicle backward toward earlier timesteps. Experiments show that COSTER outperforms existing methods in plausibility, diversity, and data efficiency. Moreover, agents trained on COSTER-generated scenarios reduce collision rates by 31\% on safety-critical scenarios from the Waymo Open Motion Dataset while also improving ego task completion. The project website is available at https://anonym-121.github.io/COSTER/.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 7 September 2026

  Contextual Observer Grounding: Evaluating Situated Spatial Reasoning in Vision-Language Models

  Mimo Shirasaka, Haochen Zhang and Yonatan Bisk
• arXiv preprint · 6 September 2026

  MemCorr-DP: Counterfactual Correspondence Conditioning for a Diffusion Policy Guided by a Reference

  Tan Su, Haoxiang Yang, Ruxin Wang and 1 other
• arXiv preprint · 7 September 2026

  Noisy-Space Policy Gradient for Diffusion Policies in Offline Reinforcement Learning

  Mahmoud Selim, Cristina Cipriani and Karl H. Johansson
• arXiv preprint · 6 September 2026

  CAVEAT: Recurrent Multimodal Diffusion Planning for Mapless Aerial Exploration

  Steven Visch, Nicolò Botteghi, Antonio Franchi and 1 other
• arXiv preprint · 7 September 2026

  Distributed Dexterous Manipulation with Spatially Conditioned Multi-Agent Transformers

  Sarvesh Patil

All new papers in Robotics