RL-Guided PAC-NMPC for Probabilistically-Safe Perception-Based Navigation in Unknown Environments

Abstract

In this paper, we present an approach for combining stochastic nonlinear model predictive control (SNMPC) and reinforcement learning (RL) to enable probabilistically-safe perception-based navigation in unknown environments. Our method first uses RL to train probabilistic actor-critic and sensor prediction models. We then leverage these probabilistic models in a sampling-based SNMPC framework known as Probably Approximately Correct (PAC)-NMPC, which uses hard constraints to enforce finite-time statistical guarantees on the probability of collision and value function improvement. By ensuring that our finite-horizon SNMPC policies decrease the value function in expectation, we can approach the long-horizon performance of the RL approach while satisfying probabilistic safety constraints. Through simulation experiments, we show that our approach can improve the safety of perception-based RL navigation policies and scale to high dimensional systems with large sensor input spaces and complex nonlinear dynamics. We also demonstrate our approach through hardware experiments, showing improved performance for vision-based navigation with an agile fixed-wing aerial vehicle in unknown environments.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 30 September 2026

  Residual Wrench Certification and Margin-Aware Control Synthesis for Aerial Physical Interaction

  Abhimanyu Khadga, Abhinav Sinha and Shashi Ranjan Kumar
• arXiv preprint · 1 October 2026

  Are Frontier VLM Agents Ready to Be Robot Generalists? An Empirical Study with the Embodied Agent Arena

  Haojian Huang, Pukun Zhao, Zexi Li and 7 others
• arXiv preprint · 30 September 2026

  CEER2: Directional and Tunable End-Effector and Root Compliance for Humanoid Loco-Manipulation

  Xinyuan Luo, Chunyuan Yang, Boyuan Chen and 1 other
• arXiv preprint · 1 October 2026

  Lang3DSeg: Annotation-Free Open-Vocabulary 3D Segmentation with Point Transformers

  Cigdem Kokenoz, Amir Salarpour, Alkim Domeke and 5 others
• arXiv preprint · 30 September 2026

  Path-Following Control and Terramechanics Analysis for Planetary Rovers Under Wheel-to-Wheel Traction Asymmetry

  Ryuya Matsuoka, Keisuke Takehana, Kentaro Uno and 2 others

All new papers in Robotics