VAMPS: Visual and Motor Policies from Sampling-Based Planning

Abstract

Learning robot policies directly on physical systems remains difficult because data collection is costly and policy exploration can be unsafe. We introduce Visual and Motor Policies from Sampling-Based Planning (VAMPS), a framework that uses Model Predictive Path Integral (MPPI) control to train reusable policies without human demonstrations. VAMPS supports two training modes. For one-step proprioceptive policies, it operates iteratively in simulation: the policy warm-starts MPPI, and the refined trajectories provide new supervision as the policy changes. A learned terminal value improves short-horizon planning, while an Implicit Q-Learning (IQL) critic guides the policy update. Iterative refinement outperforms training once on frozen MPPI data, and we transfer the learned locomotion policy to a Unitree Go2. For visuomotor policies, VAMPS operates directly from real-robot data. MPPI uses task-specific state estimates to plan and execute trajectories while recording RGB and sensor observations on a Flexiv Rizon 10S. Action Chunking with Transformers predicts action chunks, reducing the effective prediction horizon, and is trained offline on this fixed dataset. We demonstrate visuomotor pick-and-place and force-aware whiteboard erasing. In the latter task, the policy additionally observes the measured $6$-D wrench and desired normal force. These results show that VAMPS can learn policies either in simulation followed by hardware transfer or directly from autonomously collected real-robot data.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 4 October 2026

  Tackling Sim-to-Real Mismatch Through Sampling-Based Disturbance Observers: From Analytical Models to Learned World Models

  Tianqi Zhu, Jun Yang, Jianliang Mao and 2 others
• arXiv preprint · 5 October 2026

  FOCUS: Fine-Grained Open-Vocabulary Change Detection for Uncertainty-Aware Semi-Static Scenes

  Can Xu, Mingfeng Yuan, Mahan Mohammadi and 1 other
• arXiv preprint · 4 October 2026

  GJK-CBF: Control Barrier Functions for Convex Rigid Body Collision Avoidance on SE(3)

  Yi-Hsuan Chen, Shuo Liu, Wei Xiao and 2 others
• arXiv preprint · 5 October 2026

  Spacecraft Rendezvous Trajectory Generation with Modular Constraints via Diffusion Model Composition

  Mariko A. Storey-Matsutani and Richard Linares
• arXiv preprint · 4 October 2026

  $R^2$-WAM: Repair-and-Reject Post-Training for World Action Models

  Ruiyan Xu, Haisheng Su, Sixu Lin and 4 others

All new papers in Robotics