FastOPD: On-Policy Distillation for Lightweight VLA Deployment

Abstract

Vision-Language-Action (VLA) foundation models have scaled rapidly to enhance manipulation performance and generalizability, but this scaling incurs high computational costs that render real-world deployment increasingly challenging. Existing approaches typically mitigate this issue by designing smaller architectures or reducing the iterative denoising steps in flow-based policies. In this work, we propose FastOPD, a foundation-to-lightweight VLA framework that enables the practical deployment of large-scale VLAs through efficient on-policy distillation. Specifically, FastOPD adapts a flow map for single-state teacher supervision and combines it with a self-consistency objective to construct a compact student that learns the teacher dynamics. Furthermore, we theoretically demonstrate that minimizing this objective allows the distilled student to recover a distribution on par with that induced by an ideal few-step teacher model. We evaluate FastOPD across diverse foundation policies in simulation and real-world experiments. On LIBERO, FastOPD retains 84% of the performance of $π_{0.5}$ with only two inference steps, reducing inference latency by 78.1% while outperforming existing few-step distillation baselines in average success rate. With LingBot-VLA as the teacher, FastOPD improves the single-step success rate over the base student by 15.9 percentage points on RoboTwin 2.0. We further demonstrate its applicability to a World Action Model (WAM) and deploy a compact student distilled from MolmoAct2 on a real robot.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 2 October 2026

  Mind the Refinement Gap: When Safe High-Level Robot Plans Produce Unsafe Executions

  Stabak Das, Priyesh Ranjan, Xiangfang Li and 1 other
• arXiv preprint · 3 October 2026

  Autoware in Construction: Gap Analysis and LiDAR Perception Toward Off-Road Autonomous Driving

  Yu Otsuki, Teja Emmey, Sena Matsushita and 2 others
• arXiv preprint · 2 October 2026

  A Passive AI System for Verifying Physical State on Automated Liquid Handlers

  Junqiong Joanne Qiu, Zeckria Kamrany, Ananya Anand and 7 others
• arXiv preprint · 3 October 2026

  CurveCodec 2: Skeleton-agnostic animation compression with a learned entropy model

  Mingyi Shi, Huancheng Lin, Xuelin Chen and 1 other
• arXiv preprint · 2 October 2026

  DeltaWorld: Physically Consistent Interactive World Simulators via Action-Conditioned Latent Increment Learning

  Boyuan Hou, Xiaoge Cao, Chaofan Zhang and 2 others

All new papers in Robotics