Recovering Low-Bit Failures in Vision-Language-Action Policies via Quantization-Conditioned Reinforcement Learning

Abstract

Quantization lowers deployment costs of vision-language-action (VLA) policies but can compromise task completion. Across five VLA models and 4,050 real-world trials, we systematically reveal that quantization-aware training (QAT) generally improves on post-training quantization (PTQ) but leaves substantial gaps to full precision (FP) on long-horizon tasks and under visual and semantic shifts, while its imitation-based objective does not explicitly use rollout success or partial completion. To exploit these outcome signals, we introduce Quantization-Conditioned Reinforcement Learning (QCRL), an offline RL method coupling progress-based advantage estimation with quantization-aware source conditioning. FP rollouts supply reference experience beyond action-level distillation, progress-scaled terminal penalty distinguishes partial completion, and quantization-aware conditioning selects advantageous reference behavior within the quantized policy. We evaluate weight-only INT4 W4A16 on $π_{0.5}$ and GR00T N1.5 and joint weight-activation NVFP4 W4A4 on $π_{0.5}$. Using only in-distribution data, QCRL reaches 99.3% of FP's mean score across three visual-shift conditions for $π_{0.5}$ with INT4 W4A16, alongside 42.9% model-memory savings. With NVFP4 W4A4, it reaches 100.7% of the same FP baseline, alongside a $1.73\times$ speedup using NVFP4/FP8 deployment. Hardware gains are relative to FP16 on Jetson Thor.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 11 October 2026

  Reinforcement Learning Based Heterogeneous Task Allocation Under Spatio-Temporal Environmental Uncertainty for Multi-Robot Teams

  Xi Lin, Yaxuan Li, Paul Szenher and 1 other
• arXiv preprint · 12 October 2026

  PathLift: Depth-Conditioned Metric Lifting for Visual-Navigation Priors

  Gwanjun Shin, Hyeongseok Suh, Hongmo Jung and 1 other
• arXiv preprint · 11 October 2026

  LeHami: Symplectic Latent Dynamics for World Models

  Romina Yalovetzky, Randall Balestriero and Yann LeCun
• arXiv preprint · 12 October 2026

  Constrained Differentiable Policy Learning for Safe Quadrotor Navigation

  Yan Rui Tan, Praveen Krishnapur, Zeyu Feng and 3 others
• arXiv preprint · 11 October 2026

  Embodiment-Aware Inference-Time Search for Human Reaction Selection in Humanoid Retargeting

  Yongpeng Cao, Masahiro Hirano and Yuji Yamakawa

All new papers in Robotics