VLA-HWBench: Where the Time Goes When VLA Models Run on Edge Hardware

Abstract

Vision-language-action (VLA) models increasingly run on edge devices aboard robots, where inference latency constrains closed-loop robot control. However, it remains unclear how to design VLA models, their inference software and edge hardware so that robots can run VLA inference in real time. Most VLA models report only task success, while prior studies cover limited action-generation strategies, divide inference into at most three stages, and lack comparisons of inference optimizations on the same models. Therefore, we introduce VLA-HWBench, a benchmark that measures 18 open VLA models on NVIDIA Jetson AGX Thor and AMD Ryzen AI Max+ PRO 395, with a seven-stage inference breakdown. Our study reveals three insights. First, action-generation strategy matters more than model size. It dominates 14 of 19 Jetson configurations, latency varies by $82\times$ on Jetson and $157\times$ on AMD, and parameter count explains at most 15% of latency variance. Models that generate long action chunks in a few flow-matching steps keep up with control, whereas token-by-token decoding does not. Second, kernel fusion with 4-bit weights helps most, running $π_{0.5}$ and GR00T N1.7 2.6-2.9$\times$ faster than PyTorch with torch.compile, but it exists for only these two models and only on the Jetson. Optimization also moves the time to the stages it shortens least, as CPU preprocessing grows from 12% to 39% of the GR00T N1.7 call. Third, after optimization, memory bandwidth limits only the stages that process few tokens on the Jetson, such as the denoising steps, whereas software limits all other stages, from unfused kernels to serial preprocessing on the host CPU. Overall, low-latency edge VLAs should use few action-generation iterations, inference software should extend kernel fusion and low-bit weights to more models and platforms, and edge hardware needs high memory bandwidth and a fast host CPU.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 26 October 2026

  RobotAgentBench: Towards Open-world Robot Autonomy

  Lingjun Mao, Jinglin Cao, Lukun He and 22 others
• arXiv preprint · 27 October 2026

  A Singularity Avoiding Track Model for Race Car Optimization

  Adwait Verulkar, Behzad Danaei, Srikanth Sivaramakrishnan and 1 other
• arXiv preprint · 26 October 2026

  Dream to Assist: Intent-Conditioned World Models for Shared Vehicle Control

  Jonathan DeCastro, Thomas Balch, Emily Sumner and 9 others
• arXiv preprint · 27 October 2026

  Ground Sample Distance Constrained k-Coverage Viewpoint Planning via Set Multi-Cover Formulation

  Waleed Bin Khalid and Chul Min Yeum
• arXiv preprint · 26 October 2026

  Video World Models Need Predictable Latents

  Mattia Scardecchia and Sherry Yang

All new papers in Robotics