SLA: Scaling Spatial-Language-Action Model via Continual Pre-training

Abstract

Reliable robotic manipulation requires both semantic understanding and precise control in three-dimensional space. However, vision-language-action (VLA) foundations largely inherit visual representations from 2D vision-language pre-training, while spatial supervision is often introduced only during task-specific adaptation. Developing spatial understanding as a transferable foundation-model capability therefore calls for learning from broader robot experience. We present SLA, a Spatial-Language-Action Model that scales implicit spatial alignment to continual pre-training and maintains it during downstream post-training. Initialized from a pretrained pi05 policy, SLA jointly optimizes action prediction and alignment between intermediate visual embeddings and spatial representations from a frozen 3D perception model. We curate and unify heterogeneous robot datasets to support spatial learning across diverse embodiments, tasks, and scenes. To accommodate this diversity, we introduce feature-dependent gates that adaptively aggregate visual embeddings from multiple VLA layers for spatial supervision. The teacher further exploits partially available depth and camera calibration alongside RGB observations, enabling effective use of heterogeneous geometric annotations. Probabilistic state dropout encourages reliance on visual cues and mitigates overfitting to demonstration trajectories. All auxiliary components are used only during training, allowing direct reuse of pretrained VLA weights and preserving the original inference architecture.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 5 November 2026

  An Empirical Study of Reinforcement Learning for Keypoint Positioning of Deformable Linear Objects

  Vinay Rodrigues, Sara Zeynalpour, Gokhan Solak and 2 others
• arXiv preprint · 5 November 2026

  CRISP: Constraint-Resolved Interactions between Subsystems for Predictive Whole-Body Cooperation

  Dario Valenzuela and Jeeseop Kim
• arXiv preprint · 5 November 2026

  VREgo: Consumer VR Headsets for Learning Robot Manipulation from Egocentric Demonstrations

  Liuchuan Yu
• arXiv preprint · 5 November 2026

  Efficient Diffusion Policy Fine Tuning with Latent Noise Representation Bridging

  Yuanchu Liang, Yue Yang, An-Chi He and 1 other
• arXiv preprint · 5 November 2026

  An Ordering Optimization for Fruit-Vegetable in High-Density Environment based on Genetic Algorithm

  Jaehwi Seol, Jeonghyeon Pak and Hyoung Il Son

All new papers in Robotics