How Representational Priors Shape Generalization in World Action Models

Abstract

World action models (WAMs) are shown to substantially diverge under generalization performance based on their generative backbones. We investigate this gap through the representational geometry that WAMs inherit from their backbones and how policy training reorganizes it. Our central hypothesis is that a useful representational prior would structure geometry that separates nuisance information from the in-distribution manifold in advance of training as a policy. We quantify this with nuisance orthogonality; orthogonality of the feature under visual variation outside the empirical in-distribution manifold. Across various image and video backbones, we show that a higher orthogonality from the representational prior is associated with stronger robustness to visual variations after WAM training, enabling policy generalization measurable prospectively for world models. In addition, analyzing the resulting robust WAMs reveals nuisance suppression; relative suppression of feature displacement caused by such variations and robust action generation of the policy. Together, these findings provide a geometric perspective on how the representational prior of the world model shapes the generalization performance of WAMs.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 21 October 2026

  PHD-Hand: A Printable Humanoid Dexterous Hand with Linkage-Driven 3-DOA Digits

  Neel Adwani, Muhaiminul Islam Akash, Saffia Ouali and 2 others
• arXiv preprint · 22 October 2026

  Know When to Escalate: Critic-Guided Adaptive Execution for Cloud-Local Embodied Agents

  Wei Zhang, Lirong Xiang and Charles Fleming
• arXiv preprint · 21 October 2026

  Causal world models under physical parameter shifts

  Chu Lin and Yi Sun
• arXiv preprint · 22 October 2026

  OASIS: Online Anchor-centric Scene Inference System for Open-Vocabulary Retrieval and Navigation in Dynamic Environments

  Kaiyao Liao, Qingfeng Li, Chen Chen and 3 others
• arXiv preprint · 21 October 2026

  Learning to Absorb Corrections: Critic-Weighted Residual Flow for Vision-Based Insertion

  Yiqing Yuan, Zhi Li, Jinrong Yang and 5 others

All new papers in Robotics