PhysiCalWorld: In-Context Physics Calibration for World Models

Abstract

Existing world models typically perceive a scene through current visual frame or a narrow history window. However, these observations may not reveal the physics properties that determine transition dynamics, such as an object's mass distribution, joint damping, or surface friction. Without calibrating these physics factors for world models, predictions tend to regress toward an empirical prior and induce severe drift in novel test scenes. To this end, we propose PhysiCalWorld, which calibrates action-conditioned world models to the instance-specific dynamics via in-context prompting, without fine-tuning or analytical physics modeling. Our method encodes an exploratory interaction clip collected within the test scene into a compact physics descriptor token, which grounds subsequent predictions in the scene's actual physical behavior. PhysiCalWorld is trained end-to-end with the latent prediction loss alone, without physics labels. At inference time, the descriptor token is extracted once and can be reused across rollouts with negligible compute overhead. We evaluate PhysiCalWorld across four environments covering diverse physics variations and show that it substantially improves rollout prediction accuracy and visual planning success rate. The learned descriptors also form a physically structured latent space and generalize beyond the physics ranges seen during training.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 21 October 2026

  PHD-Hand: A Printable Humanoid Dexterous Hand with Linkage-Driven 3-DOA Digits

  Neel Adwani, Muhaiminul Islam Akash, Saffia Ouali and 2 others
• arXiv preprint · 22 October 2026

  Know When to Escalate: Critic-Guided Adaptive Execution for Cloud-Local Embodied Agents

  Wei Zhang, Lirong Xiang and Charles Fleming
• arXiv preprint · 21 October 2026

  Causal world models under physical parameter shifts

  Chu Lin and Yi Sun
• arXiv preprint · 22 October 2026

  OASIS: Online Anchor-centric Scene Inference System for Open-Vocabulary Retrieval and Navigation in Dynamic Environments

  Kaiyao Liao, Qingfeng Li, Chen Chen and 3 others
• arXiv preprint · 21 October 2026

  Learning to Absorb Corrections: Critic-Weighted Residual Flow for Vision-Based Insertion

  Yiqing Yuan, Zhi Li, Jinrong Yang and 5 others

All new papers in Robotics