Why Koopman Structure Does Not Help Differentiable World Models for Humanoid Whole-Body Tracking

Abstract

We test whether Koopman structure, linear dynamics in a lifted state space, helps when a humanoid whole-body tracking policy is trained by backpropagating through a differentiable world model, replacing the MLP world model of an otherwise unchanged pipeline for simulated Unitree G1 tracking. It does not: return is at best equal (0.823 versus 0.830), one-step error on identical data is 1.3 to 1.6 times the MLP's, and training is about 15% slower. Lifted rollouts diverge or fail to train a policy; of the schemes tested, re-lifting at every imagined step trains best. Re-lifting never uses the lifted linear dynamics and leaves a model affine in the action, with state-dependent offset and slope; an action-affine MLP also predicts worse, so the cost belongs to this class. At a fixed state, the curvature of the true dynamics in the action explains only part of it. Across states, the policy's actions span a curved region, so an affine model fits policy data only as the tangent at the policy's action, the operating point: on G1, the MLP's tangent there is as accurate as the MLP; at the mean action, 31 times worse. The offset must encode, from the state alone, where the policy acts, whereas an MLP reads the action. Supplying the policy's action removes most of the remaining gap on G1, Ant and Humanoid. The only online repair approaching the MLP feeds the action into the nonlinear lift, giving up the structure. The MLP world model thus remains the better choice here.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 31 October 2026

  A Straight Line Is Not a Camera Pose: Auditing Short-Clip Pose Benchmarks

  Xinyi Shi
• arXiv preprint · 1 November 2026

  Same Path, Less Time: Training-Free Fast Execution of Vision-Language-Action Models under Inference Latency

  Fuyi Chen
• arXiv preprint · 31 October 2026

  Knowing Where to Look: Interactive Object Search via Spatial-Semantic Fusion

  Aditya Agarwal, Lucy Cai, Kelly Lu and 4 others
• arXiv preprint · 1 November 2026

  Serving Agentic Robot Fleets: Workload Characterization, KV-Cache Thrashing, and Admission Control

  Sida He
• arXiv preprint · 31 October 2026

  MESSPa: A Multi-modal Embodiment Stimulation Shoulder Pad for Preserving the Sense of Agency in a Detachable Robotic Arm

  Vitvasin Vimolmongkolporn, Guillaume Gourmelen, Yukiko Iwasaki and 1 other

All new papers in Robotics