GRAFT: Geometry-Aware Residual Adaptation for Foundation Trackers

Abstract

Humanoid behavior foundation models (BFMs) provide reusable whole-body motion priors: given a kinematic reference, they generate coordinated joint commands for motion replay, teleoperation, and VLA control. However, trained primarily on flat-ground motion, BFMs lack an explicit mechanism to adapt foot placement, swing clearance, and contact timing to local terrain. Many terrain-aware BFM approaches address this limitation by retraining or fine-tuning the tracker together with perception, incurring substantial data and computation costs while coupling ordinary tracking to the perception pathway. To bridge this gap, we propose GRAFT, a geometry-aware residual adaptation framework for frozen behavior trackers. GRAFT preserves the BFM parameters and motion-reference interface, while a lightweight adapter adds terrain-conditioned corrections only to lower-body execution targets. The adapter is trained with task and foot-geometry rewards, regularized to suppress unnecessary corrections on flat ground, and distilled from privileged terrain observations to onboard depth. Because the frozen BFM already provides whole-body reference tracking and nominal locomotion, GRAFT reduces terrain learning to a focused execution-adaptation problem. We instantiate the framework on four frozen trackers and evaluate stairs, gaps, and platforms in simulation. We further validate it through real-world deployment on a Unitree G1, where the adapted SONIC tracker traverses terrain with onboard depth and unmodified references.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 27 October 2026

  A Singularity Avoiding Track Model for Race Car Optimization

  Adwait Verulkar, Behzad Danaei, Srikanth Sivaramakrishnan and 1 other
• arXiv preprint · 28 October 2026

  Same Label, Different Interface: Beyond Action-Space Labels in Robot Learning

  Arshia Sangwan and Zhongyang Zhang
• arXiv preprint · 27 October 2026

  Ground Sample Distance Constrained k-Coverage Viewpoint Planning via Set Multi-Cover Formulation

  Waleed Bin Khalid and Chul Min Yeum
• arXiv preprint · 28 October 2026

  Minimum-Time Escape from the Conic Field of View of a Reeds--Shepp Pursuer: the Faster Evader

  Ubaldo Ruiz
• arXiv preprint · 27 October 2026

  Whole-Body Humanoid Control via Stochastic Motion Tokenization

  Michael Drolet, Oleg Arenz and Jan Peters

All new papers in Robotics