FootQuery: Future-Touchdown-Guided Retrieval from Depth History for Perceptive Humanoid Locomotion

Abstract

Humanoid locomotion over complex terrain requires anticipating footholds that may no longer be visible at touchdown. Limited camera coverage and self-occlusion make it necessary to retrieve relevant terrain information from earlier observations. We present FootQuery, a perceptive locomotion framework that queries depth history using each foot's predicted next touchdown. The policy predicts touchdown locations and uncertainty from proprioception and uses these distributions, together with per-foot features, to query sparsely sampled historical depth frames. During training, realized contacts are projected into historical images to supervise retrieval at the regions where those contacts were visible. The retrieved per-foot features are fused with global visual memory to generate control actions. A progressive force-assistance curriculum supports early exploration, while event-consistent tread-midline shaping encourages coordinated stair contacts. Deployment requires only proprioception and onboard depth images. In simulation, the complete framework outperforms its component ablations on the most challenging tested stairs, gaps, and platforms. Real-world experiments on a Unitree G1 demonstrate continuous traversal with a single policy across outdoor stairs and indoor routes combining stair ascent and descent, platforms, and gaps. These results support organizing visual history around anticipated contacts for perceptive humanoid locomotion.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 18 September 2026

  TierKV: Long-Context On-Device LLMs via Predictive Multi-Tier KV Caching

  Zhihao Shu, Md Musfiqur Rahman Sanim, Jie Hu and 4 others
• arXiv preprint · 19 September 2026

  Riemannian Density-Driven Optimal Control: Tangent-Space LQR for Second-Order Multi-Agent Systems on Curved Manifolds

  Kooktae Lee and Ruchika Singh
• arXiv preprint · 18 September 2026

  VLA-Scope: Shift-Aware Failure Prediction for Vision-Language-Action Models

  Kaiwen Zhu, Dongfang Liu and Liangkai Liu
• arXiv preprint · 19 September 2026

  Intelligent Degradation Monitoring in Lithium-ion Batteries via Discharge Incremental Capacity Feature Estimation

  Amir Madmolilvand and Farzaneh Abdollahi
• arXiv preprint · 19 September 2026

  Barrier Certificate Synthesis for Non-Polynomial Robotic Dynamics via Polynomial Lifting

  Shivam Chaubey, Francesco Verdoja, Shankar Deka and 1 other

All new papers in Robotics