Remember Where You Walk: Learning Spatial Memory for End-to-End Legged Robot Exploration

Abstract

Humanoids and other legged robots operating in complex environments must remember information that leaves their field of view and only becomes relevant much later. Reinforcement learning policies address this using memory networks such as LSTMs that are trained end-to-end with the policy to memorize such task-relevant aspects. Yet, such architectures often fail to preserve sufficient information over long horizons. In this work, we propose a network architecture based on Hadamard memory that specifically targets robot navigation. Our Local Spatial Matrix Memory (LSMM) enables RL agents to store generic task-relevant information at specific, position-based memory cells, enabling flexible and spatially grounded memorization. We evaluate LSMM on the task of autonomous maze exploration, where it matches the maze coverage of strong recurrent and finite-history baselines while being the only architecture that remembers the maze layout, reducing the reconstruction error threefold.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 27 October 2026

  A Singularity Avoiding Track Model for Race Car Optimization

  Adwait Verulkar, Behzad Danaei, Srikanth Sivaramakrishnan and 1 other
• arXiv preprint · 28 October 2026

  Same Label, Different Interface: Beyond Action-Space Labels in Robot Learning

  Arshia Sangwan and Zhongyang Zhang
• arXiv preprint · 27 October 2026

  Ground Sample Distance Constrained k-Coverage Viewpoint Planning via Set Multi-Cover Formulation

  Waleed Bin Khalid and Chul Min Yeum
• arXiv preprint · 28 October 2026

  Minimum-Time Escape from the Conic Field of View of a Reeds--Shepp Pursuer: the Faster Evader

  Ubaldo Ruiz
• arXiv preprint · 27 October 2026

  Whole-Body Humanoid Control via Stochastic Motion Tokenization

  Michael Drolet, Oleg Arenz and Jan Peters

All new papers in Robotics