arXiv preprint ·
TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Model
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
In brief
Navigating Chaos: Meet TANGO
TANGO introduces a groundbreaking whole-body vision-language navigation framework that allows humanoid robots to interpret language instructions and navigate complex environments. By predicting joint-space actions, TANGO enables more fluid and adaptable movement than previous modular approaches.
What they found: TANGO achieved a remarkable 92.5% navigation success rate in simulated environments, significantly outperforming modular baselines, which only reached 78.3%. The robot maintained a low collision rate of just 1.5%, demonstrating its adeptness in navigating cluttered spaces. Impressively, TANGO also succeeded in real-world deployments without any prior training on real navigation data, highlighting its robustness and versatility.
AI-written summary. Check anything you rely on against the original paper.
Abstract
We study the problem of navigating cluttered indoor environments with a humanoid robot. Unlike conventional methods that model navigation as a 2D path planning problem, humanoid traversal in cluttered environments requires continuous geometry-aware whole-body adaptation, including coordinated arm placement, torso adjustment, and gait modulation for collision-free movement through complex 3D spaces. We introduce TANGO, the first whole-body vision-language navigation framework for language-conditioned humanoid traversal in cluttered environments. Given a natural-language instruction and egocentric RGB observations, TANGO directly predicts 29-DoF joint-space actions for downstream whole-body control. We train TANGO entirely in simulation by synthesizing diverse collision-free traversal behaviors via global path planning, kinematic whole-body motion generation, obstacle-aware motion editing, and RL-based tracking. This pipeline provides dynamically feasible action supervision for learning language-conditioned whole-body policies. In extensive simulation experiments, TANGO demonstrates state-of-the-art performance in vision-language navigation, while outperforming strong modular baselines in navigating challenging scenes requiring obstacle negotiation. Lastly, we deploy TANGO zero-shot on a Unitree G1 humanoid robot, and observe robust language-guided traversal in cluttered real-world scenes without training on any real-world navigation data.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Robotics
DISEIL: Demonstration Distillation for Sample-Efficient Imitation Learning
Compact Visuotactile World Models for Lifting: Prediction, Reward Alignment, and Force Constraints
Observe Before You Alert: Adaptive Driver Alerting with Vision-Language Models
MuJoCable: Reduced-Order Surface-Routed Cable Transmission for Tendon-Driven Robots
Dual-Layer Semantic-Spatial Belief Mapping for Aerial Object Goal Navigation
Get the few papers worth your time in Robotics every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.