Energy-Based Policy Orchestration

Abstract

Hierarchical control scales robot behavior by separating task-level planning from low-level control. In dynamic, high-dimensional tasks, however, a fixed planner-to-policy interface can fail when contacts, balance, or disturbances evolve faster than high-level policy updates. Execution therefore requires choosing not only which low-level policy to run, but also which policy-specific goal should be given to it. We formulate this problem as policy orchestration: runtime selection of a policy-goal pair that is likely to remain feasible while tracking the planner target. We develop EPO, an energy-based policy orchestrator for modular goal-conditioned policy families. For each policy, EPO learns a composite energy over low-level goals, where lower energy corresponds to higher feasibility and more accurate target realization. At runtime, EPO refines each policy's goal and executes the lowest-energy policy-goal pair. Because energies are policy-specific, new policies can be incorporated by learning their own energy models, without retraining the existing policies or a centralized scheduler. In simulation, EPO improves the empirical precision-robustness trade-off by refining policy-specific goals before selectively switching among policies based on energy scores. We further demonstrate sim-to-real deployment of the same frozen policies and energy models on real humanoid loco-manipulation tasks. Project website: https://yewr.github.io/epo

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 2 November 2026

  Late Autumn: LLM Agents Specialize a General Multi-Robot Planner for One Warehouse

  Yimin Tang, Han Zhang, Shao-Hung Chan and 3 others
• arXiv preprint · 3 November 2026

  VARP: A Visual Adaptive Rearrangement Planner for Non-Monotone Object Rearrangement Planning

  Hanwen Ren, Meng Zheng, Zhongpai Gao and 4 others
• arXiv preprint · 2 November 2026

  Learning Purposeful Co-designs of Bio-inspired Quadrupedal Robots

  Fabio Boekel, Jiatao Ding and Cosimo Della Santina
• arXiv preprint · 3 November 2026

  Online Hamilton-Jacobi Reachability Onboard the Robot Control Loop: A Real-Time GPU Solver for Safety-Critical Autonomy

  Kevin Weekly and Alexandre M. Bayen
• arXiv preprint · 2 November 2026

  To Coordinate or Not to Coordinate? Learning to Swim with Eight Soft Arms

  Junkai Chen, Dehan Yuan, Yiyuan Zhang and 4 others

All new papers in Robotics