Self-Crystallizing Behavior Trees: Amortizing Foundation-Model Reasoning into Deterministic Control for Autonomous Drones

Abstract

Classical robot control, Finite State Machines and Behavior Trees (BTs), is deterministic and inspectable but fixed at design time: it fails on situations its designers did not anticipate. Foundation models can synthesize new control logic at runtime, at a cost in latency and non-determinism hard to accept in safety-critical aerial systems. Existing LLM-driven approaches keep the model in the loop permanently and discard what it produces. We propose Self-Crystallizing Behavior Trees (SCBT), in which the foundation model is a compiler rather than a runtime. When a BT node fails, an LLM proposes a minimal, mission-agnostic subtree patch; CMA-ES tunes its parameters in simulation; a contextual bandit decides whether a stored patch or a new LLM call is worth its cost; and a three-stage admission pipeline (static check, invariant-monitored replays, an empirical margin over the unpatched tree) admits only patches that demonstrably recover. Admitted patches are stored in a fleet library and, once the LLM call rate decays, crystallized into a deterministic BT that no human wrote. We implement SCBT on Microsoft Project AirSim with a schema-constrained LLM pipeline (Gemini 3.1 Pro) and a lockstep simulator. Over three seeds of a 20-episode learning phase with wind-gust and battery failures, SCBT used $11\pm1.4$ LLM calls against 26 for whole-tree regeneration and 22 without a library, with 0.33 calls per episode in the second half. The crystallized trees, 28 and 33 nodes with two patches each, reached $97\pm2\%$ mission success with no learning running, against 12\% for the unpatched tree and 98\% for a hand-coded expert tree, and reproduce decision traces exactly when re-ticked offline. Two negative results: replay admission rejected useful wind recoveries by attributing wind-induced geofence excursions to the patch, and a static-only ablation generalized better to held-out failures.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 18 October 2026

  Dream What I Can: Sparse Visual Planning for Long-Horizon Robot Manipulation

  Chongkai Gao, Wenlong Huang, Haonan Chen and 5 others
• arXiv preprint · 19 October 2026

  Vector-Quantized World Model: Latent Feedback Motion Planning for Robot Manipulation

  Xuezhou Xu, Chung-Pang Wang, Zhenzhen Li and 1 other
• arXiv preprint · 18 October 2026

  Scalable, Intuitive, Mixed Reality-Based Semi-Autonomous Robotic Telemanipulation for the Execution of a Fine-Grained Bimanual Task

  Shifei Duan, Zhe Wang, Francesco De Pace and 1 other
• arXiv preprint · 19 October 2026

  Humanoid SRL: Augmenting Humanoids with Supernumerary Limbs for Coordinated Loco-Manipulation

  Fukang Liu, Feiyang Wu, Paul Barsa and 12 others
• arXiv preprint · 18 October 2026

  Finite-Time Capture by a Dubins Pursuer Against Unknown Evader Strategies

  Dinesh Patra, Bhargav Jha and Ashish R. Hota

All new papers in Robotics