Learning Geometry-Aware Planning Representations for Monocular Flight with Cross-Modal Supervision

Abstract

Existing high-speed navigation systems for micro aerial vehicles (MAVs) commonly rely on depth cameras, stereo vision, or LiDAR to obtain explicit geometric information, while monocular cameras offer a lighter and lower-cost alternative. However, monocular flight remains challenging because RGB images offer no direct metric cues and visual appearance varies considerably across environments. We propose a geometry-aware monocular visual planning framework that predicts trajectories from two image frames, their relative pose, and the MAV state. Without explicitly reconstructing depth, the proposed method complements the downstream planning objective with feature-level geometric supervision by transferring the planning-relevant representation learned by a privileged depth expert to the RGB planner through cross-modal distillation. The framework first trains a depth-based geometric expert, then distills its planning features into a monocular branch using paired RGB-D observations, and finally adapts the planner to the downstream trajectory planning objective. This design encourages the policy to learn planning-relevant geometric features, enabling collision avoidance. We further use a 3D Gaussian Splatting (3DGS) simulator to render visual observations for data collection, paired RGB-D supervision, and simulation evaluation. The planner trained in simulation is then deployed in real-world environments without real-world fine-tuning, achieving obstacle avoidance at speeds of up to 6.5 m/s.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 19 October 2026

  Vector-Quantized World Model: Latent Feedback Motion Planning for Robot Manipulation

  Xuezhou Xu, Chung-Pang Wang, Zhenzhen Li and 1 other
• arXiv preprint · 20 October 2026

  Real-Time Disturbance-Aware Koopman Model Predictive Control for Quadrotors in Spatially Varying Winds

  Stella Kombo, Masih Haseli, Alejandro A. Stefan-Zavala and 3 others
• arXiv preprint · 19 October 2026

  Humanoid SRL: Augmenting Humanoids with Supernumerary Limbs for Coordinated Loco-Manipulation

  Fukang Liu, Feiyang Wu, Paul Barsa and 12 others
• arXiv preprint · 20 October 2026

  Towards Autonomous Bricklaying Using Boston Dynamics Spot

  Karl-Johan Sorensen, Nico vom Hofe and Frank H. P. Fitzek
• arXiv preprint · 19 October 2026

  Where Do the Gaussians Go? Foreground Attraction for Camera-Based Weakly Supervised 3D Occupancy

  Jeagon Song and Jhonghyun An

All new papers in Robotics