ReDOA: Real-World Distillation via Observation Alignment for Image-Based Manipulation Policy Learning

Abstract

Data-driven learning for general-purpose robotic manipulation presents a fundamental trade-off between data-collection cost and adaptability to real-world environments. Imitation learning (IL) requires costly human demonstrations, whereas simulation-based learning is vulnerable to sim-to-real gaps in dynamics and sensor observations. We propose ReDOA (Real-World Distillation via Observation Alignment), a framework that decouples control learning from perception learning to learn image-based policies in the real world. A state-based teacher policy trained in simulation is executed on a real robot, and its control knowledge is distilled into an image-based student policy using the collected trajectories. Observation Alignment resolves observation mismatches between data collection and deployment. This framework collects successful, efficiently executed trajectories paired with real-world visual observations, without requiring demonstrations from human experts. In real-robot experiments on three non-prehensile manipulation tasks, including bimanual manipulation, our method achieves better overall performance when jointly considering task success and execution efficiency than both IL based on human demonstrations and policy distillation in simulation. https://isri-aist.github.io/redoa-project-page/

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 19 October 2026

  Vector-Quantized World Model: Latent Feedback Motion Planning for Robot Manipulation

  Xuezhou Xu, Chung-Pang Wang, Zhenzhen Li and 1 other
• arXiv preprint · 20 October 2026

  Real-Time Disturbance-Aware Koopman Model Predictive Control for Quadrotors in Spatially Varying Winds

  Stella Kombo, Masih Haseli, Alejandro A. Stefan-Zavala and 3 others
• arXiv preprint · 19 October 2026

  Humanoid SRL: Augmenting Humanoids with Supernumerary Limbs for Coordinated Loco-Manipulation

  Fukang Liu, Feiyang Wu, Paul Barsa and 12 others
• arXiv preprint · 20 October 2026

  Towards Autonomous Bricklaying Using Boston Dynamics Spot

  Karl-Johan Sorensen, Nico vom Hofe and Frank H. P. Fitzek
• arXiv preprint · 19 October 2026

  Where Do the Gaussians Go? Foreground Attraction for Camera-Based Weakly Supervised 3D Occupancy

  Jeagon Song and Jhonghyun An

All new papers in Robotics