Imitation Learning via Discrete and Rhythmic Primitive Composition

Abstract

Long-horizon robotic manipulation is inherently composed of semantically meaningful sub-tasks. While Movement Primitives (MPs) can model these components, their composition typically relies on manual engineering or sample-inefficient reinforcement learning. Existing supervised methods are limited by the lack of MP labels in standard datasets and often fail to generalize across discrete and rhythmic movements. We propose Neural Dynamic Composition (NDC), a supervised framework to compose Dynamic Movement Primitives (DMPs) using only raw trajectories for supervision, given a single example of each primitive. Our approach exploits parallel combinations of DMPs as a differentiable relaxation of categorical primitive selection, and utilizes a warp-invariant loss formulation to identify primitives despite spatial or temporal variations. A staged training curriculum is employed to learn the selection policy and DMP parameters, unifying discrete and rhythmic movements in one framework. Evaluated on 2D handwriting and 3D robotic tasks, our method outperforms baselines on most tasks and metrics. An ablation study demonstrates how each design choice contributes to the system's performance.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 11 October 2026

  Reinforcement Learning Based Heterogeneous Task Allocation Under Spatio-Temporal Environmental Uncertainty for Multi-Robot Teams

  Xi Lin, Yaxuan Li, Paul Szenher and 1 other
• arXiv preprint · 12 October 2026

  PathLift: Depth-Conditioned Metric Lifting for Visual-Navigation Priors

  Gwanjun Shin, Hyeongseok Suh, Hongmo Jung and 1 other
• arXiv preprint · 11 October 2026

  LeHami: Symplectic Latent Dynamics for World Models

  Romina Yalovetzky, Randall Balestriero and Yann LeCun
• arXiv preprint · 12 October 2026

  Constrained Differentiable Policy Learning for Safe Quadrotor Navigation

  Yan Rui Tan, Praveen Krishnapur, Zeyu Feng and 3 others
• arXiv preprint · 11 October 2026

  Embodiment-Aware Inference-Time Search for Human Reaction Selection in Humanoid Retargeting

  Yongpeng Cao, Masahiro Hirano and Yuji Yamakawa

All new papers in Robotics