Faster Imitation by Re-timing Demonstrations Within the Controller Limit

Abstract

Imitation policies inherit the operator's pace, and re-timing the demonstrations to run faster works only until success collapses at two to three times demonstration speed. Recent methods attribute that collapse to distribution shift and answer it with finer rules for which segments may be sped up; we show it has a mechanical cause that segment selection cannot address. A low-level controller realises only a bounded displacement per control period, so merging consecutive commands produces sums outside that bound: training pairs that promise a transition the plant cannot deliver. The share of such pairs in the re-timed data, which we call the exceed share, tracks where the retrained policy collapses. The rule that follows has a single parameter: merge greedily while the sum stays realisable. Every command is then realisable by construction, the demonstrated geometry is preserved, and the speed-up lands only where the demonstrator left slack. On four simulated robomimic tasks, 200 held-out seeds per cell, a merge cap of two is at or above the frozen policy's success on all four, by 14 points on Square, and shortens the successful episodes. At matched tempo, uniform re-timing loses 9 and 16 points on Can and ToolHang, is within noise on the other two, and reaches zero on the hardest at 2x. Placement also matters: no shuffled, entropy-guided or speed-conditioned alternative beats the rule on three of the four tasks, by margins the exceed share alone does not explain; on the fourth, at a tempo the task absorbs, every placement lands in the same band. The same principle carries to a simulated humanoid whole-body tracker: re-timing 429 reference motions within its velocity envelope succeeds on 71% of clips at 2.3x, against 51% for uniform time scaling at 2x.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 31 October 2026

  A Straight Line Is Not a Camera Pose: Auditing Short-Clip Pose Benchmarks

  Xinyi Shi
• arXiv preprint · 1 November 2026

  Same Path, Less Time: Training-Free Fast Execution of Vision-Language-Action Models under Inference Latency

  Fuyi Chen
• arXiv preprint · 31 October 2026

  Knowing Where to Look: Interactive Object Search via Spatial-Semantic Fusion

  Aditya Agarwal, Lucy Cai, Kelly Lu and 4 others
• arXiv preprint · 1 November 2026

  Serving Agentic Robot Fleets: Workload Characterization, KV-Cache Thrashing, and Admission Control

  Sida He
• arXiv preprint · 31 October 2026

  MESSPa: A Multi-modal Embodiment Stimulation Shoulder Pad for Preserving the Sense of Agency in a Detachable Robotic Arm

  Vitvasin Vimolmongkolporn, Guillaume Gourmelen, Yukiko Iwasaki and 1 other

All new papers in Robotics