Uncertainty-Guided Sparse Refinement for Action Chunking Transformer Policies

Abstract

Learning chunk-based visuomotor policies for long-horizon robot manipulation remains challenging. Recent action-chunking methods have shown promising performance by predicting temporally extended action sequences. However, their failures are often dominated by prediction errors at a small number of critical timesteps rather than uniformly poor predictions across the entire action chunk, making uniform refinement inefficient and insufficiently targeted. To address this bottleneck, we propose Uncertainty-Guided Refinement (UGR), a sparse refinement framework for chunk-based visuomotor policies. Specifically, UGR follows a coarse-to-refine design: it first predicts a full action chunk, estimates per-step temporal uncertainty from the coarse hidden states, and applies residual correction only to the most uncertain timesteps selected by a binary mask. The uncertainty branch is decoupled from the coarse action predictor, enabling clean attribution of the refinement gains to uncertainty-guided correction rather than additional predictor capacity. Extensive experiments on five dual-arm manipulation tasks from the RoboTwin benchmark show that UGR achieves the best success rate on four tasks, improves over the ACT baseline by up to 13% absolute, and outperforms both full-chunk and position-agnostic block refinement in ablation studies.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 14 September 2026

  Primitive-Informed Sampling-Based MPC for Multi-Fingered Dexterous Manipulation

  Emek Barış Küçüktabak, Karankumar Patel, Jinda Cui and 3 others
• arXiv preprint · 15 September 2026

  Dense to MoE Adaptation for Compact Vision Language Action Policies

  Muchun Niu, Shuang Chen, Yuzhou Wu and 1 other
• arXiv preprint · 14 September 2026

  Real-World Reinforcement Learning with MPC Scaffolding for Dexterous Manipulation

  Emek Barış Küçüktabak, Karankumar Patel, Zhaodong Yang and 3 others
• arXiv preprint · 15 September 2026

  UniDex-ViTac: Learning Unified Visuo-Tactile Dexterous Manipulation Policy from Human Video Data

  Hyesung Lee, Si-Hwan Heo and Sungwook Yang
• arXiv preprint · 14 September 2026

  HydroMap: Probabilistic Water Surface Elevation Mapping for Semantic Scene Representation in Inland Waterways

  Zhongbi Luo, Yunjia Wang, Herman Bruyninckx and 1 other

All new papers in Robotics