Primitive-Informed Sampling-Based MPC for Multi-Fingered Dexterous Manipulation

Abstract

We present a primitive-informed sampling-based model predictive control (MPC) framework for multi-fingered dexterous manipulation. Sampling-based MPC evaluates candidate control trajectories through forward simulation without requiring gradients through complex contact dynamics. However, directly sampling these trajectories in the high-dimensional joint space of a dexterous hand is inefficient and makes performance strongly dependent on the sampling distribution. Our framework biases sampling using low-dimensional manipulation primitives that encode coordinated finger motions, while simultaneously optimizing joint-level residuals to adapt these motions to the current hand-object configuration. Task-related rollout constraints reject infeasible trajectories during forward simulation, improving the effective use of the sampling budget. We evaluate the approach on a 16 DoF Allegro hand using a synchronized MuJoCo digital twin. Ablations show that both the primitive and residual are necessary for reliable continuous in-hand rotation, that increasing the sampling budget alone does not recover this coordination, and that rollout constraints substantially improve success rate. A primitive extracted for one object size transfers to other sizes and remains effective under model mismatch. The framework further supports grasping, object reorientation, and coordinated arm-hand manipulation, using primitives extracted from both a simulation-trained policy and human hand-motion data.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 15 September 2026

  Dense to MoE Adaptation for Compact Vision Language Action Policies

  Muchun Niu, Shuang Chen, Yuzhou Wu and 1 other
• arXiv preprint · 14 September 2026

  Real-World Reinforcement Learning with MPC Scaffolding for Dexterous Manipulation

  Emek Barış Küçüktabak, Karankumar Patel, Zhaodong Yang and 3 others
• arXiv preprint · 15 September 2026

  UniDex-ViTac: Learning Unified Visuo-Tactile Dexterous Manipulation Policy from Human Video Data

  Hyesung Lee, Si-Hwan Heo and Sungwook Yang
• arXiv preprint · 14 September 2026

  HydroMap: Probabilistic Water Surface Elevation Mapping for Semantic Scene Representation in Inland Waterways

  Zhongbi Luo, Yunjia Wang, Herman Bruyninckx and 1 other
• arXiv preprint · 15 September 2026

  Beyond Gestures: Estimating Full Hand Pose and Contact Forces from Wrist-Worn Pressure Sensor Array

  Svetoslav Kolev, Lingni Ma, Michael Goesele and 3 others

All new papers in Robotics