Learning Object-Centric Motion Priors from Human for Robotic Dexterous Manipulation

Abstract

Manipulating diverse objects with multi-fingered dexterous hands is challenging due to the high dimensionality and complex dynamics. Human-Object Interaction (HOI) datasets provide rich knowledge about task information and embodied interactions. Instead of solely imitating the human demonstrations, our method learns to holistically predict future hand-object states by leveraging these datasets. The predicted future states of the object can serve as a general-purpose reward term for reinforcement learning, reducing reliance on task-specific reward engineering and enhancing generalization across tasks. We conduct extensive experiments on three manipulation tasks in simulation and the real world. Our approach outperforms existing SOTA methods in both success rate and generalizability on novel objects. Furthermore, we validate the cross-embodiment compatibility of our methods by successfully deploying the skills on different robot hands.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 4 November 2026

  Closed-Loop Adaptive Sampling on a Generative Ocean Model

  Shayesteh Hafezi and Alan Papalia
• arXiv preprint · 5 November 2026

  An Empirical Study of Reinforcement Learning for Keypoint Positioning of Deformable Linear Objects

  Vinay Rodrigues, Sara Zeynalpour, Gokhan Solak and 2 others
• arXiv preprint · 4 November 2026

  ZipDrift: Generating Multimodal Short-Horizon MPC Costs with One-Step Drifting Models

  Ke Zhang
• arXiv preprint · 5 November 2026

  CRISP: Constraint-Resolved Interactions between Subsystems for Predictive Whole-Body Cooperation

  Dario Valenzuela and Jeeseop Kim
• arXiv preprint · 4 November 2026

  WayPOP: A Panoramic Open-Set Panoptic Tracking Benchmark

  Rohit Mohan, Maximilian Luz, Swarnava Chowdhury and 7 others

All new papers in Robotics