OopsieRecover: Learning Transferable VLA Corrections from Semantic Interventions

Abstract

Vision-Language-Action (VLA) models can perform a wide range of robotic manipulation tasks, but often fail during deployment. Teaching them to recover from these failures requires substantial corrective data: existing approaches learn to recover from failures by directly associating corrective actions with the observations in which they were demonstrated. For instance, DAgger-like fine-tuning can require tens to hundreds of interactions, yet the resulting policy may still fail to generalize the learned corrections beyond the demonstrated scenarios. We hypothesize that semantics can capture the underlying reasons for failures and their corrections, enabling policies to learn from only a handful of corrective demonstrations and generalize those corrections to novel objects, and scene variations. We propose OopsieRecover, a framework that uses abduction to infer the intent behind a small set of corrective demonstrations and encodes the inferred knowledge as dense spatial representations and conditional costs. These costs capture when a behavior is undesirable and steer the policy toward more desirable action regions. We experiment across 6 tasks and variations in object poses, scenes, and related tasks, and find that only a handful of corrective demonstrations can enable a VLA to overcome failures across a broad range of novel situations, without requiring new corrective data for each variation. Please refer to https://robin-lab.cs.utexas.edu/oopsierecover for videos.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Robotics

• arXiv preprint · 5 November 2026

  An Empirical Study of Reinforcement Learning for Keypoint Positioning of Deformable Linear Objects

  Vinay Rodrigues, Sara Zeynalpour, Gokhan Solak and 2 others
• arXiv preprint · 5 November 2026

  CRISP: Constraint-Resolved Interactions between Subsystems for Predictive Whole-Body Cooperation

  Dario Valenzuela and Jeeseop Kim
• arXiv preprint · 5 November 2026

  VREgo: Consumer VR Headsets for Learning Robot Manipulation from Egocentric Demonstrations

  Liuchuan Yu
• arXiv preprint · 5 November 2026

  Efficient Diffusion Policy Fine Tuning with Latent Noise Representation Bridging

  Yuanchu Liang, Yue Yang, An-Chi He and 1 other
• arXiv preprint · 5 November 2026

  An Ordering Optimization for Fruit-Vegetable in High-Density Environment based on Genetic Algorithm

  Jaehwi Seol, Jeonghyeon Pak and Hyoung Il Son

All new papers in Robotics