arXiv preprint ·
Execution Logs Sway VLM Judges of Robot Progress
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Vision-language models now grade robot videos, and text placed beside the frames can change their verdicts. On clips where the robot is losing progress, we add one log line saying the robot is making progress. Across Gemini, Qwen and GPT judges, this flips correct verdicts to progress 10 to 35 percentage points more often than a neutral line does. A one-line warning that the log may be wrong removes most of this effect. Selected fake "task complete" claims flip half of Qwen's correct verdicts, against a tenth for unrelated log lines. They have no detectable effect on Gemini.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Machine Learning
I Won't Know Until I Try: Interactive Information Gathering for Long-Horizon Manipulation
RobotAgentBench: Towards Open-world Robot Autonomy
ElevateHead: Decide Once, Then Commit: When the Action Head Matters for Multimodal Imitation
Dream to Assist: Intent-Conditioned World Models for Shared Vehicle Control
Enabling Motion-Induced WiFi-CSI Sensing in Multi-Robot Systems: A Simulation Framework
Get the few papers worth your time in Machine Learning every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.