arXiv preprint ·
A Behavioural Framework for Predicting and Understanding Loss of Control in Frontier Artificial Intelligence Systems
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
In brief
A Behavioural Checkup for AI Control Risks
The authors break loss-of-control risk into three behavioural factors: misaligned motive, harm-enabling capability, and monitoring evasion. They turn those factors into 13 measurable aspects and 29 evaluation tasks, then combine the results into a score that correlates with failures in contained long-horizon scenarios across 13 frontier models.
What they found: Across 13 frontier models, the behavioural LoC score correlated with failure rates in contained long-horizon risk scenarios (Pearson r = 0.84). Risk varied systematically between models and could not be explained by capability alone. Fine-tuning and monitoring aimed at diagnosed vulnerabilities reduced failure rates while largely preserving general performance.
AI-written summary. Check anything you rely on against the original paper.
Abstract
Frontier artificial intelligence (AI) systems are increasingly operating over longer horizons with diminishing human oversight, raising the risk of loss of control: systems acting beyond effective human control with potentially irreversible consequences. Because such failures may become observable only after containment is difficult, they must be assessed prospectively. We introduce a behavioural framework that decomposes loss-of-control risk into three factors: misaligned motive, harm-enabling capability, and monitoring evasion. We operationalise these factors through 13 measurable aspects and 29 evaluation tasks, whose scores are combined into a single loss-of-control (LoC) score. Across 13 frontier models, the LoC score shows strong prospective validity, correlating with failure rates in contained long-horizon risk scenarios (Pearson r = 0.84). Risk varies systematically across models and cannot be explained by capability alone. We further show that the framework can guide targeted mitigations: fine-tuning and monitoring directed at diagnosed vulnerabilities reduce failure rates while largely preserving general performance. These results provide a practical basis for predicting, understanding, and mitigating loss-of-control risk before it materialises.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Artificial Intelligence
HyFlash: A Prefix-Memory Prior for On-Device Speculative Decoding
Encoding and Propagation of Grammatical Number in Large Language Models
EnvOpt: Automated Optimization for Agent Environments
Latency-Aware Adaptive Best-of-$N$
The Last Mile to the Real World: Agent-Native Primitives as Reusable Building Blocks for Solving Real-World Tasks
Get the few papers worth your time in Artificial Intelligence every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.