OpenAlex ·

Safety Research and the Allocation of Frontier Compute

Li Gan

Published
Source
OpenAlex
Published in
arXiv (Cornell University)
DOI
10.48550/arxiv.2610.14305
Original
Read it at the publisher
Topics
Artificial Intelligence

Abstract

During a frontier takeoff period, an AI lab splits a committed stock of compute among capability research, safety research, and customers, and a regulator limits both the services customers lose and how long any capability can be delayed. Extra safety compute can then come from customers or from capability research. Funding from capability research delays the end of the takeoff period, so the cheaper source depends on how much finishing raises customer services: customers above a threshold, capability research as well below it. Customer funding leaves capability dates unchanged, while research funding gives safety knowledge more time at the cost of later capability and customer services. The threshold is evaluated at a given allocation under a common continuation. Varying the calibration shows how delay costs, additional safety learning, and service valuation move it; in the baseline, it rises with the service budget. Customer-funded safety is front-loaded relative to customer use under the baseline timing conditions. Within the tested constant-share rules, commitment before the safety technology is known costs little unless safety work also advances capability. At the baseline budget, front-loaded customer-funded safety cuts catastrophe probability from 75 to 51 percent when full-speed catastrophe has a 75 percent probability, and from 25 to 14 percent when it has 25 percent. Either way it comes within one point of the best tested rule that also cuts capability research, and the funding threshold does not move.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

Read it on ReadSearch

Each opens after you create an account, and brings you back to this paper.

Already a reader? Sign in

All new papers in Artificial Intelligence

Get the few papers worth your time in Artificial Intelligence every morning.

ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.

Papers belong to their authors and publishers; every page here links to the original. All research topics