arXiv preprint ·

Stronger artificial intelligence breakthroughs hasten their own exhaustion

Beichen Lu, Honglin Bao, Qi Huang, Qingguo Meng and James A. Evans

Published
Source
arXiv preprint, posted before peer review
Original
Read it at arXiv
Topics
Artificial IntelligenceComputers & SocietyGeneral Economics

In brief

AI’s Breakthroughs May Be Narrowing What Comes Next

The study tracks 36 years of computer science research, covering 7.2 million papers, 73,089 peer reviews, and 3.7 million researchers, and links topic shifts and review patterns to major breakthroughs. It also compares the pattern with structural biology and uses simulations to examine how reviewing policies can reinforce concentration; these findings describe field-level patterns, not a forecast of any particular AI system’s performance.

What they found: The authors find that computer science expanded while attention narrowed sharply after the Transformer, and that more than half of researchers who shifted topics moved into AI, especially mid-career researchers. Reviewer confidence fell by one point on a 5-point scale. The paper describes a cycle in which breakthroughs from AlexNet to large language models increase the field’s carrying capacity for ideas but are followed by steeper exhaustion of those ideas.

AI-written summary. Check anything you rely on against the original paper.

Abstract

Progress in artificial intelligence is widely assumed to scale with effort: more researchers, papers and investment should accelerate discovery. Theories of technological growth instead locate the difficulty of discovery in the space of ideas. Here we show that neither scale nor space is enough: breakthroughs depend on diverse attention, which collective concentration can deplete. Across 36 years of computer science, we analyze 7.2 million papers, 73,089 peer reviews and 3.7 million researchers and their topic shifts. The field expanded while its attention narrowed sharply after the Transformer. Over half of topic-shifting researchers moved into AI, especially mid-career ones, and reviewer confidence fell by a full point on a 5-point scale. Each successive breakthrough, from AlexNet to large language models, raised the field's carrying capacity for ideas but was followed by steeper exhaustion of those ideas. Bigger breakthroughs capture attention more completely, depleting the diversity their successors may draw upon. Structural biology shows the same cycle after cryo-EM and AlphaFold. Simulations show how well-intentioned and widely used policies such as reciprocal reviewing empower prolific authors and further narrow what the field accepts. We call for institutions that protect diverse attention in artificial intelligence rather than reward concentration on the winning paradigm.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

Read it on ReadSearch

Each opens after you create an account, and brings you back to this paper.

Already a reader? Sign in

All new papers in Artificial Intelligence

Get the few papers worth your time in Artificial Intelligence every morning.

ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.

Papers belong to their authors and publishers; every page here links to the original. All research topics