arXiv preprint ·

(Whose defaults?) Is artificial intelligence reorienting archaeological methods?

Lorenzo Cardarelli and Roberto Ragno

Published
Source
arXiv preprint, posted before peer review
Original
Read it at arXiv
Topics
Computers & SocietyArtificial IntelligenceComputation & Language / NLPHuman-Computer Interaction

In brief

AI's Influence on Archaeological Methods

This paper dives into a comprehensive analysis of 119,000 archaeological abstracts, revealing that while there’s a slight shift in method use post-2023, overall methodological diversity has actually increased. It also highlights how LLMs may be steering researchers toward a narrower set of recommendations.

What they found: The study found a small but credible shift in archaeological methods post-2023, although overall diversity has increased. LLMs provided recommendations that were significantly less diverse than the methods documented in published literature, particularly when lacking methodological guidance. This suggests that while LLMs are changing the landscape, they may also be promoting a convergence of methods rather than a decline in diversity.

AI-written summary. Check anything you rely on against the original paper.

Abstract

Generative AI and the practice of "vibe coding" are changing how archaeologists carry out computational research, but their effects on the discipline's range of methods is still understudied. In this paper, we evaluate whether large language models (LLMs) are narrowing the variety of methods archaeologists use. We first analysed approximately 119,000 archaeology abstracts from Scopus, covering publications from 2010 to 2025. Using a locally run LLM, we identified the computational methods reported in each abstract and organised them into 25 broad categories (L2) and 241 finer clusters (L3). A Bayesian Dirichlet-multinomial model of method composition within sub-disciplines found a small but credible shift in method use after 2023. However, this shift was smaller than the variation already present across the full study period. No individual technique showed a significant change, and overall methodological diversity increased rather than declined. We then ran a controlled experiment to see whether LLMs recommend a narrower set of methods than archaeologists have used in practice. Two different open-weight models were asked to suggest methods for 28 archaeological research problems, with prompts providing three levels of methodological guidance: novice, intermediate, and expert. Recommendation diversity was much lower than in the published literature, particularly without methodological guidance. The models also tended to favour methods that were widely used before 2023, and their recommendations more closely resembled the post-2023 literature. Taken together, these results are consistent with LLMs pushing methodological choice towards convergence, although our study cannot establish a causal effect. They raise a broader question: how can archaeology retain methodological diversity as LLMs become more involved in research?

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

Read it on ReadSearch

Each opens after you create an account, and brings you back to this paper.

Already a reader? Sign in

All new papers in Computers & Society

Get the few papers worth your time in Computers & Society every morning.

ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.

Papers belong to their authors and publishers; every page here links to the original. All research topics