arXiv preprint ·
Large language models underrepresent malice and overreport virtue
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
People increasingly use large language models (LLMs) to interpret others' behaviour, often assuming that LLMs infer motives as humans do. Aligned LLMs attribute more benevolent and less malevolent motives to a whistleblower than humans do, but ratings alone cannot reveal whether these differences arise in internal representations or at report. Here we compare linear-probe readouts of LLMs' internal states with their own ratings at the same prompt position for four motives, in two preregistered studies. For the two malevolent motives, self-interest and intent to harm, internal and expressed readouts did not differ: the lower ratings reflect weaker signal along the probed directions, not suppression at output. For the two benevolent motives, duty and concern for others, expressed ratings exceeded the internal readouts, indicating amplification at report. In free text the model rarely volunteered a motive against the colleague, far less often than humans did, yet produced one readily once the scenario supplied a reason. Shifting the internal representation along a malevolent-motive direction brought both malevolent ratings to the human level, whereas the rating of duty yielded only past a threshold at which the other motives had overshot. LLMs' more charitable motive profile thus has two distinct sources: reduced malevolent signal in the probed representation and amplified benevolent attribution at report.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Artificial Intelligence
Do Social Influence Pressures Move LLM Agents? Evidence from Delegated Audit Judgment
BanglishDepYT: Depression Detection in Native Bengali Social Media with Emotion-Preserving Preprocessing and Domain-Adaptive Pretraining
Dual-Axis Policy Entailment: A Benchmark for Policy-Change Reasoning
Rubric-Based Assessment of Student Reports Using Small Language Models
ROD-Dataset: A Pedestrian-Perspective Benchmark of Urban Obstacle Classes for YOLO-Based Detection
Get the few papers worth your time in Artificial Intelligence every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.