How the Audit Rule Shapes Faithful Factor Explanations in LLMs

Abstract

Large language models are often asked which input factors influenced their outputs. For structured inputs, such reports can be checked by counterfactual perturbation, but each factor must be queried multiple times to estimate its effect, so verification is usually budget-limited. We study how this limited-budget setting changes the incentive to report factor-level influence truthfully. We formalize the interaction as a verification game and show that proper scoring alone is not enough when auditing depends on the report: report-dependent auditing creates a suppression incentive, because factors reported as important are more likely to be checked and penalized for estimation noise. In contrast, report-independent auditing, or a mixed rule with a small report-independent floor, removes this channel and makes truthful reporting preferable to full suppression. We instantiate the framework with the Counterfactual Brier Score (CBS) and evaluate its predictions on four NLP benchmarks. A synthetic rational agent matches the theoretical prediction exactly, and real LLMs follow the same incentives when they are made explicit. The main design implication is simple: under partial verification, factor-level explanation systems should include a report-independent audit component so that under-reporting cannot be used to avoid scrutiny.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Computation & Language / NLP

• arXiv preprint · 1 October 2026

  AuraForge: Scaling Security Supervision for Training Coding Agents

  Danqing Wang, Songwen Zhao, Harsh Sharma and 4 others
• arXiv preprint · 2 October 2026

  Learning When to Commit from Partial Speech for End-to-End Simultaneous Speech Translation

  Hieu Hoang and Amittai Axelrod
• arXiv preprint · 1 October 2026

  Child-Adapted Structured Phonological Representations for Interpretable Speech Sound Analysis

  Abner Hernandez, Tomás Arias Vergara, Andreas Maier and 1 other
• arXiv preprint · 2 October 2026

  VERSE: Verified Self-Evolving Optimizer for Agent Harnesses

  Zekai Wang, Yingqiang Ge, Zekun Wang and 6 others
• arXiv preprint · 1 October 2026

  Kinematic MeanFlow: One-Step Action Generation Policy for Robotic Foundation Models

  Jiawei Fan, Sifeng Wang, Yuqing Hou and 1 other

All new papers in Computation & Language / NLP