arXiv preprint ·
Policy-as-Skill: Governed LLM Decision Support with Evidence, Deterministic Control, and Audit
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Organizations increasingly use LLMs for policy, compliance, risk, and operational decision support, requiring evidence validation, review routing, version control, and auditability. We introduce Policy-as-Skill (PaS), a modular runtime that packages these functions as executable, versioned policy capabilities. Thirteen methods are evaluated with a fixed Gemma4 backend on 600 development tasks. PaS+Audit achieves 53.8% exact accuracy, macro-F1 0.346, review F1 0.854, citation precision 1.000, policy-reference recall 0.984, and audit completeness 1.000, outperforming LLM+RAG on most governance and review metrics. Deterministic control raises aggregate accuracy to 61.2% but is strongly task dependent, supporting selective rather than universal rule-based intervention.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Artificial Intelligence
Order-Invariant Answers, Order-Sensitive Representations in Mathematical Reasoning
Linguistic Features for Interpretable Textual Entailment
Proceedings Tenth Symposium on Working Formal Methods
LogicTrack: Auditing Reasoning Trajectories of Large Language Models with Formal Logic Solvers
A 51-Addition Alternative-Basis Kernel for Rank-23 $3\times3$ Matrix Multiplication
Get the few papers worth your time in Artificial Intelligence every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.