arXiv preprint ·
Safety Beyond the Interface: Detecting Harm via Latent States in Large Language Models
- Published
- Source
- arXiv preprint, posted before peer review
- DOI
- 10.1109/DSN-W70714.2026.00027
- Original
- Read it at arXiv
- Topics
Abstract
Autonomous systems increasingly rely on Large Language Models (LLMs) yet the safety infrastructure surrounding these models introduces latency and compute overhead. This limits utility in resource-constrained, time-critical deployments. Existing external guardrail models remain blind to the model's internal workings, creating a fundamental assurance gap. We ask: does the model already know when the content is harmful? We extract activations from LLaMA-3.1-8B and train lightweight MLP classifier probes (12.6M parameters) to detect harmful prompts. Evaluated on WildJailbreak, Beavertails, and AEGIS 2.0, our probes achieve F1 scores of 99%, 83%, and 84%, respectively competitive with 1000x larger guard models while cutting latency and compute costs.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Artificial Intelligence
QuanText: Protecting Dataset-Level Secrets in Textual Data Sharing
Red-Teaming Auto Mode: Improving Blocking Classifiers Against Malign Coding Agents
FoundAna: A GNN-assisted Foundation Model for Graph Anomaly Detection
A Policy Profile for Croissant: Refusal as a Property of the Dataset
PentestChain: A Cost-Aware, MCP-Orchestrated Framework for Automated Penetration Testing with Free-Tier LLMs
Get the few papers worth your time in Artificial Intelligence every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.