arXiv preprint ·
CG-Probes: Recovering Guardrail Directions from Patient Query Embeddings
- Published
- Source
- arXiv preprint, posted before peer review
- DOI
- 10.1145/3799682.3840044
- Original
- Read it at arXiv
- Topics
Abstract
Patient-facing AI assistants promise valuable support to patients, but incoming queries can pose medical risks. To create guardrails, we work with oncologists to define three ordinal risk axes: Medical Urgency, Psychological Urgency, and Topic Sensitivity. We propose Clinical Guardrail Probes (CG-Probes) to measure the risks from query embeddings. We probe for each axis in the normalized embedding space of frozen embedders via the difference-in-means method, treating each axis as a potential linear direction. To train the probes, we cluster 79,658 Czech oncology search queries with BERTopic and use these clusters to generate pairs of queries with contrastive risk levels via few-shot prompting. We evaluate the approach on 200 queries (90 real, 110 synthetic), each graded by two oncologists, against two open-weight LLMs and a frontier LLM. We find that urgency-based axes are recoverable as linear directions, and the probes are competitive with open-weight LLMs (no significant differences in quadratic-weighted kappa) at a fraction of the latency. Each axis yields a scalar score that clinicians can inspect and use to set escalation thresholds. The pipeline requires only search logs, axis definitions, and black-box access to the embedding model, suggesting transferability across healthcare domains. Robust validation on new queries and axes remains future work.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Computation & Language / NLP
Component Benchmark: Hierarchical Model Profiling for Large-scale Recommendation Systems
Rethinking Cross-Channel Importance in Time-Series Forecasting
Recommendation World Models for Future-State Control
DP-Rec: Towards Dynamic Patching for Efficient Long-Sequence Recommendation
RecToolBench: Benchmarking Recommendation-Specific Tool Orchestration under Fuzzy User Intent
Get the few papers worth your time in Computation & Language / NLP every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.