arXiv preprint ·
When Is Disclosing Private Conversations with AI to the State Justified? Proactive Referral Policies of Major U.S. AI Companies through the Lens of Contextual Integrity
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
AI companies engage in "proactive referral," notifying law enforcement of user conversations they judge dangerous without a government request. This poses a dilemma, since referral may expose people who merely confided dangerous thoughts to an AI to investigation, whereas not referring may leave actual violence unprevented. This study asks under what conditions proactive referral can be justified and to what extent companies' public policies disclose those conditions. Drawing on contextual integrity theory and the norms governing exceptional information sharing in confidential counseling, online posts, and private communications, the study develops eight justification criteria classified as required, presumptive, or recommended. Three evaluators analyzed 27 public documents from six major U.S. AI companies using the criteria applicable to corporate policies. No company clarified whether broad sharing provisions or narrower safety notices took precedence, and assessments of referral scope depended on which provisions were given precedence. No company disclosed the specific factual thresholds and exception conditions governing referral decisions, or whether users would be notified afterward. The study turns contextual integrity into a stage-by-stage framework for proactive referral, shows that policy documents must be read in light of their relationships, and proposes policy elements for keeping proactive referral a narrow exception disclosed in advance.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Computers & Society
The World as Viewed by 136 Countries: An Open, Curated, Annotated, and Multilingual Dataset of 118 Million State Media Articles
Causal Humility: Governing the Authority of Fairness Claims Under Causal Uncertainty
Scam Town: Can Scam Education Spread Like a Vaccine?
When Care Expands and Control Declines: Understanding Digital Privacy in End-of-Life Care
Legal Guidance in the Wild: How Users Seek Legal Help in Real-World LLM Conversations
Get the few papers worth your time in Computers & Society every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.