arXiv preprint ·
Control-Theoretic Content Moderation
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
A sizable literature studies content moderation locally, at the level of individual moderation decisions, for example by measuring or predicting the effects of specific interventions. However, the problem of how such decisions should be combined into effective platform-level moderation strategies is comparatively unexplored. We address this latter problem by formulating content moderation as a global, adaptive, and sequential decision process in which heterogeneous interventions must jointly balance multiple competing objectives. Drawing on feedback control, we introduce a general control-theoretic framework for composing moderation actions according to their expected effects on an evolving platform. We instantiate the framework in large-scale, empirically grounded simulations and compare two control-theoretic moderators against several baselines and local strategies. When moderation aims to maintain competing platform-level properties around desired conditions, the control-theoretic approaches achieve the best overall performance. They also use severe interventions more selectively and recover more effectively after external surges of harmfulness. These results demonstrate the advantages of studying content moderation as a global, adaptive, and sequential decision problem.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Computers & Society
Large Language Model based air quality monitoring and localized alert generation
Funding the runners-up beats a golden ticket
Measuring AI Leadership: Development and Validation of a Multidimensional Measure for AI-Native Organizations
Value Faces: Surfacing How Self-Presentation Shifts Across Relationships
Newer Is Not Fairer: Gender Stereotyping in Text-to-Image AI Across Model Generations
Get the few papers worth your time in Computers & Society every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.