arXiv preprint ·

The Wisdom of the Loudest: A Large-Scale Audit of Generative Search on Reddit

Agam Goyal, Wang Claire and Eshwar Chandrasekharan

Published
Source
arXiv preprint, posted before peer review
Original
Read it at arXiv
Topics
Information Retrieval

Abstract

Online communities are valued not only for answers, but for the diversity of experiences and perspectives they contain. Generative search increasingly mediates access to this discourse, yet little is known about which community voices survive retrieval and synthesis. We audit Reddit Answers using 10,000 queries from 20 advice- and support-seeking communities, repeated three times to produce 30,000 answers over 14.68M comments. We find that differences across runs are driven primarily by retrieval, answers routinely combine evidence across communities, and selection strongly favors already-visible, top-level comments. Formal and directive language is more likely to be surfaced, while experiential voice is less likely to survive selection and is further weakened during synthesis, with first-person singular language declining sharply. These findings show that community-grounded generative search is not neutral summarization, and should be designed not only for relevance and fluency, but also for provenance, plurality, and legibility.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

Read it on ReadSearch

Each opens after you create an account, and brings you back to this paper.

Already a reader? Sign in

All new papers in Information Retrieval

Get the few papers worth your time in Information Retrieval every morning.

ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.

Papers belong to their authors and publishers; every page here links to the original. All research topics