arXiv preprint ·
Perceived Trust and Transparency in AI-Altered vs. Human-Written LinkedIn Posts
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
People increasingly draft a social media post themselves and then let an AI model refine it (AI-altered), a common but understudied middle case between fully human-written and fully AI-generated content. We ask whether this changes how trustworthy and transparent readers perceive the post to be, and whether they can even tell. We first analyze real ChatGPT conversations (WildChat) to find how people actually alter social media posts, which we use to design realistic alteration prompts. We then run a pre-registered, within-subjects online experiment (n=214) in which participants rate unlabeled human-written and AI-altered LinkedIn-style posts for perceived trustworthiness and transparency, and separately judge whether each post was AI-altered. We find that AI-alteration itself has no detectable effect on either perceived trustworthiness or transparency (both estimates near zero, not significant). At the same time, readers did not reliably detect AI-alteration (49\% accuracy, near chance) and defaulted to assuming human authorship when unsure. However, our analysis shows significant differences in transparency and trustworthiness ratings across the specific post, the AI model, as well as the prompt used to alter it. For instance, more detailed prompts raise both perceived trustworthiness and transparency but also make the alteration more detectable. Surprisingly, the prompt that shifted ratings most also asked the model to add one new idea absent from the original post: readers nonetheless rated this AI-invented, unverifiable content as more trustworthy and transparent.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Human-Computer Interaction
BobFlow: Towards Human-Agent Collaborative Data Science Using Dataflows
VREgo: Consumer VR Headsets for Learning Robot Manipulation from Egocentric Demonstrations
Sure Enough to Share? Overconfidence in GenAI Video Discernment is Associated with Sharing Intentions
Slide to Report: Continuous Reporting Symptom-Specific Cybersickness in VR
Compiling, Validating, and Using Human Reference Atlas Cell Type Annotation Crosswalks
Get the few papers worth your time in Human-Computer Interaction every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.