arXiv preprint ·

Data storytelling meets interpretable machine learning: Decoding AI decisions for non-experts without revealing sensitive data and model details

Lemen Chao, Zixuan Yang, Anran Fang, Mingran Sun and Ming Lei

Published
Source
arXiv preprint, posted before peer review
Original
Read it at arXiv
Topics
Artificial IntelligenceComputation & Language / NLPHuman-Computer InteractionMachine Learning

In brief

Bridging AI and Storytelling

This paper innovatively combines data storytelling with interpretable machine learning (IML) to create a more understandable framework for AI decisions. By introducing the DIST Pyramid and a narrative interpretation framework, it enhances the explainability of AI without compromising sensitive data.

What they found: The study demonstrates that integrating data storytelling with IML significantly enhances the comprehensibility of AI decision explanations. Using the Boston Housing dataset, the 'What-if' and 'Why-not' narratives were rated 76.4% and 74.3% comprehensible, respectively. This new approach also achieved around 30% higher accessibility scores compared to traditional SHAP visualizations, indicating a promising direction for making AI more user-friendly.

AI-written summary. Check anything you rely on against the original paper.

Abstract

AI-driven automated decision-making requires both predictive performance and interpretability. Recent advances in interpretable machine learning (IML) provide tools for explaining model predictions, but the technical complexity of these explanations may hinder accessibility to non-experts. To address this challenge, this study integrates data storytelling with IML to enhance the explainability of AI-generated decisions for a broader audience. Following the design science research (DSR) paradigm, this study proposes a formal definition of data storytelling in IML, introduces the DIST Pyramid to align data storytelling with IML, and presents the I-P-O Model to describe their interactions. It further develops an architecture to explain AI decisions through distinct "What-if" and "Why-not" event-generation processes. The architecture also employs data desensitization to protect sensitive input data. To validate the approach, a case study is conducted with the Boston Housing dataset, using SHapley Additive exPlanations (SHAP) values and large language models (LLMs) to generate data stories with And-But-Therefore (ABT) structures. An empirical evaluation shows that 76.4% and 74.3% of respondents rated the "What-if" and "Why-not" data stories as more comprehensible, with significantly higher accessibility scores than traditional SHAP visualizations. The paper concludes with the presentation of a narrative interpretation framework that integrates IML and data storytelling, thereby expanding the research scope as well as the practical applicability of AI decision-making.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

Read it on ReadSearch

Each opens after you create an account, and brings you back to this paper.

Already a reader? Sign in

All new papers in Artificial Intelligence

Get the few papers worth your time in Artificial Intelligence every morning.

ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.

Papers belong to their authors and publishers; every page here links to the original. All research topics