Beyond Decodability: Do Acoustic Factors Drive Predictions in Speech-Based Alzheimer's Assessment?

Abstract

Speech-based Alzheimer's disease (AD) assessments increasingly rely on pretrained self-supervised learning (SSL) models that learn acoustic representations directly from raw audio, exposing the model to recording factors. We ask whether such factors are merely encoded in SSL representations or can systematically alter predictions. Using ADReSSo and three large SSL backbones, we apply controlled noise and reverberation interventions to participant-speech-only, non-speech, and full-recording audio. We combine layer-wise linear decoding, input- and representation-space interventions, and geometric alignment analysis to distinguish acoustic decodability from influence on AD prediction. Our results show that controlled acoustic interventions alter AD predictions across all three SSL backbones. Noise, despite showing no significant diagnostic-group difference in the original data, produces the strongest intervention effects. Importantly, these effects are systematically structured relative to the classifier's decision direction, replicate on the held-out test set and reverse when the representation-space intervention direction is reversed. Together, these findings show that high predictive performance and the absence of a significant diagnostic-group difference in a measured acoustic factor are not sufficient for robustness. We argue that intervention-based robustness tests should become standard for trustworthy clinical speech models.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Sound

• arXiv preprint · 1 October 2026

  Child-Adapted Structured Phonological Representations for Interpretable Speech Sound Analysis

  Abner Hernandez, Tomás Arias Vergara, Andreas Maier and 1 other
• arXiv preprint · 2 October 2026

  Learning Jazz Pianist Style with Cross-Attention Conditioning

  Drew Edwards, Akira Maezawa and Simon Dixon
• arXiv preprint · 1 October 2026

  Watch Your Speech: Text-aware Video-to-Speech Synthesis with Textual Conditioning

  Gunwoo Lee, Yoori Oh and Yoseob Han
• arXiv preprint · 2 October 2026

  FASTDIAR: Frame-level speaker encoder for Streaming Diarization

  Nikita Torgashov and Okan Köpüklü
• arXiv preprint · 1 October 2026

  Code-Switching Spoken Language Identification as Multi-Label Set Prediction

  Shunsuke Mitsumori, Matthew Wiesner, Shigeo Morishima and 1 other

All new papers in Sound