Backdooring Acoustic Foundation Models for Physically Realizable Triggers

Abstract

Acoustic foundation models (AFMs) have democratized acoustic applications, enabling powerful models for tasks ranging from speech recognition to speaker verification with minimal resources. However, the security of applications based on AFMs remains largely underexplored. Our work addresses this gap by proposing the Foundation Acoustic model Backdoor (FAB) attack, demonstrating that state-of-the-art AFMs are susceptible to backdooring under practical settings. Despite making minimal assumptions about adversary capabilities (e.g., no access to pre-training data), we show that FAB preserves benign performance while inducing backdoors that survive fine-tuning and cause significant degradation across diverse downstream tasks when activated. Notably, FAB utilizes task-agnostic, physically realizable, inconspicuous, and sync-free triggers (e.g., a background siren). We evaluate FAB using two leading AFMs, nine downstream tasks, and four different triggers. We further demonstrate its effectiveness against established defenses and across both digital and physical domains. While extensive end-to-end fine-tuning can mitigate FAB, such a defense is resource-intensive and task-specific. Our work highlights critical risks to AFMs and calls for advanced defenses.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Sound

• arXiv preprint · 7 October 2026

  VM-ARRAYDPS: Virtual Microphone Augmented Diffusion Posterior Sampling for Unsupervised Blind Speech Separation

  Jingqi Sun, Haozhan Tang, Shulin He and 1 other
• arXiv preprint · 8 October 2026

  Local Prototype Reconstruction for Text-Compatible Speech-to-LLM Bridge Pretraining

  Xinnian Zhao, Chia-Hua Wu, Pu Wang and 1 other
• arXiv preprint · 7 October 2026

  Boundary-Free Contextual Biasing: Depth-Adaptive Gating and Reading-Space Matching for Unsegmented Languages

  Muhammad Huzaifah, Yu Pan, Zachary Yeo and 2 others
• arXiv preprint · 8 October 2026

  Selective Listening: Mechanism-Guided Control of Audio Influence in Large Audio-Language Models

  Yulin Sun, Kele Xu and Yong Dou
• arXiv preprint · 7 October 2026

  Mitigating Accent-Language Confusion in Self-Supervised Speech Representations for Language Identification

  Minu Kim, Jihwan Lee, David R. Mortensen and 1 other

All new papers in Sound