Mitigating Accent-Language Confusion in Self-Supervised Speech Representations for Language Identification

Abstract

Spoken language identification (LID) aims to recognize the target language regardless of accent. In practice, however, LID models fine-tuned from self-supervised speech representations frequently confuse accents with languages, misclassifying non-native (L2) speech as the speaker's first language (L1). We show that non-native speech representations lie between native target-language and native L1 poles, causing systematic misclassification. To address this, we introduce a geometric projection that estimates an L1-bias direction solely from native speech and removes it before the frozen LID head. Across five MMS-LID models and non-native corpora, this projection substantially improves target language identification for L2-accented speech while preserving predictions for native speech. These results show that accent-induced L1 bias can be corrected directly within the representation space without L2 training data or model adaptation.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Audio & Speech Processing

• arXiv preprint · 7 October 2026

  Dialect-Robust Speech Language Models with Synthetic Pseudo-Dialect Augmentation

  Shunsuke Mitsumori, Tomoya Mizumoto and Yusuke Fujita
• arXiv preprint · 8 October 2026

  Beyond Speech Captions: Speech-Rewarded Style Planning for Conversational Text-to-Speech

  Shiao Zhu, Lianbo Liu, Sizhen Lyu and 3 others
• arXiv preprint · 7 October 2026

  VM-ARRAYDPS: Virtual Microphone Augmented Diffusion Posterior Sampling for Unsupervised Blind Speech Separation

  Jingqi Sun, Haozhan Tang, Shulin He and 1 other
• arXiv preprint · 8 October 2026

  SteerablePlex: Can We Steer Full-Duplex Models?

  Haolong Zheng, Maike Züfle, Dominik Macháček and 6 others
• arXiv preprint · 7 October 2026

  Boundary-Free Contextual Biasing: Depth-Adaptive Gating and Reading-Space Matching for Unsegmented Languages

  Muhammad Huzaifah, Yu Pan, Zachary Yeo and 2 others

All new papers in Audio & Speech Processing