arXiv preprint ·
VOSSA: Voiceprint Optimization for Streaming Speech Architectures
- Published
- Source
- arXiv preprint, posted before peer review
- DOI
- 10.21437/Interspeech.2026-2763
- Original
- Read it at arXiv
- Topics
Abstract
Real-time voice conversion (VC) systems commonly rely on pretrained speaker embeddings from automatic speaker verification (ASV) models. While effective for speaker discrimination, these embeddings are trained to remain stable across phonetic and prosodic variations within-speaker, which may conflict with frame-level acoustic generation in streaming constraints. To address this issue, we propose VOSSA (Voiceprint Optimization for Streaming Speech Architectures), a speaker representation framework that extracts speaker information from intermediate content encoder layers and aggregates using attentive statistics pooling. The embedding is trained jointly with VC objectives, removing the need for a separate speaker encoder. Across six datasets, VOSSA improves F0 dynamics and vowel-discriminative acoustic cues while maintaining comparable NISQA-MOS, WER, and speaker similarity. Perceptual tests further indicate improvements in naturalness, speaker similarity, intelligibility, and vibrancy.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Audio & Speech Processing
A barrier or a booster? Familiarity effects on Mandarin emotion prosody recognition using AI-powered voice cloning
Child-Adapted Structured Phonological Representations for Interpretable Speech Sound Analysis
Talk2Agent: Benchmarking Voice Interfaces for Text Agents
Watch Your Speech: Text-aware Video-to-Speech Synthesis with Textual Conditioning
Code-Switching Spoken Language Identification as Multi-Label Set Prediction
Get the few papers worth your time in Audio & Speech Processing every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.