arXiv preprint ·
MECT: Mixture of Experts with CNN-Transformer Network for Speaker verification
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
In this paper, we propose MECT, a speaker verification model that integrates the Mixture-of-Experts (MoE) mechanism into a CNN-Transformer backbone with optimized block structure and stacking scheme. Specifically, we investigated four MoE variants that span utterance-level and frame-level granularity with dense and sparse routing strategies. The MoE mechanism proves to be effective over the baseline without MoE with only a small increase in parameters. We further scale MECT to a series of model sizes, all maintaining compact parameters and low computational complexity. In particular, MECT-B2 achieves state-of-the-art performance on VoxCeleb1 and delivers strong results on CN-Celeb, demonstrating its effectiveness across diverse datasets. In addition, we establish a streaming inference paradigm through causal retraining, which maintains strong performance at a chunk size of 100ms.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Sound
AURA: Uncertainty-Routed Activation Editing for Acoustic Grounding in Speech Foundation Models
Synthesis and editing of multi-instrument audio mixtures using scalar-quantised latents with MIDI Span conditioning
SE-MSB: End-to-End Unpaired Speech Enhancement using Mamba Schrödinger Bridges
P2Flow: Phoneme-aware Progressive Flow Matching for Extreme Speech Super-Resolution
Enriching Speech Emotion Representations with Conversational Context
Get the few papers worth your time in Sound every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.