arXiv preprint ·
Synthesis and editing of multi-instrument audio mixtures using scalar-quantised latents with MIDI Span conditioning
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Music creation often involves iterative refinement, changing selected musical details while retaining the rest. To support such refinement, we introduce SpanSynth-Edit, a flow-matching model for MIDI-guided synthesis and editing of multi-instrument audio mixtures using low-frame-rate scalar-quantised latents. MIDI Span encodes instrument-labelled note lifecycles as unordered event sets with continuous-valued attributes and pools each set into one conditioning vector per audio-latent frame. The model uses contextual audio for instrument-specific timbre guidance and supports editing by resynthesising the target region from revised MIDI. Experiments on single- and multi-instrument benchmarks show competitive performance and demonstrate within-frame onset control. We also discuss limitations of transcription-based note-adherence evaluation.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Sound
Physiologically Informed Digital Auscultation for Pneumonia Detection in Long-term Care Residents
SE-MSB: End-to-End Unpaired Speech Enhancement using Mamba Schrödinger Bridges
Anomaly-Free Self-Optimization via AUC Bounds
Enriching Speech Emotion Representations with Conversational Context
Spooftral: Can Voxtral Audio-Language Model Detect Speech Spoofing?
Get the few papers worth your time in Sound every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.