SAVU-BENCH: A Real-World Benchmark for Spatial Audio-Visual Understanding

Abstract

Spatial audio-visual understanding requires models to recognize not only what is present, but also where events occur and how they relate across modalities. Existing benchmarks often rely on simulated scenes, evaluate isolated spatial skills, and provide limited diagnostic insight into failure modes. We introduce SAVU-Bench, a real-world benchmark that systematically evaluates spatial audio-visual understanding across three capability levels and seven evaluation tasks. We further introduce SAVU-Diag, a scene-linked diagnostic set that decomposes reasoning questions into their prerequisite grounding and alignment sub-tasks. Evaluation of 12 representative models on SAVU-Bench reveals that while visual spatial grounding is relatively mature, spatial perception involving audio remains a primary bottleneck. SAVU-Diag further demonstrates that most reasoning errors co-occur with failures on these prerequisite tasks, though reasoning gaps persist even when prerequisites are correctly resolved. Motivated by these findings, we introduce SAVU-EA, a training-free evidence-augmented baseline that makes spatial cues more explicit. While SAVU-EA substantially improves spatial grounding and joint matching, high-level spatial reasoning remains challenging. Our findings highlight the urgent need for both robust spatial audio perception and deeper integration of cross-modal spatial relations.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Sound

• arXiv preprint · 7 October 2026

  VM-ARRAYDPS: Virtual Microphone Augmented Diffusion Posterior Sampling for Unsupervised Blind Speech Separation

  Jingqi Sun, Haozhan Tang, Shulin He and 1 other
• arXiv preprint · 8 October 2026

  Local Prototype Reconstruction for Text-Compatible Speech-to-LLM Bridge Pretraining

  Xinnian Zhao, Chia-Hua Wu, Pu Wang and 1 other
• arXiv preprint · 7 October 2026

  Boundary-Free Contextual Biasing: Depth-Adaptive Gating and Reading-Space Matching for Unsegmented Languages

  Muhammad Huzaifah, Yu Pan, Zachary Yeo and 2 others
• arXiv preprint · 8 October 2026

  Selective Listening: Mechanism-Guided Control of Audio Influence in Large Audio-Language Models

  Yulin Sun, Kele Xu and Yong Dou
• arXiv preprint · 7 October 2026

  Mitigating Accent-Language Confusion in Self-Supervised Speech Representations for Language Identification

  Minu Kim, Jihwan Lee, David R. Mortensen and 1 other

All new papers in Sound