Audio-R1: Audio Reasoning through Reinforcement Learning on Self-Supervised Tasks

Abstract

Reasoning is increasingly important for large audio-language models (LALMs), yet remains relatively underexplored compared with text-only and vision-language models. We introduce Audio-R1, a reinforcement learning (RL) post-training framework that revisits audio self-supervised learning as a source of verifiable rewards for improving audio understanding and reasoning task performance. Audio-R1 uses answers automatically determined during the construction of self-supervised tasks to verify model responses and compute rewards. Experiments across multiple LALMs and diverse audio benchmarks show consistent performance gains, while ablations demonstrate the benefits of each self-supervised task and additional gains from joint training. While both supervised fine-tuning and Audio-R1 improve self-supervised task accuracy, Audio-R1 further improves performance on downstream tasks distinct from the training tasks. These results highlight the potential of RL post-training with self-supervised audio tasks to improve downstream performance and reasoning-trace quality.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Sound

• arXiv preprint · 25 October 2026

  In-Context Adapter Generation for Compositional Generalization in Large Audio Language Models

  Yiwei Guo, Siqi Huang, Bohan Li and 4 others
• arXiv preprint · 26 October 2026

  Heard Enough to Act: Early Tool Calling in Spoken Dialogue Systems

  Yizhou Peng, Chen Chen, Donghang Wu and 2 others
• arXiv preprint · 26 October 2026

  Gangqinpu: A Multi-Genre, Multi-Task Piano Dataset with Aligned Audio, MIDI, and Musical Scores

  Wei Zeng, Anvay Mathur and Ye Wang
• arXiv preprint · 24 October 2026

  RoleHear: Pseudo-Labeling for Semi-Supervised Role-Attributed Streaming Speech Recognition

  Zefang Liu, Chenyang Zhu, Sangwoo Cho and 4 others
• arXiv preprint · 26 October 2026

  When the Persona Contradicts the Line: Diagnosing Plan-to-Synthesis Failures in Chain-of-Thought TTS

  Joonyong Park and Jerry Li

All new papers in Sound