Augmenting Large Audio-Language Models with Frame-Level Grounding for Fine-Grained Temporal Perception

Abstract

Large Audio-Language Models (LALMs) have substantially advanced general audio understanding, yet they remain limited in fine-grained temporal perception, particularly in precise event localization. Existing approaches primarily post-train LALMs to predict event boundaries as timestamp tokens. However, this generative formulation lacks explicit correspondence between the timestamp predictions and fine-grained acoustic evidence, limiting the precision and reliability of temporal localization. To address this issue, we augment the LALM with a dedicated frame-level grounding model while leveraging its semantic modeling capability to represent the event query. Specifically, the frozen LALM encodes the event query with audio as context, and the grounding model combines these query representations with fine-grained audio features to localize the target event at the frame level. Extensive experiments across diverse temporal grounding benchmarks demonstrate strong and consistent improvements over existing methods. Further evaluation shows that the grounding model can provide temporal evidence to support downstream reasoning.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Sound

• arXiv preprint · 14 September 2026

  CAL-MOS: Bridging Layers with Adapters for Robust MOS Prediction Across Speech Foundation Models

  Alef Iury Siqueira Ferreira, Pedro Lustosa Rege Botelho, Fernanda Silva and 5 others
• arXiv preprint · 15 September 2026

  CLASH: Counterfactual Auditing of Lexical and Prosodic Reliance in Spoken Sarcasm Detection

  Qiyang Sun, Xudong Li, Yupei Li and 4 others
• arXiv preprint · 14 September 2026

  Learned Bow Control on a Measured Bowed-String Model: a Revised Minimum-Bow-Force Law, a Recurrent Controller, and the Domain of a Supervision Ceiling

  Homayoon Beigi and Grace Conneely
• arXiv preprint · 15 September 2026

  Structure Across Voices: Comparing acoustic-event type accumulation and sequence dependence across four vocal repertoires using frozen audio encoders

  Mudit Sinha and Sanika Chavan
• arXiv preprint · 14 September 2026

  Typhoon ASR Streaming: Steerable Low-Latency Thai Speech Recognition with Real-Time Shallow Fusion

  Warit Sirichotedumrong, Tanawin Samutsin, Shah Faisal Wani and 2 others

All new papers in Sound