arXiv preprint ·
Tackling the Modality Inhibitance Effect with Wavelet-based Modality Integration in Multi-modal Recommendation
- Published
- Source
- arXiv preprint, posted before peer review
- DOI
- 10.1109/TKDE.2026.3737154
- Original
- Read it at arXiv
- Topics
Abstract
Harnessing rich modality features has recently gained prominence in multi-modal recommendation systems (MRSs). To delineate user modality preferences, existing works focus on modality fusion, which can be achieved via attentive summation or concatenation. In this work, we introduce the modality inhibitance effect - a phenomenon which limits existing MRSs when these models transit from dual-modal to tri-modal configurations resulting in significant performance degradation. In particular, apart from the modal-specific contamination encapsulated in the newly introduced modality, the inclusion of new features results in excessive informational redundancy, thereby severely impeding effective integration within current approaches. To address the modality inhibitance effect, we propose a new multi-scale modality wavelet (MMWave) multi-modal recommender, which aims to fully capitalize on essential modality features and suppress modal-specific noise. This is acheived by employing wavelet decomposition from a multi-scale (time \& frequency) perspective, ensuring that only essential (non-redundant) features of each modality are extracted. We then account for the latent associations between item modality features by designing a new structure-aware multi-modal graph learning module that captures high-order latent structural information pertaining to items. To modulate the relative contributions of modality features and achieve effective integration, we then propose a new adaptive modality regulator component that employs a new cross-weight integration strategy. Experiments conducted on four real-world datasets validate the efficacy of our proposed model. The source code for this work has been made publicly available at https://github.com/kennethorq/MMWave.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Information Retrieval
Elephant in the Fridge: Constant-Memory Frame Packing for Long Video Understanding
Decomposing and Predicting Annotation Disagreement in Harmful Content Across Languages
EventLens: Event-Structure Reinforcement Learning for Video Understanding
GeoReader: Learning Latent Geometry for Spatial Reasoning in Vision-Language Models
OmniCompass: A Holistic Benchmark for Omni-Modal Video Grounding and Understanding
Get the few papers worth your time in Information Retrieval every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.