arXiv preprint ·

Federated Semantic Residuals for Multimodal Recommendation

Zhiwei Li, Guodong Long, Chengqi Zhang and Jing Jiang

Published
Source
arXiv preprint, posted before peer review
Original
Read it at arXiv
Topics
Information Retrieval

Abstract

Federated Recommendation Systems (FedRSs) learn collaborative scores from interaction histories on device and rank items by them, so a higher score means a higher rank. Item text and images add semantic information that can reorder the list. Existing Federated Multimodal Recommenders (FedMRs) fuse this content into their models, which can obscure how content reorders the list. We therefore propose the SEmantic Residual Adapter (SERA), which keeps content out of an existing FedRS and adds semantic residual scores to its collaborative scores. Content can then lift an item above another only when its semantic residual score exceeds the other's by more than their collaborative score gap. This score grows with the item's content similarity to the user's interaction history and is capped at a residual bound. We prove that for any content, an item can enter the list only if its collaborative score is within twice this bound of the lowest one in the list. A larger bound lets content lift more items, including irrelevant ones, so the bound trades off how far content reaches against accuracy. With a validated bound, SERA improves all three FedRSs on all six datasets without adding personalized parameters. It outperforms FedMRs in most comparisons and lifts some FedRSs above centralized baselines.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

Read it on ReadSearch

Each opens after you create an account, and brings you back to this paper.

Already a reader? Sign in

All new papers in Information Retrieval

Get the few papers worth your time in Information Retrieval every morning.

ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.

Papers belong to their authors and publishers; every page here links to the original. All research topics