PACERec: Progressive Adaptation of LLM Item Embeddings with Collaborative Evidence for Recommendation

Abstract

Large language model (LLM) embeddings have been increasingly adopted in sequential recommendation to encode static item attributes and alleviate the limitations of item ID embeddings under sparse interactions. However, these embeddings typically capture only static content similarity while neglecting sequential transitions, and since their adaptation quality relies on sparse per-item updates or global geometric calibration, existing methods still struggle to explicitly transfer preceding interaction contexts from frequent to long-tail items under unevenly distributed behavioral evidence, limiting recommendation effectiveness across the catalog. To address this challenge, we propose PACERec, an ID-free progressive adaptation framework that incorporates preceding interaction contexts into semantic representation adaptation by learning a shared velocity field from items with sufficient interactions via frequency-weighted flow matching. In this way, PACERec progressively guides static LLM embeddings toward collaborative behavioral targets while preserving original item semantics, overcoming sparse per-item updates to effectively generalize sequential transition patterns to long-tail items for both user modeling and candidate scoring. Extensive experiments on three real-world datasets across three sequential backbones demonstrate the superiority of our method over competitive baselines in both overall and long-tail recommendation.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Information Retrieval

• arXiv preprint · 2 November 2026

  Multi-Teacher Reasoning Distillation for LLM Recommendation with Self-Exploration

  Liangbo Ning, Siyuan Liang, Yi Zhou and 4 others
• arXiv preprint · 3 November 2026

  IDs That Mean Something: A Hands-On Tutorial on Semantic IDs for Recommender Systems

  Roger Zhe Li, Aghiles Salah, Mete Sertkan and 4 others
• arXiv preprint · 2 November 2026

  RecRSI: Mechanism-Guided Discovery of Recommendation Algorithms

  Tingran Gan, Zhouziyue Lu, Dian Jin and 7 others
• arXiv preprint · 3 November 2026

  IntentGEO: Intent-aware Generative Engine Optimization for Recommendation

  Runlin Lei, Shiqi Zhang, Xiaokui Xiao and 1 other
• arXiv preprint · 2 November 2026

  SearchInject: Retrieval Exposure Control for Indirect Prompt Injection in Language-Model Search

  Kainan Zhou, Gangzhen Qian, Janet Sung and 3 others

All new papers in Information Retrieval