arXiv preprint ·
DP-Rec: Towards Dynamic Patching for Efficient Long-Sequence Recommendation
- Published
- Source
- arXiv preprint, posted before peer review
- DOI
- 10.1145/3773078.3831823
- Original
- Read it at arXiv
- Topics
Abstract
Transformers have redefined sequential recommendation by effectively modeling dynamic user behaviors and long-range dependencies. However, they remain inherently inefficient: standard architectures operate at a fixed rate, allocating comparable computation to every item in a user's history regardless of its information content. This leads to prohibitive computational overhead on long sequences and increased sensitivity to behavioral noise. To address this, practitioners often resort to lossy sequence compression, staged modeling, or truncation. This limits the model's ability to leverage the full context of long histories during inference. Inspired by the recent success of Byte Latent Transformer, we propose DP-Rec, a dynamic latent patching architecture for recommendation. DP-Rec shifts from item-level modeling to patch-level modeling by segmenting interaction sequences using contrastive entropy surprise to identify informative behavioral boundaries. A lightweight patch encoder compresses these temporally contextualized segments into a reduced set of dynamic latent behavior vectors, which are then processed by a larger latent transformer and decoded for next-item prediction. Extensive experiments show that, under constrained computational budgets, DP-Rec scales effectively to long sequences and achieves a superior efficiency-accuracy trade-off over both non-compressed and fixed-size compression baselines.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Machine Learning
Rethinking Cross-Channel Importance in Time-Series Forecasting
Overview and Analysis of the RecSys Challenge 2026: Conversational Music Recommendation
Algorithmic Harms Associated with Generative Model-Augmented Recommendation Systems
Graph Memory: Spectral Associative Memory via Dirichlet Energy
Inspire: Benchmarking Scientific Literature Search for Open Research Problems
Get the few papers worth your time in Machine Learning every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.