arXiv preprint ·
Adaptive Sparsity Optimization with Learnable Soft Top-K and Per-Term Thresholding for Efficient Retrieval
- Published
- Source
- arXiv preprint, posted before peer review
- DOI
- 10.1145/3805712.3809625
- Original
- Read it at arXiv
- Topics
Abstract
Recent work on neural sparse retrieval has demonstrated strong relevance by leveraging Large Language Models (LLMs) for semantic term expansion. However, learned models paired with previous sparsification techniques still yield overly long document and query vectors partly due to a large LLM vocabulary, imposing a serious challenge to retrieval time and space efficiency. This paper proposes a scheme for optimizing model sparsity through a synergy of adaptive strategies, including learnable soft top-K, per-term thresholding, and FLOPs regularization to increase the sparsity of query and document vectors. Experimental results with Lion-SP model on the MS MARCO and BEIR datasets demonstrate that the proposed scheme can outperform the baselines by significantly reducing the average query and document lengths. Our scheme can achieve much shorter retrieval latency and lower storage cost while maintaining highly competitive relevance.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Information Retrieval
CANOPY: Adaptive-Granularity Evidence Compression for Multimodal RAG
Asterism: Exploring and Synthesizing Scattered Observations into Literature-Grounded Hypotheses and Theories
RPTune: Learned Context Curation for LLM Catalog Search
Learning Query Encoders Can Be Hard Even When Vector Retrieval Is Geometrically Easy
The Other Half of Workflow Portability: Evidence-Backed HPC Site Profiles with Agentic Discovery
Get the few papers worth your time in Information Retrieval every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.