BELXTR: Biomedical Entity Linking via Contextualized Token Retrieval

Abstract

Biomedical Entity Linking disambiguates mentions to entities in a knowledge base (KB), making it the cornerstone of information extraction pipelines. While embedding-based models are a popular approach for the task, they suffer from a key limitation. They compress mentions (and entities) into a single vector, forcing the model to average away crucial fine-grained differences. We present BELXTR, a novel embedding model based on the multi-vector (a.k.a. late interaction) architecture, which allows to leverage token-level matching information. BELXTR extends the original XTR model to biomedical entity linking by integrating an existing task-specific training objective and exploring active query expansion. Experiments across ten corpora and five KBs show that BELXTR improves upon current state-of-the-art in half of the corpora with an average improvement of 5pp recall@1. The largest gains are reported on the challenging cross-species gene disambiguation subtask, where BELXTR outperforms an LLM-powered retrieve-and-rerank pipeline and closely approaches a specialized rule-based system. Our results highlight multi-vector models as a practical alternative to hard-to-maintain rule-based systems or in scenarios where LLM-based reranking is too costly as in PubMed-scale mining. The code to reproduce our experiments can be found at: https://github.com/sg-wbi/belxtr.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Computation & Language / NLP

• arXiv preprint · 22 September 2026

  Matryoshka attribution: Learning to attribute language model outputs to representations and weights

  Aryaman Arora, Kirill Acharya, Nathan Hu and 4 others
• arXiv preprint · 23 September 2026

  Realize What Matters: Principled Context Representation for Large-Scale Reasoning

  Michael Theologitis, Dean Light, Shuyue Stella Li and 3 others
• arXiv preprint · 22 September 2026

  Compressing Long Context into Answer-Aligned Memory Embeddings for LLM Inference

  Md Mostafizer Rahman, Md Faizul Ibne Amin, Md Shahajada Mia and 2 others
• arXiv preprint · 23 September 2026

  Beyond Overlap: Estimating the Causal Effect of Benchmark Exposure

  Divyansh Singh
• arXiv preprint · 22 September 2026

  Rewired or Gated? How Instruction Tuning Shapes Knowledge-Conflict Circuits in LLMs

  Shubham Santosh Pandere, Gautam Ranka, Ritika Varshney and 3 others

All new papers in Computation & Language / NLP