STEER: Reducing Inference Cost in Relational Foundation Models through Semantically Informed Sampling

Abstract

Relational foundation models (RFMs) are pretrained once on a collection of relational databases and prediction tasks, and then applied zero-shot to previously unseen databases and tasks. To make a prediction for a target row, an RFM samples a neighborhood of rows linked to that row through foreign keys and uses this neighborhood as its inference context. Lowering inference cost is an important goal for any foundation model, and for RFMs this cost grows with the size of the context. The simplest ways to shrink the context is to drop some of the sampled rows, but this ignores the semantics of the database schema, so it is as likely to discard informative rows as uninformative ones. We propose STEER, a sampling approach that shrinks the inference context by concentrating it on the tables most relevant to the prediction task at hand. STEER obtains relevance information by prompting a large language model to rank the foreign-key edges of the database schema into relevance tiers for the given task, and then maps each tier to a probability of following that edge during traversal. Because the ranking uses only the schema, it is computed once per task and reused across all subsequent predictions, amortizing its cost. We evaluate STEER on three state-of-the-art RFMs (RT, RT-J, and Griffin) and show that it reduces inference context size by about 40% on average while maintaining, and in some cases improving, prediction accuracy.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Databases

• arXiv preprint · 1 October 2026

  HakiCC: LLM-Driven Multi-Agent Design and Optimization of Concurrency Control Protocols

  Farzad Habibi, Juncheng Fang and Faisal Nawab
• arXiv preprint · 2 October 2026

  AptMQL-Bench: From Text-to-SQL to Text-to-MQL via Access-Pattern Schema Design and Data-Preserving Migration

  Hy Nguyen, Nabi Rezvani and Robin Vujanic
• arXiv preprint · 2 October 2026

  Axient: Manifest-Bound Evidence for On-Chain Financial Protocols: Seven-Layer Derivation, Correlation, Tamper Rejection, and Reproducible Claim Promotion

  Maksym Nechepurenko
• arXiv preprint · 1 October 2026

  JoinGR: Learning to Traverse Join Graphs for Table Retrieval

  Sandipan De, Abhijit Chakraborty, Sambaran Bandyopadhyay and 1 other
• arXiv preprint · 2 October 2026

  Zephon: Elastic Determinism for Online, Stateful Foundation Model Data Loading Pipelines

  Maximilian Böther, Josh Wills, Ties Robroek and 14 others

All new papers in Databases