OpenAlex ·
Do Tabular Foundation Models Know Physics? Contamination, Units, and the Deterministic Limit
- Published
- Source
- OpenAlex
- Published in
- arXiv (Cornell University)
- DOI
- 10.48550/arxiv.2609.02766
- Original
- Read it at the publisher
- Topics
Abstract
Tabular foundation models (TFMs) learn to fill in tables the way language models fill in text --- and tables are arguably the format in which most physical measurement arrives. Did they learn any physics in the process? They are Bayesian by construction, so the question is what their prior contains. We probe it directly, evaluating four of them ($\texttt{TabPFN-3}$, $\texttt{TabICLv2}$, $\texttt{TabDPT}$ and $\texttt{Real-TabPFN-2.5}$) against six baselines on datasets sampled from 316 physical equations, in and out of domain. TFMs dominate, out of the box and after tuning. But they struggle to represent noiseless deterministic mechanisms in their uncertainty, and show no sign of exploiting physical units: they interpolate physics without yet being able to act as physical models.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Materials Science
Ancilla mediated steady-state engineering in open quantum systems
Pole-Zero Geometry, Model Reduction, and Identifiability in Sensory Adaptation
Fisher Information Dynamics: A Kinematic Framework for Phase Space Ordering with Applications to Shock Layers and Turbulence
iPINN for Broadband CARS Phase Retrieval: A Framework for Function Approximation and Inverse Modeling Problems in Nonlinear Spectroscopy
The Spectral Skeleton of Chaos: Koopman Wave Packets on Poincaré Sections
Get the few papers worth your time in Materials Science every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.