arXiv preprint ·
Gestalt: a meta-foundation model for astronomy
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
The Platonic Representation Hypothesis predicts that sufficiently scaled foundation models converge on a shared representation of the world. As each non-converged model gives a noisy view of a common structure when passed the same input, we ask whether we can combine models into a representation that outperforms its individual components. We test this on galaxies: we embed images via a basket of 22 frozen foundation models from eight families, whiten each view, and take a randomised SVD of the embedding concatenation. The resulting 1024-dimensional embedding outperforms every basket member on 19/21 of our tested metrics for physical property and galaxy morphology estimation for HSC, JWST, and DESI Legacy Survey imagery. We find that performance rises with basket size and basket architectural diversity, and that the meta-foundation model's performance transfers across astronomical surveys. We conclude that a useful astronomical foundation model can be assembled from existing generalist models with no training required beyond a single unsupervised projection. By leveraging the community's already-spent work, we save a lot of compute: a fresh pre-train of a comparable single-domain model would cost $\mathcal{O}(10^{4}$--$10^{5})$ A100 GPU hours (emitting several tonnes of CO$_2$eq.), whereas assembling Gestalt requires minutes on a single machine.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Instrumentation & Methods for Astrophysics
Everything Everywhere All At Once: A Hierarchical Framework for Mapping Anisotropies in the Local Universe
ArxSP: A Python-Based Modular Application for the Reduction of Digitized Archival Spectra
A Bayesian Inference Framework for Binary Lens Events Fully Incorporating Higher-Order Effects
MADGRAV: a multilevel anomaly-detection pipeline for gravitational-wave searches applied to LIGO data
Morphological Identification of Dynamical Regimes in MHD Turbulence with ScaleAware-JEPA
All new papers in Instrumentation & Methods for Astrophysics
Get the few papers worth your time in Instrumentation & Methods for Astrophysics every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.