arXiv preprint ·
Identifying Scientifically Interesting Galaxies with Vision-Language Models
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Anomaly searches in large astronomical image datasets aim to identify rare objects for follow-up investigation. Yet the objects that are most statistically unusual are not necessarily those of greatest scientific relevance. We investigate whether pretrained vision-language models can directly assess scientific interest from natural-language instructions, enabling galaxy images to be ranked without labeled examples. We evaluate models on a 20,000-image Hubble Space Telescope sample that includes 167 reference anomalies previously identified through machine learning and expert inspection. By scoring images for scientific interest, Gemini 3.1 Flash-Lite places 98.2% of the reference anomalies within the highest-ranked ~2,000 images, at a present-day inference cost of approximately $5.05 per 10,000 images. We recover known gravitational lenses, jellyfish-galaxy candidates, and galaxies with visible jets, and release 102 high-scoring candidates for further investigation. These results show that an off-the-shelf vision-language model, without any training on the target data, offers a practical way to rank large image datasets by scientific relevance rather than rarity. The project code is available at https://github.com/TheCheng2005/Galaxy-Anomaly-Search/
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Instrumentation & Methods for Astrophysics
A Hierarchical Bayesian Differential Calibration of the Gaia DR3 Parallax Zero Point Using Galactic Globular Clusters
PyMsOfa 2.0: A Pure-Python Implementation of the IAU Standards of Fundamental Astronomy Service
Quantum Annealing for Gamma-ray Source Detection and Localization with AGILE Data
GRAVITY-RESOLVE: A comprehensive image reconstruction tool for Galactic Center observations with GRAVITY
Neglecting Dynamical Microlensing Can Bias Accretion Disk Size Measurements at the Population Level
All new papers in Instrumentation & Methods for Astrophysics
Get the few papers worth your time in Instrumentation & Methods for Astrophysics every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.