arXiv preprint ·
Prompting Particle Physics: Tokenized Multi-modal Foundation Models for Combinatorially Many Tasks
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Reconstruction and simulation at a collider experiment are long chains of specialised algorithms, each tuned to a single step. We explore how one model can serve many of those steps at once, while still producing the intermediate objects (tracks, calorimeter cells, clusters, particles and jets) that make the chain interpretable. To do so, we represent every object in a jet in a single shared token vocabulary and train one model to map any subset of these modalities to any other. A task is then only a choice of which modalities to provide and which to request: particle flow, detector simulation and charged energy subtraction are all directions through the same set of weights. We train over all modality combinations, with a decoder emitting tokens either autoregressively or in parallel. With tokenisation, both architectures train stably with little tuning. In evaluations, both models produce realistic reconstruction and simulation objects, with the autoregressive model particularly faithful to output from Geant4. The autoregressive model also outperforms a state-of-the-art particle flow algorithm on many typical jet reconstruction metrics.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in High Energy Physics - Phenomenology
Fast and Precise Learned Charged-Particle Trajectory Regression at the Large Hadron Collider
Identifiability Limits of Gravitational Wave Phase Deviations: Multiclass Classification with a Multihead Neural Network
A citizen science behavioural dataset of an urban collective-risk dilemma on air pollution mitigation under resource inequality
Assessing the Impact of Fleet Size on Crowdsourced Mapping Using a Dissimilarity Measure
Hybrid Neural Simulation-Based Inference for Robust Applications and Limited-Budget Scenarios
Get the few papers worth your time in High Energy Physics - Phenomenology every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.