16–20 Jun 2025
THotel, Cagliari, Sardinia, Italy
Europe/Rome timezone

🎙️ TrackFormers Part 2: Enhanced Transformer-Based Models for High-Energy Physics Track Reconstruction

18 Jun 2025, 16:59
20m
T1c

T1c

Parallel talk Inference & Uncertainty 🔀 Inference & Uncertainty

Speaker

Yue Zhao (SURF, the Netherlands)

Description

High-Energy Physics experiments are rapidly escalating in generated data volume, a trend that will intensify with the upcoming High-Luminosity LHC upgrade. This surge in data necessitates critical revisions across the data processing pipeline, with particle track reconstruction being a prime candidate for improvement. In our previous work, we introduced "TrackFormers", a collection of Transformer-based one-shot encoder-only models that effectively associate hits with expected tracks. In this study, we extend our earlier efforts by incorporating loss functions that account for inter-hit correlations, conducting detailed investigations into (various) Transformer attention mechanisms, and a study on the reconstruction of higher-level objects. Furthermore we discuss new datasets that allow the training on hit level for a range of physics processes. These developments collectively aim to boost both the accuracy, and potentially the efficiency of our tracking models, offering a robust solution to meet the demands of next-generation high-energy physics experiments.

AI keywords transformers, inference, pattern recognition, foundation models

Primary authors

Sascha Caron (High-Energy Physics, Radboud University, The Netherlands and National Institute for Subatomic Physics (Nikhef), The Netherlands) Nadezhda Dobreva (Institute for Computing and Information Sciences, Radboud University, The Netherlands) José Martín-Guerrero (Intelligent Data Analysis Laboratory (IDAL), Department of Electronic Engineering, ETSE-UV, University of Valencia, Spain and Valencian Graduate School and Research Network of Artificial Intelligence (ValgrAI), Spain) Uraz Odyurt (Faculty of Engineering Technology, University of Twente, The Netherlands and National Institute for Subatomic Physics (Nikhef), The Netherlands) Slav Pshenov (The Netherlands and National Institute for Subatomic Physics (Nikhef), The Netherlands) Roberto Ruiz de Austri (Instituto de Física Corpuscular, University of Valencia, Spain) Evgeniy Shalugin (Radboud University) Zef Wolffs (Institute of Physics, University of Amsterdam, The Netherlands and National Institute for Subatomic Physics (Nikhef), The Netherlands) Yue Zhao (SURF, the Netherlands)

Presentation materials

There are no materials yet.