16–20 Jun 2025
THotel, Cagliari, Sardinia, Italy
Europe/Rome timezone

Electron and Proton Classification with AMS ECAL Using Convolutional Vision Transformers and Domain Adaptation

Not scheduled
20m
THotel, Cagliari, Sardinia, Italy

THotel, Cagliari, Sardinia, Italy

Via dei Giudicati, 66, 09131 Cagliari (CA), Italy
Poster + Flashtalk Inference & Uncertainty

Speaker

Berk Türk (Middle East Technical University)

Description

Alpha Magnetic Spectrometer (AMS-02) is a precision high-energy cosmic-ray experiment on the ISS operating since 2011 and has collected more than 228 billion particles. Among them, positrons are important to understand the particle nature of dark matter. Separating the positrons from cosmic background protons is challenging above 1 TeV. Therefore, we use state-of-the-art convolutional and transformer models, CoAtNet and Convolutional Vision Transformer (CvT), that employ the shower signals from the ECAL to classify the electrons/positrons in the dominant cosmic proton background. We created sets of electrons, positrons, and protons events from the ISS data and Monte Carlo Simulation in the energy range between 0.2-2 TeV by applying various data quality cuts on reconstructed variables obtained from the sub-detectors. Initially, since ECAL showers are not tunned in the AMS MC, our MC trained models show a lower proton rejection on the ISS data. To accommodate the difference between the training and test domain distributions, we implemented domain adaptation with the CoAtNet and CvT to mitigate this dataset bias/domain shift. We also trained domain adaptation with a set of well-reconstructed 1 electron charge ISS events without electron/proton labels at TeV energy order as the target dataset. We evaluated the models between 1-2 TeV energy using ISS and MC events with the proton rejection vs. electron efficiency and proton rejection vs. energy at near 90% electron efficiency plots. We performed experiments using various training and validation dataset combinations and other hyperparameters with the CvT and CoAtNet. Among them, the best models are obtained with the 1-2TeV MC events as training data and half of the labeled 1-2 TeV ISS events as validation data. Using domain adaptation with the CoAtNet, we obtained a maximum proton rejection at 88% electron efficiency on the ISS data. We also rejected all of the MC protons at higher than 99.8% electron efficiency with both CvT and CoAtNet. At 90% electron efficiency, the proton rejection power of the CvT and CoAtNet is 5 and 7 times higher than the proton rejection power of the AMS's Boosted Decision Tree and ECAL Likelihood Estimator for MC events in the 1-2 TeV range. We created another dataset in the 50-200 GeV energy range in which electrons and protons are labeled independently from the ECAL in the ISS Data. After hyperparameter tuning on the CoAtNet and applying focal loss, the models's proton rejection factors are 2 times higher than AMS ECAL LHD in the 50-200 GeV range.

AI keywords Convolutional Vision Transformers, domain adaptation, ECAL Shower Classification, focal loss

Primary author

Berk Türk (Middle East Technical University)

Co-authors

Prof. Bilge Demirköz (Middle East Techinal University) Prof. Emre Akbaş (Middle East Techinal University) Dr Zhili Weng (CERN,MIT)

Presentation materials

There are no materials yet.