16–20 Jun 2025
THotel, Cagliari, Sardinia, Italy
Europe/Rome timezone

OmniJet-alpha and beyond: foundation model expansions

Not scheduled
20m
THotel, Cagliari, Sardinia, Italy

THotel, Cagliari, Sardinia, Italy

Via dei Giudicati, 66, 09131 Cagliari (CA), Italy
Parallel talk Foundation Models

Speaker

Anna Hallin (Universität Hamburg)

Description

OmniJet-alpha, released in 2024, is the first cross-task foundation model for particle physics, demonstrating transfer learning between an unsupervised problem (jet generation) and a classic supervised task (jet tagging). This talk will present current developments and expansions of the model. We will for example show how we are able to utilize real, unlabeled CMS data to pretrain the model. We will also cover how OmniJet-alpha can be used to generate calorimeter showers, showcasing its capabilities to work with very different data types.

AI keywords foundation models; transformers; generation; classification

Primary authors

Anna Hallin (Universität Hamburg) Prof. Gregor Kasieczka (Universität Hamburg) Henning Rose (Universität Hamburg) Joschka Birk (Universität Hamburg) Martina Mozzanica (Universität Hamburg)

Presentation materials

There are no materials yet.