Jul 6 – 13, 2022
Bologna, Italy
Europe/Rome timezone

Prototype of a cloud native solution of Machine Learning as Service for HEP

Jul 8, 2022, 7:05 PM
1h 25m
Bologna, Italy

Bologna, Italy

Palazzo della Cultura e dei Congressi
Poster Computing and Data handling Poster Session


Luca Giommi (Istituto Nazionale di Fisica Nucleare)


Nowadays Machine Learning (ML) techniques are successfully used in many areas of High-Energy Physics (HEP), e.g. in detector simulation, object reconstruction, identification, Monte Carlo generation. ML will play a significant role also in the upcoming High-Luminosity LHC (HL-LHC) upgrade foreseen at CERN, when a huge amount of data will be produced by LHC and collected by the experiments, facing challenges at the exascale. To favor the usage of ML in HEP analyses, it would be useful to have a service allowing to perform the entire ML pipeline (in terms of reading the data, training a ML model, and serving predictions) directly using ROOT files of arbitrary size from local or remote distributed data sources.
The MLaaS4HEP framework is an R&D project inside CMS providing such kind of solution. It was successfully validated with a CMS physics use case which gave important feedback about the needs of analysts. For instance, we introduced the possibility for the user to provide pre-processing operations, such as defining new branches and applying cuts.
To provide a real service for the user and to integrate it into the INFN Cloud, we started working on MLaaS4HEP cloudification. This would allow to use cloud resources and to work in a distributed environment. In this work we provide updates on this topic, in particular we discuss our first working prototype of the service. It includes an OAuth2 proxy server as authentication layer, a MLaaS4HEP server, an XRootD proxy server for enabling access to remote ROOT data, and the TFaaS service in charge of the inference phase. With this architecture the user is able to submit a ML pipeline, after being authenticated, using local or remote ROOT files simply using HTTP calls.

In-person participation Yes

Primary author

Luca Giommi (Istituto Nazionale di Fisica Nucleare)


Daniele Spiga (Istituto Nazionale di Fisica Nucleare) Valentin Kuznetsov (Cornell University) Daniele Bonacorsi (Istituto Nazionale di Fisica Nucleare)

Presentation materials