23–27 May 2022
Hotel Ariston
Europe/Rome timezone

Ceph Deployment at CNAF

24 May 2022, 09:00
20m
Sala Saturno (Hotel Ariston)

Sala Saturno

Hotel Ariston

Via Laura, 13 - Capaccio-Paestum (SA)
Presentazione orale Infrastrutture ICT e Calcolo Distribuito Infrastrutture ICT e Calcolo Distribuito

Speaker

Antonio Falabella (Istituto Nazionale di Fisica Nucleare)

Description

The INFN CNAF data centre hosts resources for several scientific communities.
The disk resources are deployed mainly with IBM Spectrum Scale (formerly GPFS).
In order to widen the portfolio of the storage services we tested the Ceph distributed file system which provides a POSIX compliant file system (Ceph File System - CephFS), along with object storage and block device service.
We have chosen Ceph to be deployed along with GPFS because it is open source and supported by a very wide community.
We deployed an erasure coding Ceph cluster of 3.1PB of net space. This space is used to provide block devices to INFN Tier1 Openstack Cloud and
1.5PB of pledged disk space to the ALICE LHC experiment which accesses their storage area via XrootD.
POSIX compliance as well as support for extended attributes and ACLs were of key importance for this last use case.
In this contribution we report on the choices we made to optimize purchasing costs, physical space and net storage space as well as the setup, performances of the first period of production activity.

Primary authors

Antonio Falabella (Istituto Nazionale di Fisica Nucleare) Enrico Fattibene (Istituto Nazionale di Fisica Nucleare) Andrea Prosperini (CNAF)

Co-authors

Alessandro Cavalli (CNAF) Daniele Cesini (Istituto Nazionale di Fisica Nucleare) Federico Fornari (Istituto Nazionale di Fisica Nucleare) Lucia Morganti (Istituto Nazionale di Fisica Nucleare) Andrea Rendina (Istituto Nazionale di Fisica Nucleare) Vladimir Sapunenko (Istituto Nazionale di Fisica Nucleare)

Presentation materials