23–27 May 2022
Hotel Ariston
Europe/Rome timezone

Adapting HTCondor fairshare for mixed workloads

24 May 2022, 10:00
20m
Sala Saturno (Hotel Ariston)

Sala Saturno

Hotel Ariston

Via Laura, 13 - Capaccio-Paestum (SA)
Presentazione orale Infrastrutture ICT e Calcolo Distribuito Infrastrutture ICT e Calcolo Distribuito

Speaker

Stefano Dal Pra (Istituto Nazionale di Fisica Nucleare)

Description

The INFN Tier-1 data centre provides Grid and local access to several scientific communities. The job scheduling to the computing resources is performed by the HTCondor batch system. The set of different workloads submitted by the users to the computing cluster is highly heterogeneous and a very rich set of different requirements is to be considered by the batch system in order to provide user groups with a satisfactory fair share over the available resources. To prevent or reduce usage disparities a system to self adjust imbalances has been developed and it is being used with satisfactory results. This work explain how and when fair share implementations can miss optimal performances and describes a general method to improve them. Results of the current solution are presented and possible further developments are discussed.

Primary author

Stefano Dal Pra (Istituto Nazionale di Fisica Nucleare)

Co-author

Carmelo Pellegrino (INFN-LNS)

Presentation materials