Scalable ATLAS pMSSM computational workflows using containerised REANA reusable analysis platform

Marco Donadoni, Matthew Feickert, Lukas Heinrich, Yang Liu, Audrius Mečionis, Vladyslav Moisieienkov, Tibor Šimko, Giordon Stark, Marco Vidal García

Research output: Contribution to journalConference articlepeer-review

Abstract

In this paper we describe the development of a streamlined framework for large-scale ATLAS pMSSM reinterpretations of LHC Run-2 analyses using containerised computational workflows. The project is looking to assess the global coverage of BSM physics and requires running O(5k) computational workflows representing pMSSM model points. Following ATLAS Analysis Preservation policies, many analyses have been preserved as containerised Yadage workflows, and after validation were added to a curated selection for the pMSSM study. To run the workflows at scale, we utilised the REANA reusable analysis platform. We describe how the REANA platform was enhanced to ensure the best concurrent throughput by internal service scheduling changes. We discuss the scalability of the approach on Kubernetes clusters from 500 to 5000 cores. Finally, we demonstrate a possibility of using additional ad-hoc public cloud infrastructure resources by running the same workflows on the Google Cloud Platform.

Original languageEnglish
Article number04035
JournalEPJ Web of Conferences
Volume295
DOIs
StatePublished - 6 May 2024
Externally publishedYes
Event26th International Conference on Computing in High Energy and Nuclear Physics, CHEP 2023 - Norfolk, United States
Duration: 8 May 202312 May 2023

Fingerprint

Dive into the research topics of 'Scalable ATLAS pMSSM computational workflows using containerised REANA reusable analysis platform'. Together they form a unique fingerprint.

Cite this