Probabilistic Job History Conversion and Performance Model Generation for Malleable Scheduling Simulations

Isaías Comprés, Eishi Arima, Martin Schulz, Tiberiu Rotaru, Rui Machado

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Malleability support in supercomputing requires several updates to system software stacks. In addition to this, updates to applications, libraries and the runtime systems of distributed memory programming models are also necessary. Because of this, there are relatively few applications that have been extended or developed with malleability support. As a consequence, there are no job histories from production systems that include sufficient malleable job submissions for scheduling research. In this paper, we propose a solution: a probabilistic job history conversion. This conversion allows us to evaluate malleable scheduling heuristics via simulations based on existing job histories. Based on a configurable probability, job arrivals are converted into malleable versions, and assigned a malleable performance model. This model is used by the simulator to evaluate its changes at runtime, as an effect of malleable operations being applied to it.

Original languageEnglish
Title of host publicationHigh Performance Computing - ISC High Performance 2023 International Workshops, Revised Selected Papers
EditorsAmanda Bienz, Michèle Weiland, Marc Baboulin, Carola Kruse
PublisherSpringer Science and Business Media Deutschland GmbH
Pages82-94
Number of pages13
ISBN (Print)9783031408427
DOIs
StatePublished - 2023
Event38th International Conference on High Performance Computing, ISC High Performance 2023 - Hamburg, Germany
Duration: 21 May 202325 May 2023

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13999 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference38th International Conference on High Performance Computing, ISC High Performance 2023
Country/TerritoryGermany
CityHamburg
Period21/05/2325/05/23

Keywords

  • Job History
  • Malleability
  • Scheduling
  • Supercomputing

Fingerprint

Dive into the research topics of 'Probabilistic Job History Conversion and Performance Model Generation for Malleable Scheduling Simulations'. Together they form a unique fingerprint.

Cite this