CHAMELEON: Reactive Load Balancing for Hybrid MPI+OpenMP Task-Parallel Applications

Jannis Klinkenberg, Philipp Samfass, Michael Bader, Christian Terboven, Matthias S. Müller

Publikation: Beitrag in FachzeitschriftArtikelBegutachtung

38 Zitate (Scopus)

Abstract

Many applications in high performance computing are designed based on underlying performance and execution models. While these models could successfully be employed in the past for balancing load within and between compute nodes, modern software and hardware increasingly make performance predictability difficult if not impossible. Consequently, balancing computational load becomes much more difficult. Aiming to tackle these challenges in search for a general solution, we present a novel library for fine-granular task-based reactive load balancing in distributed memory based on MPI and OpenMP. With our approach, individual migratable tasks can be executed on any MPI rank. The actual executing rank is determined at run time based on online performance data. We evaluate our approach under an enforced power cap and under enforced clock frequency changes for a synthetic benchmark and show its robustness for work-induced imbalances for a realistic application. Our experiments demonstrate speedups of up to 1.31X.

OriginalspracheEnglisch
Seiten (von - bis)55-64
Seitenumfang10
FachzeitschriftJournal of Parallel and Distributed Computing
Jahrgang138
DOIs
PublikationsstatusVeröffentlicht - Apr. 2020

Fingerprint

Untersuchen Sie die Forschungsthemen von „CHAMELEON: Reactive Load Balancing for Hybrid MPI+OpenMP Task-Parallel Applications“. Zusammen bilden sie einen einzigartigen Fingerprint.

Dieses zitieren