An approach to selecting thread + process mixes for hybrid MPI + OpenMP applications

Hormozd Gahvari, Martin Schulz, Ulrike Meier Yang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

Hybrid MPI + OpenMP is a popular means of programming modern machines that feature substantial parallelism both off-node and on-node. Determining the right mix of the two programming models to use, however, is not as straightforward as simply using exclusively OpenMP on-node and limiting MPI to only inter-node communication. We present a step-by-step methodology to help make the decision of which mix of the two programming models to use. It starts with an estimate of the performance of a generic hybrid application on a given machine and incorporates additional available information about the specific application and the machine to provide guidance for selecting effective mixes of MPI processes and OpenMP threads to use when running that application on the machine in question. We validate our approach on four different applications on an IBM Blue Gene/Q, a Cray XK7, and a Cray XC30.

Original languageEnglish
Title of host publicationProceedings - 2015 IEEE International Conference on Cluster Computing, CLUSTER 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages418-427
Number of pages10
ISBN (Electronic)9781467365987
DOIs
StatePublished - 26 Oct 2015
Externally publishedYes
EventIEEE International Conference on Cluster Computing, CLUSTER 2015 - Chicago, United States
Duration: 8 Sep 201511 Sep 2015

Publication series

NameProceedings - IEEE International Conference on Cluster Computing, ICCC
Volume2015-October
ISSN (Print)1552-5244

Conference

ConferenceIEEE International Conference on Cluster Computing, CLUSTER 2015
Country/TerritoryUnited States
CityChicago
Period8/09/1511/09/15

Keywords

  • Bandwidth
  • Benchmark testing
  • Instruction sets
  • Message systems
  • Parallel processing
  • Programming
  • Runtime

Fingerprint

Dive into the research topics of 'An approach to selecting thread + process mixes for hybrid MPI + OpenMP applications'. Together they form a unique fingerprint.

Cite this