Invasive computing in HPC with X10

Hans Joachim Bungartz, Christoph Riesinger, Martin Schreiber, Gregor Snelting, Andreas Zwinkau

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

11 Scopus citations

Abstract

High performance computing with thousands of cores relies on distributed memory due to memory consistency reasons. The resource management on such systems usually relies on static assignment of resources at the start of each application. Such a static scheduling is incapable of starting applications with required resources being used by others since a reduction of resources assigned to applications without stopping them is not possible. This lack of dynamic adaptive scheduling leads to idling resources until the remaining amount of requested resources gets available. Additionally, applications with changing resource requirements lead to idling or less efficiently used resources. The invasive computing paradigm suggests dynamic resource scheduling and applications able to dynamically adapt to changing resource requirements. As a case study, we developed an invasive resource manager as well as a multigrid with dynamically changing resource demands. Such a multigrid has changing scalability behavior during its execution and requires data migration upon reallocation due to distributed memory systems. To counteract the additional complexity introduced by the additional interfaces, e. g. for data migration, we use the X10 programming language for improved programmability. Our results show improved application throughput and the dynamic adaptivity. In addition, we show our extension for the distributed arrays of X10 to support data migration.

Original languageEnglish
Title of host publicationProceedings of the 3rd ACM SIGPLAN X10 Workshop, X10 2013
PublisherAssociation for Computing Machinery
Pages12-19
Number of pages8
ISBN (Print)9781450321570
DOIs
StatePublished - 2013
Event3rd ACM SIGPLAN X10 Workshop, X10 2013 - Seattle, WA, United States
Duration: 20 Jun 201320 Jun 2013

Publication series

NameProceedings of the 3rd ACM SIGPLAN X10 Workshop, X10 2013

Conference

Conference3rd ACM SIGPLAN X10 Workshop, X10 2013
Country/TerritoryUnited States
CitySeattle, WA
Period20/06/1320/06/13

Keywords

  • HPC
  • Invasive computing
  • Multigrid
  • Resource-aware programming
  • X10 programming language

Fingerprint

Dive into the research topics of 'Invasive computing in HPC with X10'. Together they form a unique fingerprint.

Cite this