A study of application-level recovery methods for transient network faults

Ignacio Laguna, Edgar A. León, Martin Schulz, Mark Stephenson

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

With the increasing number of components in HPC sys- tems, transient faults will become commonplace. Today, network transient faults, such as lost or corrupted network packets, are addressed by middleware libraries at the cost of high memory usage and packet retransmissions. These costs, however, can be eliminated using application-level fault tolerance. In this paper, we propose recovery methods for transient network faults at the application level. These methods reconstruct missing or corrupted data via interpolation. We derive a realistic fault model using network fault rates from a production HPC cluster and use it to demonstrate the effectiveness of our reconstruction methods in an FFT kernel. We found that the normalized root-mean-square error for FFT computations can be as low as 0.1% and, thus, demonstrates that network faults can be handled at the application level with low perturbation in applications that have smoothness in their computed data.

Original languageEnglish
Title of host publicationProc. of ScalA 2013
Subtitle of host publicationWorkshop on Latest Adv. in Scalable Algorithms for Large-Scale Systems - Held in Conjunction with SC 2013: The Int. Conf. for High Perform. Comput., Networking, Storage and Anal.
DOIs
StatePublished - 2013
Externally publishedYes
EventWorkshop on Latest Advances in Scalable Algorithms for Large-Scale Systems, ScalA 2013 - Held in Conjunction with the International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2013 - Denver, CO, United States
Duration: 17 Nov 201321 Nov 2013

Publication series

NameProc. of ScalA 2013: Workshop on Latest Adv. in Scalable Algorithms for Large-Scale Systems - Held in Conjunction with SC 2013: The Int. Conf. for High Perform. Comput., Networking, Storage and Anal.

Conference

ConferenceWorkshop on Latest Advances in Scalable Algorithms for Large-Scale Systems, ScalA 2013 - Held in Conjunction with the International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2013
Country/TerritoryUnited States
CityDenver, CO
Period17/11/1321/11/13

Keywords

  • Application-level fault recovery
  • Network faults
  • Resilience

Fingerprint

Dive into the research topics of 'A study of application-level recovery methods for transient network faults'. Together they form a unique fingerprint.

Cite this