Using semantic information to guide efficient parallel I/O on clusters

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Despite the large I/O capabilities in modern cluster architectures with local disks on each node, applications mostly are not enabled to fully exploit them. This is especially problematic for data intensive applications which often suffer from low I/O performance. As one solution for this problem, a distribution I/O management (DIOM) system has been developed to manage a transparent distribution of data across cluster nodes and to then allow applications to access this data purely from local disks. In order to be effective, however, this distribution process requires semantic information about both the application and the input data. This work therefore extends DIOM to include independent specifications for both data formats and application I/O patterns and thereby decouples them. This work is driven by an application from nuclear medical imaging, the reconstruction of PET images, for which DIOM has proven to be an adequate solution enabling truly scalable I/O and thereby improving the overall application performance.

Original languageEnglish
Title of host publicationProceedings - 11th IEEE International Symposium on High Performance Distributed Computing, HPDC 2002
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages135-142
Number of pages8
ISBN (Electronic)0769516866
DOIs
StatePublished - 2002
Event11th IEEE International Symposium on High Performance Distributed Computing, HPDC 2002 - Edinburgh, Scotland, United Kingdom
Duration: 24 Jul 200226 Jul 2002

Publication series

NameProceedings of the IEEE International Symposium on High Performance Distributed Computing
Volume2002-January
ISSN (Print)1082-8907

Conference

Conference11th IEEE International Symposium on High Performance Distributed Computing, HPDC 2002
Country/TerritoryUnited Kingdom
CityEdinburgh, Scotland
Period24/07/0226/07/02

Keywords

  • Biomedical image processing
  • Biomedical imaging
  • Detectors
  • Image reconstruction
  • Image storage
  • Middleware
  • Operating systems
  • Personal communication networks
  • Positron emission tomography
  • Resource management

Fingerprint

Dive into the research topics of 'Using semantic information to guide efficient parallel I/O on clusters'. Together they form a unique fingerprint.

Cite this