Decentralized execution of event-driven scientific workflows

Guoli Li, Vinod Muthusamy, H. Arno Jacobsen, Serge Mankovski

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

10 Scopus citations

Abstract

Scientific workflows (SWF) are traditionally coordinated and executed in a centralized fashion. This creates a single point of failure, forms a scalability bottleneck, and often leads to too much message traffic routed back to the coordinator. We have developed PADRES, a content-based publish/subscribe platform that serves as a runtime environment for the decentralized execution, control, and monitoring of SWF. Publish/subscribe is a natural paradigm for event-driven applications such as SWF management, as the loosely-coupled nature of publishers and subscribers relieves the coordinator from maintaining client connection and capability information. PADRES has been developed with features inspired by the requirements of SWF management. Its unique features include an expressive subscription language, composite subscription processing support, a rule-based matching and routing mechanism, a query-based historic data access mechanism, and support for the decentralized execution of SWFs specified in XML.

Original languageEnglish
Title of host publicationProceedings - SCW 2006
Subtitle of host publicationIEEE Services Computing Workshops
Pages73-80
Number of pages8
DOIs
StatePublished - 2006
Externally publishedYes
EventSCW 2006: IEEE Services Computing Workshops - Chicago, IL, United States
Duration: 18 Sep 200622 Sep 2006

Publication series

NameProceedings - SCW 2006: IEEE Services Computing Workshops

Conference

ConferenceSCW 2006: IEEE Services Computing Workshops
Country/TerritoryUnited States
CityChicago, IL
Period18/09/0622/09/06

Fingerprint

Dive into the research topics of 'Decentralized execution of event-driven scientific workflows'. Together they form a unique fingerprint.

Cite this