Analyzing execution dynamics of scientific workflows for latency minimization in resource sharing environments

Yi Gu, Qishi Wu, Nageswara S.V. Rao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

11 Scopus citations

Abstract

Many computation-intensive scientific applications feature complex workflows of distributed computing modules with intricate execution dependencies. Such scientific workflows must be mapped and executed in shared environments to support distributed scientific collaborations. We formulate workflow mapping as an optimization problem for latency minimization, whose difficulty essentially arises from the topological matching nature in the spatial domain, which is further compounded by the resource sharing complicacy in the temporal dimension. We conduct a rigorous analysis of the resource sharing dynamics in workflow executions, which constitutes the base for a workflow mapping algorithm to minimize the end-to-end delay. The correctness of the dynamics analysis is verified in comparison with an approximate solution, a dynamic system simulation program, and a real network deployment, and the performance superiority of the proposed mapping solution is illustrated by extensive comparisons with existing methods using both simulations and experiments.

Original languageEnglish (US)
Title of host publicationProceedings - 2011 IEEE World Congress on Services, SERVICES 2011
Pages153-160
Number of pages8
DOIs
StatePublished - 2011
Externally publishedYes
Event2011 IEEE World Congress on Services, SERVICES 2011 - Washington, DC, United States
Duration: Jul 4 2011Jul 9 2011

Publication series

NameProceedings - 2011 IEEE World Congress on Services, SERVICES 2011

Other

Other2011 IEEE World Congress on Services, SERVICES 2011
Country/TerritoryUnited States
CityWashington, DC
Period7/4/117/9/11

All Science Journal Classification (ASJC) codes

  • Electrical and Electronic Engineering

Keywords

  • Dynamics analysis
  • Latency
  • Resource sharing
  • Workflow optimization

Fingerprint

Dive into the research topics of 'Analyzing execution dynamics of scientific workflows for latency minimization in resource sharing environments'. Together they form a unique fingerprint.

Cite this