Supporting distributed application workflows in heterogeneous computing environments

Qishi Wu, Yi Gu

Research output: Contribution to journalConference articlepeer-review

46 Scopus citations

Abstract

Next-generation computation-intensive applications in various fields of science and engineering feature large-scale computing workflows with complex structures that are often modeled as directed acyclic graphs. Supporting such task graphs and optimizing their end-to-end network performances in heterogeneous computing environments are critical to the success of these distributed applications that require fast response. We construct analytical models for computing modules, network nodes, and communication links to estimate data processing and transport overhead, and formulate the task graph mapping with node reuse and resource sharing for minimum end-to-end delay as an NP-complete optimization problem. We propose a heuristic approach to this problem that recursively computes and maps the critical path to the network using a dynamic programming-based procedure. The performance superiority of the proposed approach is justified by an extensive set of experiments on simulated data sets in comparison with existing methods.

Original languageEnglish (US)
Article number4724296
Pages (from-to)3-10
Number of pages8
JournalProceedings of the International Conference on Parallel and Distributed Systems - ICPADS
DOIs
StatePublished - Dec 1 2008
Externally publishedYes
Event2008 14th IEEE International Conference on Parallel and Distributed Systems, ICPADS'08 - Melbourne, VIC, Australia
Duration: Dec 8 2008Dec 10 2008

All Science Journal Classification (ASJC) codes

  • Hardware and Architecture

Keywords

  • Graph mapping
  • Heuristic algorithm
  • Minimum end-to-end delay
  • NP-complete
  • Pptimization problem

Fingerprint Dive into the research topics of 'Supporting distributed application workflows in heterogeneous computing environments'. Together they form a unique fingerprint.

Cite this