TY - GEN
T1 - Simulation-based analysis of performance dynamics of distributed applications in heterogeneous network environments
AU - Wu, Qishi
AU - Gu, Yi
AU - Wang, Zongmin
PY - 2009
Y1 - 2009
N2 - Next-generation computation-intensive collaborative applications in various science and engineering fields feature large-scale distributed computing workflows. There exist many distributed algorithms for task scheduling, module mapping, and service provisioning to support the execution of such workflows in heterogeneous computing environments and optimize their network performance for fast user interaction or smooth data flow. However, deploying large-scale distributed applications in real network environments is extremely challenging because of the time-varying dynamics in the reliability, availability, capacity, and capability of massively distributed system resources, which are typically shared among a broad community of users over Internet or dedicated connections. We propose a simulation system to study the execution dynamics of distributed applications and evaluate the network performance of scheduling or mapping solutions before real-life deployment and experimentation. The proposed system visually illustrates the dynamic execution process of complex workflows in network environments by simulating data communication over transport links and data processing on computer nodes in a highly distributed and parallel manner. We implement the simulation system and conduct extensive testings on various distributed mapping algorithms. The theoretical results obtained by rigorous performance analysis based on well-defined mathematical models are evidently confirmed by the simulation-based performance measurements.
AB - Next-generation computation-intensive collaborative applications in various science and engineering fields feature large-scale distributed computing workflows. There exist many distributed algorithms for task scheduling, module mapping, and service provisioning to support the execution of such workflows in heterogeneous computing environments and optimize their network performance for fast user interaction or smooth data flow. However, deploying large-scale distributed applications in real network environments is extremely challenging because of the time-varying dynamics in the reliability, availability, capacity, and capability of massively distributed system resources, which are typically shared among a broad community of users over Internet or dedicated connections. We propose a simulation system to study the execution dynamics of distributed applications and evaluate the network performance of scheduling or mapping solutions before real-life deployment and experimentation. The proposed system visually illustrates the dynamic execution process of complex workflows in network environments by simulating data communication over transport links and data processing on computer nodes in a highly distributed and parallel manner. We implement the simulation system and conduct extensive testings on various distributed mapping algorithms. The theoretical results obtained by rigorous performance analysis based on well-defined mathematical models are evidently confirmed by the simulation-based performance measurements.
KW - Computing workflow
KW - Distributed computing
KW - Dynamic simulation
KW - Graph mapping
UR - http://www.scopus.com/inward/record.url?scp=84870498610&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84870498610&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:84870498610
SN - 9781617386404
T3 - 42nd Annual Simulation Symposium 2009, ANSS 2009, Part of the 2009 Spring Simulation Multiconference
SP - 125
EP - 132
BT - 42nd Annual Simulation Symposium 2009, ANSS 2009, Part of the 2009 Spring Simulation Multiconference
T2 - 42nd Annual Simulation Symposium 2009, ANSS 2009, Part of the 2009 Spring Simulation Multiconference
Y2 - 22 March 2009 through 27 March 2009
ER -