Load balancing on PC clusters with the super-programming model

Dejiang Jin, S. G. Ziavras

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Recent work in high-performance computing has shifted attention to PC cluster.. For PC-clusters, member nodes are independent computers connected by generalpurpose networks. The latency of data communications is long and load balancing among the nodes becomes a critical issue. We introduce a new model for program development on PC clusters, namely the Super-Programming Model (SPM) to address this issue. In SPM PC clusters are modeled as a single virtual machine with PC as their processing units. The workload is modeled as a collection of Super-Instructions (SIs). Each SIs can achieve a limited workload. Application programs are coded using SIs. SIs are dynamically assigned to available PC at run time. For limited workload, no SIs overloads any PC. Therefore, dynamic load balancing becomes an easier task. We apply SPM to mining association rules. Our experiments show that under normal conditions the workload is balanced very well. A performance model is also developed to describe the scalable behavior of SPM.

Original languageEnglish (US)
Title of host publicationProceedings - 2003 International Conference on Parallel Processing Workshops, ICPPW 2003
EditorsChua-Huang Huang, J. Ramanujam
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages63-70
Number of pages8
ISBN (Electronic)0769520189
DOIs
StatePublished - 2003
Event2003 International Conference on Parallel Processing Workshops, ICPPW 2003 - Kaohsiung, Taiwan, Province of China
Duration: Oct 6 2003Oct 9 2003

Publication series

NameProceedings of the International Conference on Parallel Processing Workshops
Volume2003-January
ISSN (Print)1530-2016

Other

Other2003 International Conference on Parallel Processing Workshops, ICPPW 2003
Country/TerritoryTaiwan, Province of China
CityKaohsiung
Period10/6/0310/9/03

All Science Journal Classification (ASJC) codes

  • Software
  • General Mathematics
  • Hardware and Architecture

Keywords

  • Application software
  • Concurrent computing
  • Data communication
  • Data mining
  • Delay
  • Hardware
  • Load management
  • Parallel processing
  • Personal communication networks
  • Scanning probe microscopy

Fingerprint

Dive into the research topics of 'Load balancing on PC clusters with the super-programming model'. Together they form a unique fingerprint.

Cite this