Natural HPC substrate: Exploitation of mixed multicore CPU and GPUs

Moussa Taifi, Abdallah Khreishah, Justin Y. Shi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Scopus citations

Abstract

Recent GPU developments have attracted much interest in the HPC community. Since each GPU interface requires a dedicated host processor, the unused high performance non-GPU processors are simply wasted. GPUs are energy intensive and are more likely to fail than CPUs, we are interested in using all processors to a) boosting application performance, and b) defending GPU failures. This paper reports parallel computation experiments using a natural semantic multiplexing substrate; we call Deeply Decoupled Parallel Processing (D2P2). The idea is to apply statistic multiplexing on application's semantic network with application-defined data tuples. Tuple space parallel processing is a natural choice for applying statistic multiplexing on application semantic networks. We report up to 53% performance gain for CPU:GPU capability ratio of 1:5. For faster GPUs, CPUs are better used to prevent application halt when GPU fails. The D2P2 substrate allows fault tolerant parallel processing using heterogeneous processors.

Original languageEnglish (US)
Title of host publicationProceedings of the 2011 International Conference on High Performance Computing and Simulation, HPCS 2011
Pages33-40
Number of pages8
DOIs
StatePublished - 2011
Externally publishedYes
Event2011 International Conference on High Performance Computing and Simulation, HPCS 2011 - Istanbul, Turkey
Duration: Jul 4 2011Jul 8 2011

Publication series

NameProceedings of the 2011 International Conference on High Performance Computing and Simulation, HPCS 2011

Other

Other2011 International Conference on High Performance Computing and Simulation, HPCS 2011
Country/TerritoryTurkey
CityIstanbul
Period7/4/117/8/11

All Science Journal Classification (ASJC) codes

  • Computational Theory and Mathematics
  • Modeling and Simulation

Keywords

  • Semantic statistic multiplexing
  • fault tolerant GPU computing
  • load balancing using heterogeneous processors

Fingerprint

Dive into the research topics of 'Natural HPC substrate: Exploitation of mixed multicore CPU and GPUs'. Together they form a unique fingerprint.

Cite this