Architecture independent parallel algorithm design: Theory vs practice

Research output: Contribution to journalArticlepeer-review

5 Scopus citations


We propose architecture independent parallel algorithm design as a framework for writing parallel code that is scalable, portable and reusable. Towards this end we study the performance of some dense matrix computations such as matrix multiplication, LU decomposition and matrix inversion. Although optimized algorithms for these problems have been extensively examined before, a systematic study of an architecture independent design and analysis of parallel algorithms and their performance (including matrix computations) has not been undertaken. Even though more refined algorithms and implementations (sequential or parallel) for the stated problems exist, the complexity and performance of the introduced algorithms is sufficient to raise the issues that are important in architecture independent parallel algorithm design. Two established distributions of an input matrix among the processors of a parallel machine are examined and the particular theoretical and practical merits of each one are also discussed. The algorithms we propose have been implemented and tested on a variety of parallel systems that include the SGI Power Challenge, the IBM SP2 and the Cray T3D. Our experimental results support our claims of efficiency, portability and reusability of the presented algorithms.

Original languageEnglish (US)
Pages (from-to)573-593
Number of pages21
JournalFuture Generation Computer Systems
Issue number5
StatePublished - Apr 2002

All Science Journal Classification (ASJC) codes

  • Software
  • Hardware and Architecture
  • Computer Networks and Communications


  • Architecture independent parallel algorithms
  • Dense matrix algorithms
  • Experimental parallel algorithmics
  • Parallel algorithm design
  • Parallel performance prediction


Dive into the research topics of 'Architecture independent parallel algorithm design: Theory vs practice'. Together they form a unique fingerprint.

Cite this