An improved, randomized algorithm for parallel selection with an experimental study

Research output: Contribution to journalArticlepeer-review

8 Scopus citations

Abstract

A common statistical problem is that of finding the median element in a set of data. This paper presents an efficient randomized high-level parallel algorithm for finding the median given a set of elements distributed across a parallel machine. In fact, our algorithm solves the general selection problem that requires the determination of the element of rank k, for an arbitrarily given integer k. Our general framework is an SPMD distributed-memory programming model that is enhanced by a set of communication primitives. We use efficient techniques for distributing and coalescing data as well as efficient combinations of task and data parallelism. The algorithms have been coded in the message-passing standard MPI, and our experimental results from the IBM SP-2 illustrate the scalability and efficiency of our algorithm and improve upon all the related experimental results known to the author. The main contributions of this paper are (1) New techniques for speeding the performance of certain randomized algorithms, such as selection, which are efficient with likely probability. (2) A new, practical randomized selection algorithm (UltraFast) with significantly improved convergence.

Original languageEnglish (US)
Pages (from-to)1051-1059
Number of pages9
JournalJournal of Parallel and Distributed Computing
Volume64
Issue number9
DOIs
StatePublished - Sep 2004
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • Software
  • Theoretical Computer Science
  • Hardware and Architecture
  • Computer Networks and Communications
  • Artificial Intelligence

Keywords

  • Experimental parallel algorithmics
  • Parallel algorithms
  • Randomized algorithms
  • Selection algorithm

Fingerprint

Dive into the research topics of 'An improved, randomized algorithm for parallel selection with an experimental study'. Together they form a unique fingerprint.

Cite this