HyFi: Architecture-independent parallelism on networks of multiprocessors

David K. Lowenthal, Ragavanis Subramanian

Research output: Contribution to journalArticlepeer-review

Abstract

A network of parallel workstations promises cost-effective parallel computing. This article presents the HyFi (Hybrid Filaments) package, which can be used to create architecture-independent parallel programs that is, programs that are portable and efficient across different parallel machines. HyFi integrates Shared Filaments (SF), which provides parallelism on shared-memory multiprocessors, and Distributed Filaments (DF), which extracts parallelism from networks of uniprocessors, This enables parallelism on any architecture, including homogeneous networks of multiprocessors. HyFi uses fine-grain parallelism and implicit shared-variable communication to provide a uniform programming model. HyFi adopts the same basic execution model as SF and DF; this work discusses the modifications necessary to develop the hybrid system. In particular, HyFi modifies the signal-thread model as well as the software distributed shared memory of DF. It also unifies the SF and DF reduction operations as well as the dynamic load-balancing mechanism of fork-join filaments. Application programs written using the HyFi API can run unchanged on any architecture. Performance is encouraging on fork/join applications, where excellent speedup is achieved. Also, the fine-grain model of HyFi allows up to a 14.5% improvement due to overlap of communication and computation. Unfortunately, we find that iterative applications do not speed up well due to the inability of the Pentium Xeon architecture to efficiently support concurrent memory accesses.

Original languageEnglish (US)
Pages (from-to)272-282
Number of pages11
JournalInternational Journal of Computers and Applications
Volume25
Issue number4
DOIs
StatePublished - Jan 1 2003
Externally publishedYes

Keywords

  • Architecture independence
  • Distributed shared memory
  • Fine-grain parallelism

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Computer Science Applications
  • Computer Graphics and Computer-Aided Design

Fingerprint Dive into the research topics of 'HyFi: Architecture-independent parallelism on networks of multiprocessors'. Together they form a unique fingerprint.

Cite this