CC-MPI: A compiled communication capable MPI prototype for ethernet switched clusters

Amit Karwanda, Xin Yuan, David K. Lowenthal

Research output: Contribution to journalArticlepeer-review

14 Scopus citations

Abstract

Compiled communication has recently been proposed to improve communication performance for clusters of workstations. The idea of compiled communication is to apply more aggressive optimizations to communications whose information is known at compile time. Existing MPI libraries do not support compiled communication. In this paper, we present an MPI prototype, CC-MPI, that supports compiled communication on Ethernet switched clusters. The unique feature of CC-MPI is that it allows the user to manage network resources such as multicast groups directly and to optimize communications based on the availability of the communication information. CC-MPI optimizes one-to-all, one-to-many, all-to-all, and many-to-many collective communication routines using the compiled communication technique. We describe the techniques used in CC-MPI and report its performance. The results show that communication performance of Ethernet switched clusters can be significantly improved through compiled communication.

Original languageEnglish (US)
Pages (from-to)95-106
Number of pages12
JournalACM SIGPLAN Notices
Volume38
Issue number10
StatePublished - Oct 2003
Externally publishedYes

Keywords

  • Clusters of workstations
  • Compiled communication
  • MPI
  • Message passing library

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design

Fingerprint Dive into the research topics of 'CC-MPI: A compiled communication capable MPI prototype for ethernet switched clusters'. Together they form a unique fingerprint.

Cite this