An MPI prototype for compiled communication on Ethernet switched clusters

Amit Karwande, Xin Yuan, David K. Lowenthal

Research output: Contribution to journalArticle

26 Scopus citations

Abstract

Compiled communication has recently been proposed to improve communication performance for clusters of workstations. The idea of compiled communication is to apply more aggressive optimizations to communications whose information is known at compile time. Existing MPI libraries do not support compiled communication. In this paper, we present an MPI prototype, CC-MPI, that supports compiled communication on Ethernet switched clusters. The unique feature of CC-MPI is that it allows the user to manage network resources such as multicast groups directly and to optimize communications based on the availability of the communication information. CC-MPI optimizes one-to-all, one-to-many, all-to-all, and many-to-many collective communication routines using the compiled communication technique. We describe the techniques used in CC-MPI and report its performance.The results show that communication performance of Ethernet switched clusters can be significantly improved through compiled communication.

Original languageEnglish (US)
Pages (from-to)1123-1133
Number of pages11
JournalJournal of Parallel and Distributed Computing
Volume65
Issue number10
DOIs
StatePublished - Oct 1 2005
Externally publishedYes

Keywords

  • Clusters of workstations
  • Collective communication
  • Communication optimization
  • Compiled communication
  • MPI

ASJC Scopus subject areas

  • Software
  • Theoretical Computer Science
  • Hardware and Architecture
  • Computer Networks and Communications
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'An MPI prototype for compiled communication on Ethernet switched clusters'. Together they form a unique fingerprint.

  • Cite this