Accurate data redistribution cost estimation in software distributed shared memory systems

D. G. Morris, D. K. Lowenthal

Research output: Contribution to conferencePaper

8 Scopus citations

Abstract

Distributing data is one of the key problems in implementing efficient distributed-memory parallel programs. The problem becomes more difficult in programs where data redistribution between computational phases is considered. The global data distribution problem is to find the optimal distribution in multi-phase parallel programs. Solving this problem requires accurate knowledge of data redistribution cost. We are investigating this problem in the context of a software distributed shared memory (SDSM) system, in which obtaining accurate redistribution cost estimates is difficult. This is because SDSM communication is implicit: It depends on access patterns, page locations, and the SDSM consistency protocol. We have developed integrated compile- and run-time analysis for SDSM systems to determine accurate redistribution cost estimates with low overhead. Our resulting system, SUIF-Adapt, can efficiently and accurately estimate execution time, including redistribution, to within 5% of the actual time in all of our test cases and is often much closer. These precise costs enable SUIF-Adapt to find efficient global data distributions in multiple-phase programs.

Original languageEnglish (US)
Pages62-71
Number of pages10
DOIs
StatePublished - 2001
Event8th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming - Snowbird, UT, United States
Duration: Jun 18 2001Jun 20 2001

Other

Other8th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming
CountryUnited States
CitySnowbird, UT
Period6/18/016/20/01

ASJC Scopus subject areas

  • Software

Fingerprint Dive into the research topics of 'Accurate data redistribution cost estimation in software distributed shared memory systems'. Together they form a unique fingerprint.

  • Cite this

    Morris, D. G., & Lowenthal, D. K. (2001). Accurate data redistribution cost estimation in software distributed shared memory systems. 62-71. Paper presented at 8th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, Snowbird, UT, United States. https://doi.org/10.1145/379539.379570