Mitigating Inter-Job Interference via Process-Level Quality-of-Service

Abstract

Jobs on most high-performance computing (HPC) systems share the network with other concurrently executing jobs. This sharing creates contention that can severely degrade performance. We investigate the use of Quality of Service (QoS) mechanisms to reduce the negative impacts of network contention. Our results show that careful use of QoS reduces the impact of contention for specific jobs, resulting in up to a 27% performance improvement. In some cases the impact of contention is completely eliminated. These improvements are achieved with limited negative impact to other jobs; any job that experiences performance loss typically degrades less than 5%, often much less. Our approach can help ensure that HPC machines maintain high throughput as per-node compute power continues to increase faster than network bandwidth.

Original languageEnglish (US)
Title of host publicationProceedings - 2019 IEEE International Conference on Cluster Computing, CLUSTER 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728147345
DOIs
Publication statusPublished - Sep 2019
Event2019 IEEE International Conference on Cluster Computing, CLUSTER 2019 - Albuquerque, United States
Duration: Sep 23 2019Sep 26 2019

Publication series

NameProceedings - IEEE International Conference on Cluster Computing, ICCC
Volume2019-September
ISSN (Print)1552-5244

Conference

Conference2019 IEEE International Conference on Cluster Computing, CLUSTER 2019
CountryUnited States
CityAlbuquerque
Period9/23/199/26/19

    Fingerprint

Keywords

  • MPI
  • network contention
  • quality of service

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Signal Processing

Cite this

Mitigating Inter-Job Interference via Process-Level Quality-of-Service. / Savoie, Lee; Lowenthal, David K.; De Supinski, Bronis R.; Mohror, Kathryn; Jain, Nikhil.

Proceedings - 2019 IEEE International Conference on Cluster Computing, CLUSTER 2019. Institute of Electrical and Electronics Engineers Inc., 2019. 8891007 (Proceedings - IEEE International Conference on Cluster Computing, ICCC; Vol. 2019-September).

Research output: Chapter in Book/Report/Conference proceedingConference contribution