Mitigating Inter-Job Interference via Process-Level Quality-of-Service

Lee Savoie, David K. Lowenthal, Bronis R. De Supinski, Kathryn Mohror, Nikhil Jain

Research output: Contribution to journalArticlepeer-review

Abstract

Jobs on most high-performance computing (HPC) systems share the network with other concurrently executing jobs. Network sharing leads to contention that can severely degrade performance. This article investigates the use of Quality of Service (QoS) mechanisms to reduce the negative impacts of network contention. QoS allows users to manage resource sharing between network flows and to provide bandwidth guarantees to specific flows. Our results show that careful use of QoS reduces the impact of network contention for specific jobs, resulting in up to a 40% performance improvement. In some cases, it completely eliminates the impact of contention. It achieves these improvements with limited negative impact to other jobs; any job that experiences performance loss typically degrades less than 5%, and often much less. Our approach can help ensure that HPC machines maintain high levels of throughput as per-node compute power continues to increase faster than network bandwidth.

Original languageEnglish (US)
Article number3434397
JournalACM Transactions on Parallel Computing
Volume8
Issue number1
DOIs
StatePublished - Apr 2021

Keywords

  • High-performance computing
  • network contention
  • quality of service

ASJC Scopus subject areas

  • Software
  • Modeling and Simulation
  • Hardware and Architecture
  • Computer Science Applications
  • Computational Theory and Mathematics

Fingerprint Dive into the research topics of 'Mitigating Inter-Job Interference via Process-Level Quality-of-Service'. Together they form a unique fingerprint.

Cite this