MAKER as a service: Moving HPC applications to jetstream cloud

Nicholas Hazekamp, Upendra Kumar Devisetty, Nirav Merchant, Douglas Thain

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

As cloud resources become more available as an execution platform, the need to transition applications between HPC and the cloud becomes a necessity. However, because of the complex setup and system specific demands of these applications, transition is difficult and may not scale as desired. Jetstream is a NSF funded cloud service that is aiming to provide these services for users in a dynamical allocated nature. In this work we look at three key areas to focus on when transitioning between resources: providing a portable reproducible environment, scaling between local and remote resources, and using feedback to the user for informing configuration and runtime decisions. Building on the MAKER bioinformatic application, we have deployed WQ-MAKER on the Jetstream cloud platform, helping to annotate over 30 genomes and accelerating performance from days to hours and weeks to days.

Original languageEnglish (US)
Title of host publicationProceedings - 2018 IEEE International Conference on Cloud Engineering, IC2E 2018
EditorsJie Li, Abhishek Chandra, Tian Guo, Ying Cai
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages72-78
Number of pages7
ISBN (Electronic)9781538650080
DOIs
StatePublished - May 16 2018
Event2018 IEEE International Conference on Cloud Engineering, IC2E 2018 - Orlando, United States
Duration: Apr 17 2018Apr 20 2018

Publication series

NameProceedings - 2018 IEEE International Conference on Cloud Engineering, IC2E 2018

Other

Other2018 IEEE International Conference on Cloud Engineering, IC2E 2018
CountryUnited States
CityOrlando
Period4/17/184/20/18

Keywords

  • Bioinformatics
  • Scalability
  • Workflows

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Hardware and Architecture

Fingerprint Dive into the research topics of 'MAKER as a service: Moving HPC applications to jetstream cloud'. Together they form a unique fingerprint.

  • Cite this

    Hazekamp, N., Devisetty, U. K., Merchant, N., & Thain, D. (2018). MAKER as a service: Moving HPC applications to jetstream cloud. In J. Li, A. Chandra, T. Guo, & Y. Cai (Eds.), Proceedings - 2018 IEEE International Conference on Cloud Engineering, IC2E 2018 (pp. 72-78). (Proceedings - 2018 IEEE International Conference on Cloud Engineering, IC2E 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IC2E.2018.00029