An Autonomic Workflow Performance Manager for Weather Research and Forecast Workflows

Shuqing Gu, Likai Yao, Cihan Tunc, Ali Akoglu, Salim A Hariri, Elizabeth A Ritchie

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

Parameter selection is a critical task in scientific workflows in order to maintain the accuracy of the simulation in an environment where physical conditions change dynamically such as in the case of weather research and forecast (WRF) simulations. Considering the large number of simulation parameters, the size of the configuration search space becomes prohibitive for rapidly evaluating and identifying the parameter configuration that leads to most accurate prediction. We present an autonomic workflow performance manager that can automatically manage model initialization and workflow execution for a given resource allocation. We model the configuration selection of WRF workflow using Apache Storm and automate the process of model initialization, configuration and execution. We reduce the timescale of the configuration search workflow by a factor of 10x by using 20 threads when compared to serial workflow execution as it is typically performed by domain scientists.

Original languageEnglish (US)
Title of host publicationProceedings - 2016 International Conference on Cloud and Autonomic Computing, ICCAC 2016: Co-located with the 10th IEEE International Conference on Self-Adaptive and Self-Organizing Systems, SASO 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages111-114
Number of pages4
ISBN (Electronic)9781509035366
DOIs
StatePublished - Dec 5 2016
Event2016 International Conference on Cloud and Autonomic Computing, ICCAC 2016 - Augsburg, Germany
Duration: Sep 12 2016Sep 16 2016

Other

Other2016 International Conference on Cloud and Autonomic Computing, ICCAC 2016
CountryGermany
CityAugsburg
Period9/12/169/16/16

Keywords

  • Apache Storm
  • Automated Workflow Management
  • Model Parameter Sweeping
  • Weather Research and Forecast

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'An Autonomic Workflow Performance Manager for Weather Research and Forecast Workflows'. Together they form a unique fingerprint.

  • Cite this

    Gu, S., Yao, L., Tunc, C., Akoglu, A., Hariri, S. A., & Ritchie, E. A. (2016). An Autonomic Workflow Performance Manager for Weather Research and Forecast Workflows. In Proceedings - 2016 International Conference on Cloud and Autonomic Computing, ICCAC 2016: Co-located with the 10th IEEE International Conference on Self-Adaptive and Self-Organizing Systems, SASO 2016 (pp. 111-114). [7774966] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCAC.2016.23