JetLag: An Interactive, Asynchronous Array Computing Environment

Steven R. Brandt, Alex Bigelow, Sayef Azad Sakin, Katy Williams, Katherine E. Isaacs, Kevin Huck, Rod Tohid, Bibek Wagle, Shahrzad Shirzad, Hartmut Kaiser

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We describe an interactive computing environment called JetLag. JetLag implements the following features of Phylanx project: (1) Phylanx, a Python-based asynchronous array computing toolkit; (2) the APEX performance measurement library; (3) a performance visualization framework called Traveler; (4) the Tapis/Agave Science as a Service middleware; and (6) a container infrastructure that includes Docker-based Jupyter notebook for the client and a singularity image for the server. The running system starts with a user performing array computations on their workstation or laptop. If, at some point, the calculation the user is performing becomes sufficiently intensive or numerous, it can be packaged and sent to another machine where it will run (through the batch queue system if there is one), produce a result, and have that result sent back to the user's local interface. Whether the calculation is local or remote, the user will be able to use APEX and Traveler to diagnose and fix performance related problems. The JetLag system is suitable for a variety of array computational tasks, including machine learning and exploratory data analysis.

Original languageEnglish (US)
Title of host publicationPEARC 2020 - Practice and Experience in Advanced Research Computing 2020
Subtitle of host publicationCatch the Wave
PublisherAssociation for Computing Machinery
Pages8-12
Number of pages5
ISBN (Electronic)9781450366892
DOIs
StatePublished - Jul 26 2020
Event2020 Conference on Practice and Experience in Advanced Research Computing: Catch the Wave, PEARC 2020 - Virtual, Online, United States
Duration: Jul 27 2020Jul 31 2020

Publication series

NameACM International Conference Proceeding Series

Conference

Conference2020 Conference on Practice and Experience in Advanced Research Computing: Catch the Wave, PEARC 2020
CountryUnited States
CityVirtual, Online
Period7/27/207/31/20

Keywords

  • array
  • asynchronous
  • cloud computing
  • interactive computing
  • performance tuning
  • performance visualization
  • research environment

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'JetLag: An Interactive, Asynchronous Array Computing Environment'. Together they form a unique fingerprint.

Cite this