Designing and Evaluating Scientific Workflows for Big Data Interactions

Ronak Etemadpour, Matthew Bomhoff, Eric H Lyons, Paul Murray, Angus Forbes

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

This paper explores the specialized nature of research-oriented web applications that enable interactions with and the visual analysis of ''Big Data,'' i.e., large, heterogeneous scientific datasets. We introduce a pragmatic methodology for the design and evaluation of scientific workflows in research-oriented web applications. Through an in-depth usability study of the CoGe web application, a system that provides a rich set of tools for exploring genomic datasets, we demonstrate: how to identify bottlenecks in multi-step tasks; how to analyze these bottlenecks in order to provide effective solutions for improving user experience; and how these solutions may more generally apply to similar research-oriented websites in other scientific domains that also enable scientific workflows. Specifically, we provide details regarding: our user interviews, the visualization system we created to analyze complex tasks associated with scientific workflows, and how this analysis directly leads to suggestions for improvements in the current implementation of the CoGe web application. A follow-up study was carried out which indicates that our suggestions improved the ability of CoGe users to navigate and complete custom workflows, leading us to believe that our approach could also be applied to other research-oriented web applications that utilize scientific datasets.

Original languageEnglish (US)
Title of host publication2015 Big Data Visual Analytics, BDVA 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Print)9781467373432
DOIs
StatePublished - Oct 30 2015
EventBig Data Visual Analytics, BDVA 2015 - Hobart, Australia
Duration: Sep 22 2015Sep 25 2015

Other

OtherBig Data Visual Analytics, BDVA 2015
CountryAustralia
CityHobart
Period9/22/159/25/15

Fingerprint

Websites
Visualization
Big data

Keywords

  • Big Data
  • Scientific workflows
  • user evaluation
  • visual analytics

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Networks and Communications
  • Information Systems

Cite this

Etemadpour, R., Bomhoff, M., Lyons, E. H., Murray, P., & Forbes, A. (2015). Designing and Evaluating Scientific Workflows for Big Data Interactions. In 2015 Big Data Visual Analytics, BDVA 2015 [7314290] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/BDVA.2015.7314290

Designing and Evaluating Scientific Workflows for Big Data Interactions. / Etemadpour, Ronak; Bomhoff, Matthew; Lyons, Eric H; Murray, Paul; Forbes, Angus.

2015 Big Data Visual Analytics, BDVA 2015. Institute of Electrical and Electronics Engineers Inc., 2015. 7314290.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Etemadpour, R, Bomhoff, M, Lyons, EH, Murray, P & Forbes, A 2015, Designing and Evaluating Scientific Workflows for Big Data Interactions. in 2015 Big Data Visual Analytics, BDVA 2015., 7314290, Institute of Electrical and Electronics Engineers Inc., Big Data Visual Analytics, BDVA 2015, Hobart, Australia, 9/22/15. https://doi.org/10.1109/BDVA.2015.7314290
Etemadpour R, Bomhoff M, Lyons EH, Murray P, Forbes A. Designing and Evaluating Scientific Workflows for Big Data Interactions. In 2015 Big Data Visual Analytics, BDVA 2015. Institute of Electrical and Electronics Engineers Inc. 2015. 7314290 https://doi.org/10.1109/BDVA.2015.7314290
Etemadpour, Ronak ; Bomhoff, Matthew ; Lyons, Eric H ; Murray, Paul ; Forbes, Angus. / Designing and Evaluating Scientific Workflows for Big Data Interactions. 2015 Big Data Visual Analytics, BDVA 2015. Institute of Electrical and Electronics Engineers Inc., 2015.
@inproceedings{262ff1ec8e2f4a33a266204b795c85f5,
title = "Designing and Evaluating Scientific Workflows for Big Data Interactions",
abstract = "This paper explores the specialized nature of research-oriented web applications that enable interactions with and the visual analysis of ''Big Data,'' i.e., large, heterogeneous scientific datasets. We introduce a pragmatic methodology for the design and evaluation of scientific workflows in research-oriented web applications. Through an in-depth usability study of the CoGe web application, a system that provides a rich set of tools for exploring genomic datasets, we demonstrate: how to identify bottlenecks in multi-step tasks; how to analyze these bottlenecks in order to provide effective solutions for improving user experience; and how these solutions may more generally apply to similar research-oriented websites in other scientific domains that also enable scientific workflows. Specifically, we provide details regarding: our user interviews, the visualization system we created to analyze complex tasks associated with scientific workflows, and how this analysis directly leads to suggestions for improvements in the current implementation of the CoGe web application. A follow-up study was carried out which indicates that our suggestions improved the ability of CoGe users to navigate and complete custom workflows, leading us to believe that our approach could also be applied to other research-oriented web applications that utilize scientific datasets.",
keywords = "Big Data, Scientific workflows, user evaluation, visual analytics",
author = "Ronak Etemadpour and Matthew Bomhoff and Lyons, {Eric H} and Paul Murray and Angus Forbes",
year = "2015",
month = "10",
day = "30",
doi = "10.1109/BDVA.2015.7314290",
language = "English (US)",
isbn = "9781467373432",
booktitle = "2015 Big Data Visual Analytics, BDVA 2015",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Designing and Evaluating Scientific Workflows for Big Data Interactions

AU - Etemadpour, Ronak

AU - Bomhoff, Matthew

AU - Lyons, Eric H

AU - Murray, Paul

AU - Forbes, Angus

PY - 2015/10/30

Y1 - 2015/10/30

N2 - This paper explores the specialized nature of research-oriented web applications that enable interactions with and the visual analysis of ''Big Data,'' i.e., large, heterogeneous scientific datasets. We introduce a pragmatic methodology for the design and evaluation of scientific workflows in research-oriented web applications. Through an in-depth usability study of the CoGe web application, a system that provides a rich set of tools for exploring genomic datasets, we demonstrate: how to identify bottlenecks in multi-step tasks; how to analyze these bottlenecks in order to provide effective solutions for improving user experience; and how these solutions may more generally apply to similar research-oriented websites in other scientific domains that also enable scientific workflows. Specifically, we provide details regarding: our user interviews, the visualization system we created to analyze complex tasks associated with scientific workflows, and how this analysis directly leads to suggestions for improvements in the current implementation of the CoGe web application. A follow-up study was carried out which indicates that our suggestions improved the ability of CoGe users to navigate and complete custom workflows, leading us to believe that our approach could also be applied to other research-oriented web applications that utilize scientific datasets.

AB - This paper explores the specialized nature of research-oriented web applications that enable interactions with and the visual analysis of ''Big Data,'' i.e., large, heterogeneous scientific datasets. We introduce a pragmatic methodology for the design and evaluation of scientific workflows in research-oriented web applications. Through an in-depth usability study of the CoGe web application, a system that provides a rich set of tools for exploring genomic datasets, we demonstrate: how to identify bottlenecks in multi-step tasks; how to analyze these bottlenecks in order to provide effective solutions for improving user experience; and how these solutions may more generally apply to similar research-oriented websites in other scientific domains that also enable scientific workflows. Specifically, we provide details regarding: our user interviews, the visualization system we created to analyze complex tasks associated with scientific workflows, and how this analysis directly leads to suggestions for improvements in the current implementation of the CoGe web application. A follow-up study was carried out which indicates that our suggestions improved the ability of CoGe users to navigate and complete custom workflows, leading us to believe that our approach could also be applied to other research-oriented web applications that utilize scientific datasets.

KW - Big Data

KW - Scientific workflows

KW - user evaluation

KW - visual analytics

UR - http://www.scopus.com/inward/record.url?scp=84962302538&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84962302538&partnerID=8YFLogxK

U2 - 10.1109/BDVA.2015.7314290

DO - 10.1109/BDVA.2015.7314290

M3 - Conference contribution

AN - SCOPUS:84962302538

SN - 9781467373432

BT - 2015 Big Data Visual Analytics, BDVA 2015

PB - Institute of Electrical and Electronics Engineers Inc.

ER -