Evaluating event visualization: A usability study of COPLINK Spatio-Temporal Visualizer

Wingyan Chung, Hsinchun Chen, Luis G. Chaboya, Christopher D. O'Toole, Homa Atabakhsh

Research output: Contribution to journalArticle

20 Citations (Scopus)

Abstract

Event visualization holds the promise of alleviating information overload in human analysis and numerous tools and techniques have been developed and evaluated. However, previous work does not specifically address either the coordination of event dimensions with the types of tasks involved or the way that visualizing different event dimensions can benefit human analysis. In this paper, we propose a taxonomy of event visualization and present a methodology for evaluating a coordinated event visualization tool called COPLINK Spatio-Temporal Visualizer (STV). The taxonomy encompasses various event dimensions, application domains, visualization metaphors, evaluation methods and performance measures. The evaluation methodology examines different event dimensions and different task types, thus juxtaposing two important elements of evaluating a tool. To achieve both internal and external validity, a laboratory experiment with students and a field study with crime analysis experts were conducted. Findings of our usability study show that STV could support crime analysis involving multiple, coordinated event dimensions as effectively as it could analyze individual, uncoordinated event dimensions. STV was significantly more effective and efficient than Microsoft Excel in performing coordinated tasks and was significantly more efficient in doing uncoordinated tasks related to temporal, spatial and aggregated information. Also, STV had compared favorably with Excel in completing uncoordinated tasks related to temporal and spatial information, respectively. Subjects' comments showed STV to be intuitive, useful and preferable to existing crime analysis methods.

Original languageEnglish (US)
Pages (from-to)127-157
Number of pages31
JournalInternational Journal of Human Computer Studies
Volume62
Issue number1
DOIs
StatePublished - Jan 2005

Fingerprint

visualization
Crime
Visualization
event
Taxonomies
offense
taxonomy
Metaphor
Students
methodology
laboratory experiment
evaluation
Experiments
metaphor
expert
present
performance

Keywords

  • COPLINK
  • Crime analysis
  • Evaluation methodology
  • Event visualization
  • Information visualization
  • Intelligence analysis
  • Law enforcement
  • National security
  • Spatio-Temporal Visualizer
  • Taxonomy
  • Usability

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction
  • Experimental and Cognitive Psychology

Cite this

Evaluating event visualization : A usability study of COPLINK Spatio-Temporal Visualizer. / Chung, Wingyan; Chen, Hsinchun; Chaboya, Luis G.; O'Toole, Christopher D.; Atabakhsh, Homa.

In: International Journal of Human Computer Studies, Vol. 62, No. 1, 01.2005, p. 127-157.

Research output: Contribution to journalArticle

Chung, Wingyan ; Chen, Hsinchun ; Chaboya, Luis G. ; O'Toole, Christopher D. ; Atabakhsh, Homa. / Evaluating event visualization : A usability study of COPLINK Spatio-Temporal Visualizer. In: International Journal of Human Computer Studies. 2005 ; Vol. 62, No. 1. pp. 127-157.
@article{26046e43ec0c4c8e8c7ad02bbeba9a76,
title = "Evaluating event visualization: A usability study of COPLINK Spatio-Temporal Visualizer",
abstract = "Event visualization holds the promise of alleviating information overload in human analysis and numerous tools and techniques have been developed and evaluated. However, previous work does not specifically address either the coordination of event dimensions with the types of tasks involved or the way that visualizing different event dimensions can benefit human analysis. In this paper, we propose a taxonomy of event visualization and present a methodology for evaluating a coordinated event visualization tool called COPLINK Spatio-Temporal Visualizer (STV). The taxonomy encompasses various event dimensions, application domains, visualization metaphors, evaluation methods and performance measures. The evaluation methodology examines different event dimensions and different task types, thus juxtaposing two important elements of evaluating a tool. To achieve both internal and external validity, a laboratory experiment with students and a field study with crime analysis experts were conducted. Findings of our usability study show that STV could support crime analysis involving multiple, coordinated event dimensions as effectively as it could analyze individual, uncoordinated event dimensions. STV was significantly more effective and efficient than Microsoft Excel in performing coordinated tasks and was significantly more efficient in doing uncoordinated tasks related to temporal, spatial and aggregated information. Also, STV had compared favorably with Excel in completing uncoordinated tasks related to temporal and spatial information, respectively. Subjects' comments showed STV to be intuitive, useful and preferable to existing crime analysis methods.",
keywords = "COPLINK, Crime analysis, Evaluation methodology, Event visualization, Information visualization, Intelligence analysis, Law enforcement, National security, Spatio-Temporal Visualizer, Taxonomy, Usability",
author = "Wingyan Chung and Hsinchun Chen and Chaboya, {Luis G.} and O'Toole, {Christopher D.} and Homa Atabakhsh",
year = "2005",
month = "1",
doi = "10.1016/j.ijhcs.2004.08.005",
language = "English (US)",
volume = "62",
pages = "127--157",
journal = "International Journal of Human Computer Studies",
issn = "1071-5819",
publisher = "Academic Press Inc.",
number = "1",

}

TY - JOUR

T1 - Evaluating event visualization

T2 - A usability study of COPLINK Spatio-Temporal Visualizer

AU - Chung, Wingyan

AU - Chen, Hsinchun

AU - Chaboya, Luis G.

AU - O'Toole, Christopher D.

AU - Atabakhsh, Homa

PY - 2005/1

Y1 - 2005/1

N2 - Event visualization holds the promise of alleviating information overload in human analysis and numerous tools and techniques have been developed and evaluated. However, previous work does not specifically address either the coordination of event dimensions with the types of tasks involved or the way that visualizing different event dimensions can benefit human analysis. In this paper, we propose a taxonomy of event visualization and present a methodology for evaluating a coordinated event visualization tool called COPLINK Spatio-Temporal Visualizer (STV). The taxonomy encompasses various event dimensions, application domains, visualization metaphors, evaluation methods and performance measures. The evaluation methodology examines different event dimensions and different task types, thus juxtaposing two important elements of evaluating a tool. To achieve both internal and external validity, a laboratory experiment with students and a field study with crime analysis experts were conducted. Findings of our usability study show that STV could support crime analysis involving multiple, coordinated event dimensions as effectively as it could analyze individual, uncoordinated event dimensions. STV was significantly more effective and efficient than Microsoft Excel in performing coordinated tasks and was significantly more efficient in doing uncoordinated tasks related to temporal, spatial and aggregated information. Also, STV had compared favorably with Excel in completing uncoordinated tasks related to temporal and spatial information, respectively. Subjects' comments showed STV to be intuitive, useful and preferable to existing crime analysis methods.

AB - Event visualization holds the promise of alleviating information overload in human analysis and numerous tools and techniques have been developed and evaluated. However, previous work does not specifically address either the coordination of event dimensions with the types of tasks involved or the way that visualizing different event dimensions can benefit human analysis. In this paper, we propose a taxonomy of event visualization and present a methodology for evaluating a coordinated event visualization tool called COPLINK Spatio-Temporal Visualizer (STV). The taxonomy encompasses various event dimensions, application domains, visualization metaphors, evaluation methods and performance measures. The evaluation methodology examines different event dimensions and different task types, thus juxtaposing two important elements of evaluating a tool. To achieve both internal and external validity, a laboratory experiment with students and a field study with crime analysis experts were conducted. Findings of our usability study show that STV could support crime analysis involving multiple, coordinated event dimensions as effectively as it could analyze individual, uncoordinated event dimensions. STV was significantly more effective and efficient than Microsoft Excel in performing coordinated tasks and was significantly more efficient in doing uncoordinated tasks related to temporal, spatial and aggregated information. Also, STV had compared favorably with Excel in completing uncoordinated tasks related to temporal and spatial information, respectively. Subjects' comments showed STV to be intuitive, useful and preferable to existing crime analysis methods.

KW - COPLINK

KW - Crime analysis

KW - Evaluation methodology

KW - Event visualization

KW - Information visualization

KW - Intelligence analysis

KW - Law enforcement

KW - National security

KW - Spatio-Temporal Visualizer

KW - Taxonomy

KW - Usability

UR - http://www.scopus.com/inward/record.url?scp=10644268659&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=10644268659&partnerID=8YFLogxK

U2 - 10.1016/j.ijhcs.2004.08.005

DO - 10.1016/j.ijhcs.2004.08.005

M3 - Article

AN - SCOPUS:10644268659

VL - 62

SP - 127

EP - 157

JO - International Journal of Human Computer Studies

JF - International Journal of Human Computer Studies

SN - 1071-5819

IS - 1

ER -