Measuring Game Engagement: Multiple Methods and Construct Complexity

Rosa Mikeal Martey, Kate Kenski, James Folkestad, Laurie Feldman, Elana Gordis, Adrienne Shaw, Jennifer Stromer-Galley, Ben Clegg, Hui Zhang, Nissim Kaufman, Ari N. Rabkin, Samira Shaikh, Tomek Strzalkowski

Research output: Contribution to journalArticle

20 Scopus citations

Abstract

Background. Engagement has been identified as a crucial component of learning in games research. However, the conceptualization and operationalization of engagement vary widely in the literature. Many valuable approaches illuminate ways in which presence, flow, arousal, participation, and other concepts constitute or contribute to engagement. However, few studies examine multiple conceptualizations of engagement in the same project.

Method. This article discusses the results of two experiments that measure engagement in five different ways: survey self-report, content analyses of player videos, electro-dermal activity, mouse movements, and game click logs. We examine the relationships among these measures and assess how they are affected by the technical characteristics of a 30-minute, custom-built, educational game: use of a customized character, level of narrative complexity, and level of art complexity.

Results. We found that the five measures of engagement correlated in limited ways, and that they revealed substantially different relationships with game characteristics. We conclude that engagement as a construct is more complex than is captured in any of these measures individually and that using multiple methods to assess engagement can illuminate aspects of engagement not detectable by a single method of measurement.

Original languageEnglish (US)
Pages (from-to)528-547
Number of pages20
JournalSimulation and Gaming
Volume45
DOIs
StatePublished - Jan 24 2014

Keywords

  • EDA
  • art
  • art complexity
  • attention
  • character customization
  • content analyses
  • customized character
  • educational games
  • electro-dermal activity
  • engagement
  • game clicks
  • interactivity
  • measurement
  • mouse movements
  • multiple methods
  • narrative
  • narrative complexity
  • presence
  • self-report
  • transportation

ASJC Scopus subject areas

  • Business, Management and Accounting (miscellaneous)
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Measuring Game Engagement: Multiple Methods and Construct Complexity'. Together they form a unique fingerprint.

  • Cite this

    Martey, R. M., Kenski, K., Folkestad, J., Feldman, L., Gordis, E., Shaw, A., Stromer-Galley, J., Clegg, B., Zhang, H., Kaufman, N., Rabkin, A. N., Shaikh, S., & Strzalkowski, T. (2014). Measuring Game Engagement: Multiple Methods and Construct Complexity. Simulation and Gaming, 45, 528-547. https://doi.org/10.1177/1046878114553575