Use of internal consistency coefficients for estimating reliability of experimental task scores

Samuel B. Green, Yanyun Yang, Mary Alt, Shara Brinkley, Shelley Gray, Tiffany Hogan, Nelson Cowan

Research output: Contribution to journalReview article

22 Scopus citations

Abstract

Reliabilities of scores for experimental tasks are likely to differ from one study to another to the extent that the task stimuli change, the number of trials varies, the type of individuals taking the task changes, the administration conditions are altered, or the focal task variable differs. Given that reliabilities vary as a function of the design of these tasks and the characteristics of the individuals taking them, making inferences about the reliability of scores in an ongoing study based on reliability estimates from prior studies is precarious. Thus, it would be advantageous to estimate reliability based on data from the ongoing study. We argue that internal consistency estimates of reliability are underutilized for experimental task data and in many applications could provide this information using a single administration of a task. We discuss different methods for computing internal consistency estimates with a generalized coefficient alpha and the conditions under which these estimates are accurate. We illustrate use of these coefficients using data for three different tasks.

Original languageEnglish (US)
Pages (from-to)750-763
Number of pages14
JournalPsychonomic Bulletin and Review
Volume23
Issue number3
DOIs
StatePublished - Jun 1 2016

    Fingerprint

Keywords

  • Coefficient alpha
  • Generalized coefficient alpha
  • Reliability
  • Split-half reliability

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Developmental and Educational Psychology
  • Arts and Humanities (miscellaneous)

Cite this