Validation of authentic performance assessment: A process suited for Rasch modeling

Terrence R. Jackson, JoLaine R. Draugalis, Marion K Slack, Woodie M. Zachry, Jerome D'Agostino

Research output: Contribution to journalArticle

35 Citations (Scopus)

Abstract

An evaluation was conducted in order to develop, test, and validate a method for assessing critical thinking learning outcomes as related to scientific literature evaluation in a PharmD program. A 25-item authentic assessment was created using recommended guidelines and Bloom's hierarchical taxonomy. Construct and content validity were supported using classical test theory and Rasch modeling. A primer on using Rasch analysis is provided in conjunction with the specific results. Rasch analysis demonstrated good INFIT and OUTFIT statistics, with item difficulty ranging from -1.90 to 2.46 logits for 23 items. The KR20 for the assessment was 0.41 and item point-biserial correlations ranged from -0.05 to 0.25. Rasch modeling techniques provided information to evaluate individual item contributions not discerned by standard techniques such as KR20 or point-biserial correlations. This research supports the practical application of this type of authentic assessment and provides evidence for construct and content validity in measuring student performance.

Original languageEnglish (US)
Pages (from-to)233-243
Number of pages11
JournalAmerican Journal of Pharmaceutical Education
Volume66
Issue number3
StatePublished - 2002

Fingerprint

Process Assessment (Health Care)
performance assessment
Literature
test theory
technical literature
Learning
Guidelines
Students
evaluation
taxonomy
statistics
Research
learning
performance
evidence
student
Thinking

ASJC Scopus subject areas

  • Pharmacology
  • Education

Cite this

Jackson, T. R., Draugalis, J. R., Slack, M. K., Zachry, W. M., & D'Agostino, J. (2002). Validation of authentic performance assessment: A process suited for Rasch modeling. American Journal of Pharmaceutical Education, 66(3), 233-243.

Validation of authentic performance assessment : A process suited for Rasch modeling. / Jackson, Terrence R.; Draugalis, JoLaine R.; Slack, Marion K; Zachry, Woodie M.; D'Agostino, Jerome.

In: American Journal of Pharmaceutical Education, Vol. 66, No. 3, 2002, p. 233-243.

Research output: Contribution to journalArticle

Jackson, TR, Draugalis, JR, Slack, MK, Zachry, WM & D'Agostino, J 2002, 'Validation of authentic performance assessment: A process suited for Rasch modeling', American Journal of Pharmaceutical Education, vol. 66, no. 3, pp. 233-243.
Jackson, Terrence R. ; Draugalis, JoLaine R. ; Slack, Marion K ; Zachry, Woodie M. ; D'Agostino, Jerome. / Validation of authentic performance assessment : A process suited for Rasch modeling. In: American Journal of Pharmaceutical Education. 2002 ; Vol. 66, No. 3. pp. 233-243.
@article{f4fd78eeb0834f08a888503cc35c520f,
title = "Validation of authentic performance assessment: A process suited for Rasch modeling",
abstract = "An evaluation was conducted in order to develop, test, and validate a method for assessing critical thinking learning outcomes as related to scientific literature evaluation in a PharmD program. A 25-item authentic assessment was created using recommended guidelines and Bloom's hierarchical taxonomy. Construct and content validity were supported using classical test theory and Rasch modeling. A primer on using Rasch analysis is provided in conjunction with the specific results. Rasch analysis demonstrated good INFIT and OUTFIT statistics, with item difficulty ranging from -1.90 to 2.46 logits for 23 items. The KR20 for the assessment was 0.41 and item point-biserial correlations ranged from -0.05 to 0.25. Rasch modeling techniques provided information to evaluate individual item contributions not discerned by standard techniques such as KR20 or point-biserial correlations. This research supports the practical application of this type of authentic assessment and provides evidence for construct and content validity in measuring student performance.",
author = "Jackson, {Terrence R.} and Draugalis, {JoLaine R.} and Slack, {Marion K} and Zachry, {Woodie M.} and Jerome D'Agostino",
year = "2002",
language = "English (US)",
volume = "66",
pages = "233--243",
journal = "American Journal of Pharmaceutical Education",
issn = "0002-9459",
publisher = "American Association of Colleges of Pharmacy",
number = "3",

}

TY - JOUR

T1 - Validation of authentic performance assessment

T2 - A process suited for Rasch modeling

AU - Jackson, Terrence R.

AU - Draugalis, JoLaine R.

AU - Slack, Marion K

AU - Zachry, Woodie M.

AU - D'Agostino, Jerome

PY - 2002

Y1 - 2002

N2 - An evaluation was conducted in order to develop, test, and validate a method for assessing critical thinking learning outcomes as related to scientific literature evaluation in a PharmD program. A 25-item authentic assessment was created using recommended guidelines and Bloom's hierarchical taxonomy. Construct and content validity were supported using classical test theory and Rasch modeling. A primer on using Rasch analysis is provided in conjunction with the specific results. Rasch analysis demonstrated good INFIT and OUTFIT statistics, with item difficulty ranging from -1.90 to 2.46 logits for 23 items. The KR20 for the assessment was 0.41 and item point-biserial correlations ranged from -0.05 to 0.25. Rasch modeling techniques provided information to evaluate individual item contributions not discerned by standard techniques such as KR20 or point-biserial correlations. This research supports the practical application of this type of authentic assessment and provides evidence for construct and content validity in measuring student performance.

AB - An evaluation was conducted in order to develop, test, and validate a method for assessing critical thinking learning outcomes as related to scientific literature evaluation in a PharmD program. A 25-item authentic assessment was created using recommended guidelines and Bloom's hierarchical taxonomy. Construct and content validity were supported using classical test theory and Rasch modeling. A primer on using Rasch analysis is provided in conjunction with the specific results. Rasch analysis demonstrated good INFIT and OUTFIT statistics, with item difficulty ranging from -1.90 to 2.46 logits for 23 items. The KR20 for the assessment was 0.41 and item point-biserial correlations ranged from -0.05 to 0.25. Rasch modeling techniques provided information to evaluate individual item contributions not discerned by standard techniques such as KR20 or point-biserial correlations. This research supports the practical application of this type of authentic assessment and provides evidence for construct and content validity in measuring student performance.

UR - http://www.scopus.com/inward/record.url?scp=0039482974&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0039482974&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:0039482974

VL - 66

SP - 233

EP - 243

JO - American Journal of Pharmaceutical Education

JF - American Journal of Pharmaceutical Education

SN - 0002-9459

IS - 3

ER -