Establishing the validity and reliability evidence of preceptor assessment of student tool

Lili Zhou, Abdulaali R. Almutairi, Nimer S. Alsaid, Terri L Warholak, Janet Heather Cooley

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Objective. To evaluate the validity and reliability evidence of the preceptor assessment of student tool (PAST) which was designed to assess doctor of pharmacy (PharmD) student rotation performance. Methods. Evaluation data were loaded into WINSTEPS software to conduct a Rasch rating scale analysis. Validity evidence was examined from construct and content validity perspectives, and reliability was assessed via student and item separation index and reliability coefficient. Data from 435 observations were included in the analysis. Results. All 19 items measured the same construct of interest and the five-point rating scale functioned appropriately and differentiated students’ ability. However, the item/person map indicated an absence of items at the end of the measurement continuum. Conclusion. Although adding items at the end of the measurement continuum may be beneficial, PAST showed good validity and reliability evidence when used to evaluate PharmD student rotations and is suitable to assess mastery learning.

Original languageEnglish (US)
Article number5908
Pages (from-to)10-20
Number of pages11
JournalAmerican Journal of Pharmaceutical Education
Volume81
Issue number8
DOIs
StatePublished - Jan 1 2017

Fingerprint

Reproducibility of Results
Students
evidence
student
rating scale
Pharmacy Students
Aptitude
Software
Learning
data analysis
human being
ability
learning
performance

Keywords

  • APPE/IPPE
  • Doctor of pharmacy students
  • Instrument evaluation
  • Performance assessment
  • Rasch analysis

ASJC Scopus subject areas

  • Education
  • Pharmacology, Toxicology and Pharmaceutics(all)

Cite this

Establishing the validity and reliability evidence of preceptor assessment of student tool. / Zhou, Lili; Almutairi, Abdulaali R.; Alsaid, Nimer S.; Warholak, Terri L; Cooley, Janet Heather.

In: American Journal of Pharmaceutical Education, Vol. 81, No. 8, 5908, 01.01.2017, p. 10-20.

Research output: Contribution to journalArticle

@article{83b67270b4b04351a684ab65311110af,
title = "Establishing the validity and reliability evidence of preceptor assessment of student tool",
abstract = "Objective. To evaluate the validity and reliability evidence of the preceptor assessment of student tool (PAST) which was designed to assess doctor of pharmacy (PharmD) student rotation performance. Methods. Evaluation data were loaded into WINSTEPS software to conduct a Rasch rating scale analysis. Validity evidence was examined from construct and content validity perspectives, and reliability was assessed via student and item separation index and reliability coefficient. Data from 435 observations were included in the analysis. Results. All 19 items measured the same construct of interest and the five-point rating scale functioned appropriately and differentiated students’ ability. However, the item/person map indicated an absence of items at the end of the measurement continuum. Conclusion. Although adding items at the end of the measurement continuum may be beneficial, PAST showed good validity and reliability evidence when used to evaluate PharmD student rotations and is suitable to assess mastery learning.",
keywords = "APPE/IPPE, Doctor of pharmacy students, Instrument evaluation, Performance assessment, Rasch analysis",
author = "Lili Zhou and Almutairi, {Abdulaali R.} and Alsaid, {Nimer S.} and Warholak, {Terri L} and Cooley, {Janet Heather}",
year = "2017",
month = "1",
day = "1",
doi = "10.5688/ajpe5908",
language = "English (US)",
volume = "81",
pages = "10--20",
journal = "American Journal of Pharmaceutical Education",
issn = "0002-9459",
publisher = "American Association of Colleges of Pharmacy",
number = "8",

}

TY - JOUR

T1 - Establishing the validity and reliability evidence of preceptor assessment of student tool

AU - Zhou, Lili

AU - Almutairi, Abdulaali R.

AU - Alsaid, Nimer S.

AU - Warholak, Terri L

AU - Cooley, Janet Heather

PY - 2017/1/1

Y1 - 2017/1/1

N2 - Objective. To evaluate the validity and reliability evidence of the preceptor assessment of student tool (PAST) which was designed to assess doctor of pharmacy (PharmD) student rotation performance. Methods. Evaluation data were loaded into WINSTEPS software to conduct a Rasch rating scale analysis. Validity evidence was examined from construct and content validity perspectives, and reliability was assessed via student and item separation index and reliability coefficient. Data from 435 observations were included in the analysis. Results. All 19 items measured the same construct of interest and the five-point rating scale functioned appropriately and differentiated students’ ability. However, the item/person map indicated an absence of items at the end of the measurement continuum. Conclusion. Although adding items at the end of the measurement continuum may be beneficial, PAST showed good validity and reliability evidence when used to evaluate PharmD student rotations and is suitable to assess mastery learning.

AB - Objective. To evaluate the validity and reliability evidence of the preceptor assessment of student tool (PAST) which was designed to assess doctor of pharmacy (PharmD) student rotation performance. Methods. Evaluation data were loaded into WINSTEPS software to conduct a Rasch rating scale analysis. Validity evidence was examined from construct and content validity perspectives, and reliability was assessed via student and item separation index and reliability coefficient. Data from 435 observations were included in the analysis. Results. All 19 items measured the same construct of interest and the five-point rating scale functioned appropriately and differentiated students’ ability. However, the item/person map indicated an absence of items at the end of the measurement continuum. Conclusion. Although adding items at the end of the measurement continuum may be beneficial, PAST showed good validity and reliability evidence when used to evaluate PharmD student rotations and is suitable to assess mastery learning.

KW - APPE/IPPE

KW - Doctor of pharmacy students

KW - Instrument evaluation

KW - Performance assessment

KW - Rasch analysis

UR - http://www.scopus.com/inward/record.url?scp=85034626139&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85034626139&partnerID=8YFLogxK

U2 - 10.5688/ajpe5908

DO - 10.5688/ajpe5908

M3 - Article

C2 - 29200445

AN - SCOPUS:85034626139

VL - 81

SP - 10

EP - 20

JO - American Journal of Pharmaceutical Education

JF - American Journal of Pharmaceutical Education

SN - 0002-9459

IS - 8

M1 - 5908

ER -