Assessing First Year Radiology Resident Competence Pre-call. Development and Implementation of a Computer-based Exam before and after the 12 Month Training Requirement

Rihan Khan, Elizabeth A Krupinski, J. Allen Graham, Les Benodin, Petra Lewis

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Rationale and Objectives: Whether first-year radiology residents are ready to start call after 6 or 12 months has been a subject of much debate. The purpose of this study was to establish an assessment that would evaluate the call readiness of first-year radiology residents and identify any individual areas of weakness using a comprehensive computerized format. Secondarily, we evaluated for any significant differences in performance before and after the change in precall training requirement from 6 to 12 months. Materials and Methods: A list of >140 potential emergency radiology cases was given to first-year radiology residents at the beginning of the academic year. Over 4 years, three separate versions of a computerized examination were constructed using hyperlinked PowerPoint presentations and given to both first-year and second-year residents. No resident took the same version of the exam twice. Exam score and number of cases failed were assessed. Individual areas of weakness were identified and remediated with the residents. Statistical analysis was used to evaluate exam score and the number of cases failed, considering resident year and the three versions of the exam. Results: Over 4 years, 17 of 19 (89%) first-year radiology residents passed the exam on first attempt. The two who failed were remediated and passed a different version of the exam 6 weeks later. Using the oral board scoring system, first-year radiology residents scored an average of 70.7 with 13 cases failed, compared to 71.1 with eight cases failed for second-year residents who scored statistically significantly higher. No significant difference was found in first-year radiology resident scoring before and after the 12-month training requirement prior to call. Conclusions: An emergency radiology examination was established to aid in the assessment of first-year radiology residents' competency prior to starting call, which has become a permanent part of the first-year curriculum. Over 4 years, all first-year residents were ultimately judged ready to start call. Of the variables assessed, only resident year showed a significant difference in scoring parameters. In particular, length of training prior to taking call showed no significant difference. Areas of weakness were identified for further study.

Original languageEnglish (US)
Pages (from-to)752-758
Number of pages7
JournalAcademic Radiology
Volume19
Issue number6
DOIs
StatePublished - Jun 2012

Fingerprint

Radiology
Mental Competency
Emergencies
Curriculum

Keywords

  • Emergency radiology exam
  • Precall ER exam
  • Resident exam

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging

Cite this

Assessing First Year Radiology Resident Competence Pre-call. Development and Implementation of a Computer-based Exam before and after the 12 Month Training Requirement. / Khan, Rihan; Krupinski, Elizabeth A; Graham, J. Allen; Benodin, Les; Lewis, Petra.

In: Academic Radiology, Vol. 19, No. 6, 06.2012, p. 752-758.

Research output: Contribution to journalArticle

@article{34c6363da20d47adaca19aef42907f60,
title = "Assessing First Year Radiology Resident Competence Pre-call. Development and Implementation of a Computer-based Exam before and after the 12 Month Training Requirement",
abstract = "Rationale and Objectives: Whether first-year radiology residents are ready to start call after 6 or 12 months has been a subject of much debate. The purpose of this study was to establish an assessment that would evaluate the call readiness of first-year radiology residents and identify any individual areas of weakness using a comprehensive computerized format. Secondarily, we evaluated for any significant differences in performance before and after the change in precall training requirement from 6 to 12 months. Materials and Methods: A list of >140 potential emergency radiology cases was given to first-year radiology residents at the beginning of the academic year. Over 4 years, three separate versions of a computerized examination were constructed using hyperlinked PowerPoint presentations and given to both first-year and second-year residents. No resident took the same version of the exam twice. Exam score and number of cases failed were assessed. Individual areas of weakness were identified and remediated with the residents. Statistical analysis was used to evaluate exam score and the number of cases failed, considering resident year and the three versions of the exam. Results: Over 4 years, 17 of 19 (89{\%}) first-year radiology residents passed the exam on first attempt. The two who failed were remediated and passed a different version of the exam 6 weeks later. Using the oral board scoring system, first-year radiology residents scored an average of 70.7 with 13 cases failed, compared to 71.1 with eight cases failed for second-year residents who scored statistically significantly higher. No significant difference was found in first-year radiology resident scoring before and after the 12-month training requirement prior to call. Conclusions: An emergency radiology examination was established to aid in the assessment of first-year radiology residents' competency prior to starting call, which has become a permanent part of the first-year curriculum. Over 4 years, all first-year residents were ultimately judged ready to start call. Of the variables assessed, only resident year showed a significant difference in scoring parameters. In particular, length of training prior to taking call showed no significant difference. Areas of weakness were identified for further study.",
keywords = "Emergency radiology exam, Precall ER exam, Resident exam",
author = "Rihan Khan and Krupinski, {Elizabeth A} and Graham, {J. Allen} and Les Benodin and Petra Lewis",
year = "2012",
month = "6",
doi = "10.1016/j.acra.2011.12.019",
language = "English (US)",
volume = "19",
pages = "752--758",
journal = "Academic Radiology",
issn = "1076-6332",
publisher = "Elsevier USA",
number = "6",

}

TY - JOUR

T1 - Assessing First Year Radiology Resident Competence Pre-call. Development and Implementation of a Computer-based Exam before and after the 12 Month Training Requirement

AU - Khan, Rihan

AU - Krupinski, Elizabeth A

AU - Graham, J. Allen

AU - Benodin, Les

AU - Lewis, Petra

PY - 2012/6

Y1 - 2012/6

N2 - Rationale and Objectives: Whether first-year radiology residents are ready to start call after 6 or 12 months has been a subject of much debate. The purpose of this study was to establish an assessment that would evaluate the call readiness of first-year radiology residents and identify any individual areas of weakness using a comprehensive computerized format. Secondarily, we evaluated for any significant differences in performance before and after the change in precall training requirement from 6 to 12 months. Materials and Methods: A list of >140 potential emergency radiology cases was given to first-year radiology residents at the beginning of the academic year. Over 4 years, three separate versions of a computerized examination were constructed using hyperlinked PowerPoint presentations and given to both first-year and second-year residents. No resident took the same version of the exam twice. Exam score and number of cases failed were assessed. Individual areas of weakness were identified and remediated with the residents. Statistical analysis was used to evaluate exam score and the number of cases failed, considering resident year and the three versions of the exam. Results: Over 4 years, 17 of 19 (89%) first-year radiology residents passed the exam on first attempt. The two who failed were remediated and passed a different version of the exam 6 weeks later. Using the oral board scoring system, first-year radiology residents scored an average of 70.7 with 13 cases failed, compared to 71.1 with eight cases failed for second-year residents who scored statistically significantly higher. No significant difference was found in first-year radiology resident scoring before and after the 12-month training requirement prior to call. Conclusions: An emergency radiology examination was established to aid in the assessment of first-year radiology residents' competency prior to starting call, which has become a permanent part of the first-year curriculum. Over 4 years, all first-year residents were ultimately judged ready to start call. Of the variables assessed, only resident year showed a significant difference in scoring parameters. In particular, length of training prior to taking call showed no significant difference. Areas of weakness were identified for further study.

AB - Rationale and Objectives: Whether first-year radiology residents are ready to start call after 6 or 12 months has been a subject of much debate. The purpose of this study was to establish an assessment that would evaluate the call readiness of first-year radiology residents and identify any individual areas of weakness using a comprehensive computerized format. Secondarily, we evaluated for any significant differences in performance before and after the change in precall training requirement from 6 to 12 months. Materials and Methods: A list of >140 potential emergency radiology cases was given to first-year radiology residents at the beginning of the academic year. Over 4 years, three separate versions of a computerized examination were constructed using hyperlinked PowerPoint presentations and given to both first-year and second-year residents. No resident took the same version of the exam twice. Exam score and number of cases failed were assessed. Individual areas of weakness were identified and remediated with the residents. Statistical analysis was used to evaluate exam score and the number of cases failed, considering resident year and the three versions of the exam. Results: Over 4 years, 17 of 19 (89%) first-year radiology residents passed the exam on first attempt. The two who failed were remediated and passed a different version of the exam 6 weeks later. Using the oral board scoring system, first-year radiology residents scored an average of 70.7 with 13 cases failed, compared to 71.1 with eight cases failed for second-year residents who scored statistically significantly higher. No significant difference was found in first-year radiology resident scoring before and after the 12-month training requirement prior to call. Conclusions: An emergency radiology examination was established to aid in the assessment of first-year radiology residents' competency prior to starting call, which has become a permanent part of the first-year curriculum. Over 4 years, all first-year residents were ultimately judged ready to start call. Of the variables assessed, only resident year showed a significant difference in scoring parameters. In particular, length of training prior to taking call showed no significant difference. Areas of weakness were identified for further study.

KW - Emergency radiology exam

KW - Precall ER exam

KW - Resident exam

UR - http://www.scopus.com/inward/record.url?scp=84860624656&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84860624656&partnerID=8YFLogxK

U2 - 10.1016/j.acra.2011.12.019

DO - 10.1016/j.acra.2011.12.019

M3 - Article

C2 - 22297203

AN - SCOPUS:84860624656

VL - 19

SP - 752

EP - 758

JO - Academic Radiology

JF - Academic Radiology

SN - 1076-6332

IS - 6

ER -