Does the experience of the writer affect the evaluative components on the standardized letter of recommendation in emergency medicine?

Daniel L. Beskind, Katherine M Hiller, Uwe Stolz, Hans Bradshaw, Matthew Berkman, Lisa R Stoneking, Albert Fiorello, Alice Min, Chad D Viscusi, Kristi J H Grall

Research output: Contribution to journalArticle

8 Citations (Scopus)

Abstract

Background The Standardized Letter of Recommendation (SLOR) was developed in an attempt to standardize the evaluation of applicants to an emergency medicine (EM) residency. Objective Our aim was to determine whether the Global Assessment Score (GAS) and Likelihood of Matching Assessment (LOMA) of the SLOR for applicants applying to an EM residency are affected by the experience of the letter writer. We describe the distribution of GAS and LOMA grades and compare the GAS and LOMA scores to length of time an applicant knew the letter writer and number of EM rotations. Methods We conducted a retrospective review of all SLORs written for all applicants applying to three EM residency programs for the 2012 match. Median number of letters written the previous year were compared across the four GAS and LOMA scores using an equality of medians test and test for trend to see if higher scores on the GAS and LOMA were associated with less experienced letter writers. Distributions of the scores were determined and length of time a letter writer knew an applicant and number of EM rotations were compared with GAS and LOMA scores. Results There were 917 applicants representing 27.6% of the total applicant pool for the 2012 United States EM residency match and 1253 SLORs for GAS and 1246 for LOMA were analyzed. The highest scores on the GAS and LOMA were associated with the lowest median number of letters written the previous year (equality of medians test across groups, p < 0.001; test for trend, p < 0.001). Less than 3% received the lowest score for GAS and LOMA. Among letter writers that knew an applicant for more than 1 year, 45.3% gave a GAS score of "Outstanding" and 53.4% gave a LOMA of "Very Competitive" compared with 31.7% and 39.6%, respectively, if the letter writer knew them 1 year or less (p = 0.002; p = 0.005). Number of EM rotations was not associated with GAS and LOMA scores. Conclusions SLORs written by less experienced letter writers were more likely to have a GAS of "Outstanding" (p < 0.001) and a LOMA of "Very Competitive" (p < 0.001) than more experienced letter writers. The overall distribution of GAS and LOMA was heavily weighted to the highest scores. The length of time a letter writer knew an applicant was significantly associated with GAS and LOMA scores.

Original languageEnglish (US)
Pages (from-to)544-550
Number of pages7
JournalJournal of Emergency Medicine
Volume46
Issue number4
DOIs
StatePublished - 2014

Fingerprint

Emergency Medicine
Internship and Residency
State Medicine

Keywords

  • emergency medicine
  • graduate medical education
  • residency
  • standardized letter of recommendation

ASJC Scopus subject areas

  • Emergency Medicine
  • Medicine(all)

Cite this

Does the experience of the writer affect the evaluative components on the standardized letter of recommendation in emergency medicine? / Beskind, Daniel L.; Hiller, Katherine M; Stolz, Uwe; Bradshaw, Hans; Berkman, Matthew; Stoneking, Lisa R; Fiorello, Albert; Min, Alice; Viscusi, Chad D; Grall, Kristi J H.

In: Journal of Emergency Medicine, Vol. 46, No. 4, 2014, p. 544-550.

Research output: Contribution to journalArticle

@article{bed5452565c746c583554e885d82e13e,
title = "Does the experience of the writer affect the evaluative components on the standardized letter of recommendation in emergency medicine?",
abstract = "Background The Standardized Letter of Recommendation (SLOR) was developed in an attempt to standardize the evaluation of applicants to an emergency medicine (EM) residency. Objective Our aim was to determine whether the Global Assessment Score (GAS) and Likelihood of Matching Assessment (LOMA) of the SLOR for applicants applying to an EM residency are affected by the experience of the letter writer. We describe the distribution of GAS and LOMA grades and compare the GAS and LOMA scores to length of time an applicant knew the letter writer and number of EM rotations. Methods We conducted a retrospective review of all SLORs written for all applicants applying to three EM residency programs for the 2012 match. Median number of letters written the previous year were compared across the four GAS and LOMA scores using an equality of medians test and test for trend to see if higher scores on the GAS and LOMA were associated with less experienced letter writers. Distributions of the scores were determined and length of time a letter writer knew an applicant and number of EM rotations were compared with GAS and LOMA scores. Results There were 917 applicants representing 27.6{\%} of the total applicant pool for the 2012 United States EM residency match and 1253 SLORs for GAS and 1246 for LOMA were analyzed. The highest scores on the GAS and LOMA were associated with the lowest median number of letters written the previous year (equality of medians test across groups, p < 0.001; test for trend, p < 0.001). Less than 3{\%} received the lowest score for GAS and LOMA. Among letter writers that knew an applicant for more than 1 year, 45.3{\%} gave a GAS score of {"}Outstanding{"} and 53.4{\%} gave a LOMA of {"}Very Competitive{"} compared with 31.7{\%} and 39.6{\%}, respectively, if the letter writer knew them 1 year or less (p = 0.002; p = 0.005). Number of EM rotations was not associated with GAS and LOMA scores. Conclusions SLORs written by less experienced letter writers were more likely to have a GAS of {"}Outstanding{"} (p < 0.001) and a LOMA of {"}Very Competitive{"} (p < 0.001) than more experienced letter writers. The overall distribution of GAS and LOMA was heavily weighted to the highest scores. The length of time a letter writer knew an applicant was significantly associated with GAS and LOMA scores.",
keywords = "emergency medicine, graduate medical education, residency, standardized letter of recommendation",
author = "Beskind, {Daniel L.} and Hiller, {Katherine M} and Uwe Stolz and Hans Bradshaw and Matthew Berkman and Stoneking, {Lisa R} and Albert Fiorello and Alice Min and Viscusi, {Chad D} and Grall, {Kristi J H}",
year = "2014",
doi = "10.1016/j.jemermed.2013.08.025",
language = "English (US)",
volume = "46",
pages = "544--550",
journal = "Journal of Emergency Medicine",
issn = "0736-4679",
publisher = "Elsevier USA",
number = "4",

}

TY - JOUR

T1 - Does the experience of the writer affect the evaluative components on the standardized letter of recommendation in emergency medicine?

AU - Beskind, Daniel L.

AU - Hiller, Katherine M

AU - Stolz, Uwe

AU - Bradshaw, Hans

AU - Berkman, Matthew

AU - Stoneking, Lisa R

AU - Fiorello, Albert

AU - Min, Alice

AU - Viscusi, Chad D

AU - Grall, Kristi J H

PY - 2014

Y1 - 2014

N2 - Background The Standardized Letter of Recommendation (SLOR) was developed in an attempt to standardize the evaluation of applicants to an emergency medicine (EM) residency. Objective Our aim was to determine whether the Global Assessment Score (GAS) and Likelihood of Matching Assessment (LOMA) of the SLOR for applicants applying to an EM residency are affected by the experience of the letter writer. We describe the distribution of GAS and LOMA grades and compare the GAS and LOMA scores to length of time an applicant knew the letter writer and number of EM rotations. Methods We conducted a retrospective review of all SLORs written for all applicants applying to three EM residency programs for the 2012 match. Median number of letters written the previous year were compared across the four GAS and LOMA scores using an equality of medians test and test for trend to see if higher scores on the GAS and LOMA were associated with less experienced letter writers. Distributions of the scores were determined and length of time a letter writer knew an applicant and number of EM rotations were compared with GAS and LOMA scores. Results There were 917 applicants representing 27.6% of the total applicant pool for the 2012 United States EM residency match and 1253 SLORs for GAS and 1246 for LOMA were analyzed. The highest scores on the GAS and LOMA were associated with the lowest median number of letters written the previous year (equality of medians test across groups, p < 0.001; test for trend, p < 0.001). Less than 3% received the lowest score for GAS and LOMA. Among letter writers that knew an applicant for more than 1 year, 45.3% gave a GAS score of "Outstanding" and 53.4% gave a LOMA of "Very Competitive" compared with 31.7% and 39.6%, respectively, if the letter writer knew them 1 year or less (p = 0.002; p = 0.005). Number of EM rotations was not associated with GAS and LOMA scores. Conclusions SLORs written by less experienced letter writers were more likely to have a GAS of "Outstanding" (p < 0.001) and a LOMA of "Very Competitive" (p < 0.001) than more experienced letter writers. The overall distribution of GAS and LOMA was heavily weighted to the highest scores. The length of time a letter writer knew an applicant was significantly associated with GAS and LOMA scores.

AB - Background The Standardized Letter of Recommendation (SLOR) was developed in an attempt to standardize the evaluation of applicants to an emergency medicine (EM) residency. Objective Our aim was to determine whether the Global Assessment Score (GAS) and Likelihood of Matching Assessment (LOMA) of the SLOR for applicants applying to an EM residency are affected by the experience of the letter writer. We describe the distribution of GAS and LOMA grades and compare the GAS and LOMA scores to length of time an applicant knew the letter writer and number of EM rotations. Methods We conducted a retrospective review of all SLORs written for all applicants applying to three EM residency programs for the 2012 match. Median number of letters written the previous year were compared across the four GAS and LOMA scores using an equality of medians test and test for trend to see if higher scores on the GAS and LOMA were associated with less experienced letter writers. Distributions of the scores were determined and length of time a letter writer knew an applicant and number of EM rotations were compared with GAS and LOMA scores. Results There were 917 applicants representing 27.6% of the total applicant pool for the 2012 United States EM residency match and 1253 SLORs for GAS and 1246 for LOMA were analyzed. The highest scores on the GAS and LOMA were associated with the lowest median number of letters written the previous year (equality of medians test across groups, p < 0.001; test for trend, p < 0.001). Less than 3% received the lowest score for GAS and LOMA. Among letter writers that knew an applicant for more than 1 year, 45.3% gave a GAS score of "Outstanding" and 53.4% gave a LOMA of "Very Competitive" compared with 31.7% and 39.6%, respectively, if the letter writer knew them 1 year or less (p = 0.002; p = 0.005). Number of EM rotations was not associated with GAS and LOMA scores. Conclusions SLORs written by less experienced letter writers were more likely to have a GAS of "Outstanding" (p < 0.001) and a LOMA of "Very Competitive" (p < 0.001) than more experienced letter writers. The overall distribution of GAS and LOMA was heavily weighted to the highest scores. The length of time a letter writer knew an applicant was significantly associated with GAS and LOMA scores.

KW - emergency medicine

KW - graduate medical education

KW - residency

KW - standardized letter of recommendation

UR - http://www.scopus.com/inward/record.url?scp=84898600189&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84898600189&partnerID=8YFLogxK

U2 - 10.1016/j.jemermed.2013.08.025

DO - 10.1016/j.jemermed.2013.08.025

M3 - Article

C2 - 24113483

AN - SCOPUS:84898600189

VL - 46

SP - 544

EP - 550

JO - Journal of Emergency Medicine

JF - Journal of Emergency Medicine

SN - 0736-4679

IS - 4

ER -