Using word clouds to Re-envision letters of recommendation for residency applicants

Sinehan B. Bayrak, Jennifer A. Villwock, Mark R. Villwock, Alexander G Chiu, Kevin J. Sykes

Research output: Contribution to journalArticle

Abstract

Objectives/Hypothesis: To develop a “word cloud”–based visual letter of recommendation (VLOR) and to evaluate its efficiency in discerning applicant quality compared to narrative letters of recommendation (NLORs). Study Design: Cross-sectional cohort study. Methods: NLORs for 48 otolaryngology residency applicants interviewed from the 2016 application cycle were identified and mined for descriptive terms to generate a word cloud, referred to as a VLOR. Eight individuals reviewed and rated a total of 187 blinded NLORs and 48 VLORs on a four-point scale (negative to exceptional). Median VLOR and NLOR scores and the time to review for each candidate were compared using the Wilcoxon signed rank test. Results: It took significantly more time to review the NLORs in comparison to the VLORs (67 seconds, interquartile range [IQR]: 41–98 seconds vs. 17 seconds, IQR: 11–26 seconds, P <.001). There was no significant difference between median scores for VLORs and NLORs (P =.136). Review time and score correlated positively for VLORs and was statistically significant (ρ = 0.459, P =.001), indicating that more time spent reviewing equates to higher scores. The same relationship appeared with NLORs, but was not statistically significant (ρ = 0.276, P =.058). Conclusions: VLORs are a novel and efficient additive tool for screening candidates for otolaryngology residency interview slots. Their scores do not significantly vary from NLOR scores and are significantly faster to evaluate. Level of Evidence: 2b Laryngoscope, 2018.

Original languageEnglish (US)
JournalLaryngoscope
DOIs
StateAccepted/In press - Jan 1 2018
Externally publishedYes

Fingerprint

Internship and Residency
Otolaryngology
Laryngoscopes
Nonparametric Statistics
Cohort Studies
Cross-Sectional Studies
Interviews

Keywords

  • application
  • Letter of recommendation
  • otolaryngology
  • residency

ASJC Scopus subject areas

  • Otorhinolaryngology

Cite this

Using word clouds to Re-envision letters of recommendation for residency applicants. / Bayrak, Sinehan B.; Villwock, Jennifer A.; Villwock, Mark R.; Chiu, Alexander G; Sykes, Kevin J.

In: Laryngoscope, 01.01.2018.

Research output: Contribution to journalArticle

Bayrak, Sinehan B. ; Villwock, Jennifer A. ; Villwock, Mark R. ; Chiu, Alexander G ; Sykes, Kevin J. / Using word clouds to Re-envision letters of recommendation for residency applicants. In: Laryngoscope. 2018.
@article{0e3227453ee146daac901a0fc6762e21,
title = "Using word clouds to Re-envision letters of recommendation for residency applicants",
abstract = "Objectives/Hypothesis: To develop a “word cloud”–based visual letter of recommendation (VLOR) and to evaluate its efficiency in discerning applicant quality compared to narrative letters of recommendation (NLORs). Study Design: Cross-sectional cohort study. Methods: NLORs for 48 otolaryngology residency applicants interviewed from the 2016 application cycle were identified and mined for descriptive terms to generate a word cloud, referred to as a VLOR. Eight individuals reviewed and rated a total of 187 blinded NLORs and 48 VLORs on a four-point scale (negative to exceptional). Median VLOR and NLOR scores and the time to review for each candidate were compared using the Wilcoxon signed rank test. Results: It took significantly more time to review the NLORs in comparison to the VLORs (67 seconds, interquartile range [IQR]: 41–98 seconds vs. 17 seconds, IQR: 11–26 seconds, P <.001). There was no significant difference between median scores for VLORs and NLORs (P =.136). Review time and score correlated positively for VLORs and was statistically significant (ρ = 0.459, P =.001), indicating that more time spent reviewing equates to higher scores. The same relationship appeared with NLORs, but was not statistically significant (ρ = 0.276, P =.058). Conclusions: VLORs are a novel and efficient additive tool for screening candidates for otolaryngology residency interview slots. Their scores do not significantly vary from NLOR scores and are significantly faster to evaluate. Level of Evidence: 2b Laryngoscope, 2018.",
keywords = "application, Letter of recommendation, otolaryngology, residency",
author = "Bayrak, {Sinehan B.} and Villwock, {Jennifer A.} and Villwock, {Mark R.} and Chiu, {Alexander G} and Sykes, {Kevin J.}",
year = "2018",
month = "1",
day = "1",
doi = "10.1002/lary.27613",
language = "English (US)",
journal = "Laryngoscope",
issn = "0023-852X",
publisher = "John Wiley and Sons Inc.",

}

TY - JOUR

T1 - Using word clouds to Re-envision letters of recommendation for residency applicants

AU - Bayrak, Sinehan B.

AU - Villwock, Jennifer A.

AU - Villwock, Mark R.

AU - Chiu, Alexander G

AU - Sykes, Kevin J.

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Objectives/Hypothesis: To develop a “word cloud”–based visual letter of recommendation (VLOR) and to evaluate its efficiency in discerning applicant quality compared to narrative letters of recommendation (NLORs). Study Design: Cross-sectional cohort study. Methods: NLORs for 48 otolaryngology residency applicants interviewed from the 2016 application cycle were identified and mined for descriptive terms to generate a word cloud, referred to as a VLOR. Eight individuals reviewed and rated a total of 187 blinded NLORs and 48 VLORs on a four-point scale (negative to exceptional). Median VLOR and NLOR scores and the time to review for each candidate were compared using the Wilcoxon signed rank test. Results: It took significantly more time to review the NLORs in comparison to the VLORs (67 seconds, interquartile range [IQR]: 41–98 seconds vs. 17 seconds, IQR: 11–26 seconds, P <.001). There was no significant difference between median scores for VLORs and NLORs (P =.136). Review time and score correlated positively for VLORs and was statistically significant (ρ = 0.459, P =.001), indicating that more time spent reviewing equates to higher scores. The same relationship appeared with NLORs, but was not statistically significant (ρ = 0.276, P =.058). Conclusions: VLORs are a novel and efficient additive tool for screening candidates for otolaryngology residency interview slots. Their scores do not significantly vary from NLOR scores and are significantly faster to evaluate. Level of Evidence: 2b Laryngoscope, 2018.

AB - Objectives/Hypothesis: To develop a “word cloud”–based visual letter of recommendation (VLOR) and to evaluate its efficiency in discerning applicant quality compared to narrative letters of recommendation (NLORs). Study Design: Cross-sectional cohort study. Methods: NLORs for 48 otolaryngology residency applicants interviewed from the 2016 application cycle were identified and mined for descriptive terms to generate a word cloud, referred to as a VLOR. Eight individuals reviewed and rated a total of 187 blinded NLORs and 48 VLORs on a four-point scale (negative to exceptional). Median VLOR and NLOR scores and the time to review for each candidate were compared using the Wilcoxon signed rank test. Results: It took significantly more time to review the NLORs in comparison to the VLORs (67 seconds, interquartile range [IQR]: 41–98 seconds vs. 17 seconds, IQR: 11–26 seconds, P <.001). There was no significant difference between median scores for VLORs and NLORs (P =.136). Review time and score correlated positively for VLORs and was statistically significant (ρ = 0.459, P =.001), indicating that more time spent reviewing equates to higher scores. The same relationship appeared with NLORs, but was not statistically significant (ρ = 0.276, P =.058). Conclusions: VLORs are a novel and efficient additive tool for screening candidates for otolaryngology residency interview slots. Their scores do not significantly vary from NLOR scores and are significantly faster to evaluate. Level of Evidence: 2b Laryngoscope, 2018.

KW - application

KW - Letter of recommendation

KW - otolaryngology

KW - residency

UR - http://www.scopus.com/inward/record.url?scp=85057050603&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85057050603&partnerID=8YFLogxK

U2 - 10.1002/lary.27613

DO - 10.1002/lary.27613

M3 - Article

AN - SCOPUS:85057050603

JO - Laryngoscope

JF - Laryngoscope

SN - 0023-852X

ER -