A multi-institutional study of the Family Conference Objective Structured Clinical Exam: A reliable assessment of professional communication

Jeffrey G. Chipman, Travis P. Webb, Mohsen Shabahang, Stephanie F. Heller, Joan M. Vancamp, Amy L Waer, Michael G. Luxenberg, Matthew Christenson, Connie C. Schmitz

Research output: Contribution to journalArticle

18 Citations (Scopus)

Abstract

Background: To test the value of a simulated Family Conference Objective Structured Clinical Exam (OSCE) for resident assessment purposes, we examined the generalizability and construct validity of its scores in a multi-institutional study. Methods: Thirty-four first-year (PG1) and 27 third-year (PG3) surgery residents (n = 61) from 6 training programs were tested. The OSCE consisted of 2 cases (End-of-Life [EOL] and Disclosure of Complications [DOC]). At each program, 2 clinicians and 2 standardized family members rated residents using case-specific tools. Performance was measured as the percentage of possible score obtained. We examined the generalizability of scores for each case separately. To assess construct validity, we compared PG1 with PG3 performance using repeated measures multivariate analysis of variance (MANOVA). Results: The relative G-coefficient for EOL was .890. For DOC, the relative G-coefficient was .716. There were no significant performance differences between PG1 and PG3 residents. Conclusions: This OSCE provides reliable assessments suitable for formative evaluation of residents' interpersonal communication skills and professionalism.

Original languageEnglish (US)
Pages (from-to)492-497
Number of pages6
JournalAmerican Journal of Surgery
Volume201
Issue number4
DOIs
StatePublished - Apr 2011

Fingerprint

Disclosure
Communication
Analysis of Variance
Multivariate Analysis
Education
Professionalism
Social Skills

Keywords

  • Assessment
  • Communication
  • Complications
  • End-of-life
  • Objective Structured Clinical Exam (OSCE)
  • Simulation
  • Surgical resident

ASJC Scopus subject areas

  • Surgery

Cite this

A multi-institutional study of the Family Conference Objective Structured Clinical Exam : A reliable assessment of professional communication. / Chipman, Jeffrey G.; Webb, Travis P.; Shabahang, Mohsen; Heller, Stephanie F.; Vancamp, Joan M.; Waer, Amy L; Luxenberg, Michael G.; Christenson, Matthew; Schmitz, Connie C.

In: American Journal of Surgery, Vol. 201, No. 4, 04.2011, p. 492-497.

Research output: Contribution to journalArticle

Chipman, JG, Webb, TP, Shabahang, M, Heller, SF, Vancamp, JM, Waer, AL, Luxenberg, MG, Christenson, M & Schmitz, CC 2011, 'A multi-institutional study of the Family Conference Objective Structured Clinical Exam: A reliable assessment of professional communication', American Journal of Surgery, vol. 201, no. 4, pp. 492-497. https://doi.org/10.1016/j.amjsurg.2010.02.006
Chipman, Jeffrey G. ; Webb, Travis P. ; Shabahang, Mohsen ; Heller, Stephanie F. ; Vancamp, Joan M. ; Waer, Amy L ; Luxenberg, Michael G. ; Christenson, Matthew ; Schmitz, Connie C. / A multi-institutional study of the Family Conference Objective Structured Clinical Exam : A reliable assessment of professional communication. In: American Journal of Surgery. 2011 ; Vol. 201, No. 4. pp. 492-497.
@article{483895f70d144166a5decd8b99b67ede,
title = "A multi-institutional study of the Family Conference Objective Structured Clinical Exam: A reliable assessment of professional communication",
abstract = "Background: To test the value of a simulated Family Conference Objective Structured Clinical Exam (OSCE) for resident assessment purposes, we examined the generalizability and construct validity of its scores in a multi-institutional study. Methods: Thirty-four first-year (PG1) and 27 third-year (PG3) surgery residents (n = 61) from 6 training programs were tested. The OSCE consisted of 2 cases (End-of-Life [EOL] and Disclosure of Complications [DOC]). At each program, 2 clinicians and 2 standardized family members rated residents using case-specific tools. Performance was measured as the percentage of possible score obtained. We examined the generalizability of scores for each case separately. To assess construct validity, we compared PG1 with PG3 performance using repeated measures multivariate analysis of variance (MANOVA). Results: The relative G-coefficient for EOL was .890. For DOC, the relative G-coefficient was .716. There were no significant performance differences between PG1 and PG3 residents. Conclusions: This OSCE provides reliable assessments suitable for formative evaluation of residents' interpersonal communication skills and professionalism.",
keywords = "Assessment, Communication, Complications, End-of-life, Objective Structured Clinical Exam (OSCE), Simulation, Surgical resident",
author = "Chipman, {Jeffrey G.} and Webb, {Travis P.} and Mohsen Shabahang and Heller, {Stephanie F.} and Vancamp, {Joan M.} and Waer, {Amy L} and Luxenberg, {Michael G.} and Matthew Christenson and Schmitz, {Connie C.}",
year = "2011",
month = "4",
doi = "10.1016/j.amjsurg.2010.02.006",
language = "English (US)",
volume = "201",
pages = "492--497",
journal = "American Journal of Surgery",
issn = "0002-9610",
publisher = "Elsevier Inc.",
number = "4",

}

TY - JOUR

T1 - A multi-institutional study of the Family Conference Objective Structured Clinical Exam

T2 - A reliable assessment of professional communication

AU - Chipman, Jeffrey G.

AU - Webb, Travis P.

AU - Shabahang, Mohsen

AU - Heller, Stephanie F.

AU - Vancamp, Joan M.

AU - Waer, Amy L

AU - Luxenberg, Michael G.

AU - Christenson, Matthew

AU - Schmitz, Connie C.

PY - 2011/4

Y1 - 2011/4

N2 - Background: To test the value of a simulated Family Conference Objective Structured Clinical Exam (OSCE) for resident assessment purposes, we examined the generalizability and construct validity of its scores in a multi-institutional study. Methods: Thirty-four first-year (PG1) and 27 third-year (PG3) surgery residents (n = 61) from 6 training programs were tested. The OSCE consisted of 2 cases (End-of-Life [EOL] and Disclosure of Complications [DOC]). At each program, 2 clinicians and 2 standardized family members rated residents using case-specific tools. Performance was measured as the percentage of possible score obtained. We examined the generalizability of scores for each case separately. To assess construct validity, we compared PG1 with PG3 performance using repeated measures multivariate analysis of variance (MANOVA). Results: The relative G-coefficient for EOL was .890. For DOC, the relative G-coefficient was .716. There were no significant performance differences between PG1 and PG3 residents. Conclusions: This OSCE provides reliable assessments suitable for formative evaluation of residents' interpersonal communication skills and professionalism.

AB - Background: To test the value of a simulated Family Conference Objective Structured Clinical Exam (OSCE) for resident assessment purposes, we examined the generalizability and construct validity of its scores in a multi-institutional study. Methods: Thirty-four first-year (PG1) and 27 third-year (PG3) surgery residents (n = 61) from 6 training programs were tested. The OSCE consisted of 2 cases (End-of-Life [EOL] and Disclosure of Complications [DOC]). At each program, 2 clinicians and 2 standardized family members rated residents using case-specific tools. Performance was measured as the percentage of possible score obtained. We examined the generalizability of scores for each case separately. To assess construct validity, we compared PG1 with PG3 performance using repeated measures multivariate analysis of variance (MANOVA). Results: The relative G-coefficient for EOL was .890. For DOC, the relative G-coefficient was .716. There were no significant performance differences between PG1 and PG3 residents. Conclusions: This OSCE provides reliable assessments suitable for formative evaluation of residents' interpersonal communication skills and professionalism.

KW - Assessment

KW - Communication

KW - Complications

KW - End-of-life

KW - Objective Structured Clinical Exam (OSCE)

KW - Simulation

KW - Surgical resident

UR - http://www.scopus.com/inward/record.url?scp=79952984664&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79952984664&partnerID=8YFLogxK

U2 - 10.1016/j.amjsurg.2010.02.006

DO - 10.1016/j.amjsurg.2010.02.006

M3 - Article

C2 - 20850709

AN - SCOPUS:79952984664

VL - 201

SP - 492

EP - 497

JO - American Journal of Surgery

JF - American Journal of Surgery

SN - 0002-9610

IS - 4

ER -