Knowledge elicitation for performance assessment in a computerized surgical training system

Mario Riojas, Chuan Feng, Allan J Hamilton, Jerzy W Rozenblit

Research output: Contribution to journalArticle

21 Citations (Scopus)

Abstract

Effective training is the key to minimizing the dangers of minimally invasive surgery (MIS). At present, the assessment of laparoscopic skills relies on the expertise of senior surgeons. The judgment is typically based on and expressed in ordinal variables that can take values such as low, medium, high or other comparable terms. This limited assessment, along with the lack of expert surgeons' metacognitive awareness of how the judgment process takes place, results in imprecise rules for the evaluation of laparoscopic surgical skills. In this work, we present the knowledge elicitation process to model the performance metrics and the rules involved in the assessment of minimally invasive surgical skills. We have implemented a scoring system for the evaluation of laparoscopic skills based on five performance metrics capable of distinguishing between four proficiency levels while providing a quantitative score. Our assessment model is based on fuzzy logic, so that it is easier to mimic the judgment that is already performed by experienced surgeons. The presented framework was empirically validated using the performance data of 38 subjects belonging to five groups: non-medical students, medical students with no previous laparoscopic training, medical students with some training, residents, and expert surgeons.

Original languageEnglish (US)
Pages (from-to)3697-3708
Number of pages12
JournalApplied Soft Computing Journal
Volume11
Issue number4
DOIs
StatePublished - Jun 2011

Fingerprint

Knowledge acquisition
Students
Surgery
Fuzzy logic

Keywords

  • Fuzzy logic
  • Knowledge elicitation
  • Membership functions
  • Minimally invasive surgery (MIS)
  • Objective assessment
  • Surgical training systems

ASJC Scopus subject areas

  • Software

Cite this

Knowledge elicitation for performance assessment in a computerized surgical training system. / Riojas, Mario; Feng, Chuan; Hamilton, Allan J; Rozenblit, Jerzy W.

In: Applied Soft Computing Journal, Vol. 11, No. 4, 06.2011, p. 3697-3708.

Research output: Contribution to journalArticle

@article{5ade9fe626a747f78bf80ab269b8569e,
title = "Knowledge elicitation for performance assessment in a computerized surgical training system",
abstract = "Effective training is the key to minimizing the dangers of minimally invasive surgery (MIS). At present, the assessment of laparoscopic skills relies on the expertise of senior surgeons. The judgment is typically based on and expressed in ordinal variables that can take values such as low, medium, high or other comparable terms. This limited assessment, along with the lack of expert surgeons' metacognitive awareness of how the judgment process takes place, results in imprecise rules for the evaluation of laparoscopic surgical skills. In this work, we present the knowledge elicitation process to model the performance metrics and the rules involved in the assessment of minimally invasive surgical skills. We have implemented a scoring system for the evaluation of laparoscopic skills based on five performance metrics capable of distinguishing between four proficiency levels while providing a quantitative score. Our assessment model is based on fuzzy logic, so that it is easier to mimic the judgment that is already performed by experienced surgeons. The presented framework was empirically validated using the performance data of 38 subjects belonging to five groups: non-medical students, medical students with no previous laparoscopic training, medical students with some training, residents, and expert surgeons.",
keywords = "Fuzzy logic, Knowledge elicitation, Membership functions, Minimally invasive surgery (MIS), Objective assessment, Surgical training systems",
author = "Mario Riojas and Chuan Feng and Hamilton, {Allan J} and Rozenblit, {Jerzy W}",
year = "2011",
month = "6",
doi = "10.1016/j.asoc.2011.01.041",
language = "English (US)",
volume = "11",
pages = "3697--3708",
journal = "Applied Soft Computing",
issn = "1568-4946",
publisher = "Elsevier BV",
number = "4",

}

TY - JOUR

T1 - Knowledge elicitation for performance assessment in a computerized surgical training system

AU - Riojas, Mario

AU - Feng, Chuan

AU - Hamilton, Allan J

AU - Rozenblit, Jerzy W

PY - 2011/6

Y1 - 2011/6

N2 - Effective training is the key to minimizing the dangers of minimally invasive surgery (MIS). At present, the assessment of laparoscopic skills relies on the expertise of senior surgeons. The judgment is typically based on and expressed in ordinal variables that can take values such as low, medium, high or other comparable terms. This limited assessment, along with the lack of expert surgeons' metacognitive awareness of how the judgment process takes place, results in imprecise rules for the evaluation of laparoscopic surgical skills. In this work, we present the knowledge elicitation process to model the performance metrics and the rules involved in the assessment of minimally invasive surgical skills. We have implemented a scoring system for the evaluation of laparoscopic skills based on five performance metrics capable of distinguishing between four proficiency levels while providing a quantitative score. Our assessment model is based on fuzzy logic, so that it is easier to mimic the judgment that is already performed by experienced surgeons. The presented framework was empirically validated using the performance data of 38 subjects belonging to five groups: non-medical students, medical students with no previous laparoscopic training, medical students with some training, residents, and expert surgeons.

AB - Effective training is the key to minimizing the dangers of minimally invasive surgery (MIS). At present, the assessment of laparoscopic skills relies on the expertise of senior surgeons. The judgment is typically based on and expressed in ordinal variables that can take values such as low, medium, high or other comparable terms. This limited assessment, along with the lack of expert surgeons' metacognitive awareness of how the judgment process takes place, results in imprecise rules for the evaluation of laparoscopic surgical skills. In this work, we present the knowledge elicitation process to model the performance metrics and the rules involved in the assessment of minimally invasive surgical skills. We have implemented a scoring system for the evaluation of laparoscopic skills based on five performance metrics capable of distinguishing between four proficiency levels while providing a quantitative score. Our assessment model is based on fuzzy logic, so that it is easier to mimic the judgment that is already performed by experienced surgeons. The presented framework was empirically validated using the performance data of 38 subjects belonging to five groups: non-medical students, medical students with no previous laparoscopic training, medical students with some training, residents, and expert surgeons.

KW - Fuzzy logic

KW - Knowledge elicitation

KW - Membership functions

KW - Minimally invasive surgery (MIS)

KW - Objective assessment

KW - Surgical training systems

UR - http://www.scopus.com/inward/record.url?scp=79954592096&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79954592096&partnerID=8YFLogxK

U2 - 10.1016/j.asoc.2011.01.041

DO - 10.1016/j.asoc.2011.01.041

M3 - Article

VL - 11

SP - 3697

EP - 3708

JO - Applied Soft Computing

JF - Applied Soft Computing

SN - 1568-4946

IS - 4

ER -