Professional practice evaluation for pathologists

The development, life, and death of the evalumetrics program

Keith E. Volmar, Shannon J. McCall, Ronald B Schifman, Michael L. Talbert, Joseph A. Tworek, Keren I. Hulkower, Anthony J. Guidi, Raouf E. Nakhleh, Rhona J. Souers, Christine P. Bashleben, Barbara J. Blond

Research output: Contribution to journalArticle

Abstract

Context: In 2008, the Joint Commission (JC) implemented a standard mandating formal monitoring of physician professional performance as part of the process of granting and maintaining practice privileges. Objective: To create a pathology-specific management tool to aid pathologists in constructing a professional practice-monitoring program, thereby meeting the JC mandate. Design: A total of 105 College of American Pathologists (CAP)-defined metrics were created. Metrics were based on the job descriptions of pathologists' duties in the laboratory, and metric development was aided by experience from the Q-Probes and Q-Tracks programs. The program was offered in a Web-based format, allowing secure data entry, customization of metrics, and central data collection for future benchmarking. Results: The program was live for 3 years, with 347 pathologists subscribed from 61 practices (median, 4 per institution; range, 1-35). Subscribers used 93 of the CAP-defined metrics and created 109 custom metrics. The median number of CAP-defined metrics used per pathologist was 5 (range, 1-43), and the median custom-defined metrics per pathologist was 2 (range, 1-5). Most frequently, 1 to 3 metrics were monitored (42.7%), with 20% each following 4 to 6 metrics, 5 to 9 metrics, or greater than 10 metrics. Anatomic pathology metrics were used more commonly than clinical pathology metrics. Owing to low registration, the program was discontinued in 2016. Conclusions: Through careful vetting of metrics it was possible to develop a pathologist-specific management tool to address the JC mandate. While this initial product failed, valuable metrics were developed and implementation knowledge was gained that may be used to address new regulatory requirements for emerging value-based payment systems.

Original languageEnglish (US)
Pages (from-to)551-558
Number of pages8
JournalArchives of Pathology and Laboratory Medicine
Volume141
Issue number4
DOIs
StatePublished - Apr 1 2017
Externally publishedYes

Fingerprint

Professional Practice
Joints
Job Description
Pathology
Pathologists
Benchmarking
Clinical Pathology
Physicians

ASJC Scopus subject areas

  • Pathology and Forensic Medicine
  • Medical Laboratory Technology

Cite this

Professional practice evaluation for pathologists : The development, life, and death of the evalumetrics program. / Volmar, Keith E.; McCall, Shannon J.; Schifman, Ronald B; Talbert, Michael L.; Tworek, Joseph A.; Hulkower, Keren I.; Guidi, Anthony J.; Nakhleh, Raouf E.; Souers, Rhona J.; Bashleben, Christine P.; Blond, Barbara J.

In: Archives of Pathology and Laboratory Medicine, Vol. 141, No. 4, 01.04.2017, p. 551-558.

Research output: Contribution to journalArticle

Volmar, KE, McCall, SJ, Schifman, RB, Talbert, ML, Tworek, JA, Hulkower, KI, Guidi, AJ, Nakhleh, RE, Souers, RJ, Bashleben, CP & Blond, BJ 2017, 'Professional practice evaluation for pathologists: The development, life, and death of the evalumetrics program', Archives of Pathology and Laboratory Medicine, vol. 141, no. 4, pp. 551-558. https://doi.org/10.5858/arpa.2016-0275-CP
Volmar, Keith E. ; McCall, Shannon J. ; Schifman, Ronald B ; Talbert, Michael L. ; Tworek, Joseph A. ; Hulkower, Keren I. ; Guidi, Anthony J. ; Nakhleh, Raouf E. ; Souers, Rhona J. ; Bashleben, Christine P. ; Blond, Barbara J. / Professional practice evaluation for pathologists : The development, life, and death of the evalumetrics program. In: Archives of Pathology and Laboratory Medicine. 2017 ; Vol. 141, No. 4. pp. 551-558.
@article{cd3f90b7d9bb4d7a92aa3a976b0d475f,
title = "Professional practice evaluation for pathologists: The development, life, and death of the evalumetrics program",
abstract = "Context: In 2008, the Joint Commission (JC) implemented a standard mandating formal monitoring of physician professional performance as part of the process of granting and maintaining practice privileges. Objective: To create a pathology-specific management tool to aid pathologists in constructing a professional practice-monitoring program, thereby meeting the JC mandate. Design: A total of 105 College of American Pathologists (CAP)-defined metrics were created. Metrics were based on the job descriptions of pathologists' duties in the laboratory, and metric development was aided by experience from the Q-Probes and Q-Tracks programs. The program was offered in a Web-based format, allowing secure data entry, customization of metrics, and central data collection for future benchmarking. Results: The program was live for 3 years, with 347 pathologists subscribed from 61 practices (median, 4 per institution; range, 1-35). Subscribers used 93 of the CAP-defined metrics and created 109 custom metrics. The median number of CAP-defined metrics used per pathologist was 5 (range, 1-43), and the median custom-defined metrics per pathologist was 2 (range, 1-5). Most frequently, 1 to 3 metrics were monitored (42.7{\%}), with 20{\%} each following 4 to 6 metrics, 5 to 9 metrics, or greater than 10 metrics. Anatomic pathology metrics were used more commonly than clinical pathology metrics. Owing to low registration, the program was discontinued in 2016. Conclusions: Through careful vetting of metrics it was possible to develop a pathologist-specific management tool to address the JC mandate. While this initial product failed, valuable metrics were developed and implementation knowledge was gained that may be used to address new regulatory requirements for emerging value-based payment systems.",
author = "Volmar, {Keith E.} and McCall, {Shannon J.} and Schifman, {Ronald B} and Talbert, {Michael L.} and Tworek, {Joseph A.} and Hulkower, {Keren I.} and Guidi, {Anthony J.} and Nakhleh, {Raouf E.} and Souers, {Rhona J.} and Bashleben, {Christine P.} and Blond, {Barbara J.}",
year = "2017",
month = "4",
day = "1",
doi = "10.5858/arpa.2016-0275-CP",
language = "English (US)",
volume = "141",
pages = "551--558",
journal = "Archives of Pathology and Laboratory Medicine",
issn = "0003-9985",
publisher = "College of American Pathologists",
number = "4",

}

TY - JOUR

T1 - Professional practice evaluation for pathologists

T2 - The development, life, and death of the evalumetrics program

AU - Volmar, Keith E.

AU - McCall, Shannon J.

AU - Schifman, Ronald B

AU - Talbert, Michael L.

AU - Tworek, Joseph A.

AU - Hulkower, Keren I.

AU - Guidi, Anthony J.

AU - Nakhleh, Raouf E.

AU - Souers, Rhona J.

AU - Bashleben, Christine P.

AU - Blond, Barbara J.

PY - 2017/4/1

Y1 - 2017/4/1

N2 - Context: In 2008, the Joint Commission (JC) implemented a standard mandating formal monitoring of physician professional performance as part of the process of granting and maintaining practice privileges. Objective: To create a pathology-specific management tool to aid pathologists in constructing a professional practice-monitoring program, thereby meeting the JC mandate. Design: A total of 105 College of American Pathologists (CAP)-defined metrics were created. Metrics were based on the job descriptions of pathologists' duties in the laboratory, and metric development was aided by experience from the Q-Probes and Q-Tracks programs. The program was offered in a Web-based format, allowing secure data entry, customization of metrics, and central data collection for future benchmarking. Results: The program was live for 3 years, with 347 pathologists subscribed from 61 practices (median, 4 per institution; range, 1-35). Subscribers used 93 of the CAP-defined metrics and created 109 custom metrics. The median number of CAP-defined metrics used per pathologist was 5 (range, 1-43), and the median custom-defined metrics per pathologist was 2 (range, 1-5). Most frequently, 1 to 3 metrics were monitored (42.7%), with 20% each following 4 to 6 metrics, 5 to 9 metrics, or greater than 10 metrics. Anatomic pathology metrics were used more commonly than clinical pathology metrics. Owing to low registration, the program was discontinued in 2016. Conclusions: Through careful vetting of metrics it was possible to develop a pathologist-specific management tool to address the JC mandate. While this initial product failed, valuable metrics were developed and implementation knowledge was gained that may be used to address new regulatory requirements for emerging value-based payment systems.

AB - Context: In 2008, the Joint Commission (JC) implemented a standard mandating formal monitoring of physician professional performance as part of the process of granting and maintaining practice privileges. Objective: To create a pathology-specific management tool to aid pathologists in constructing a professional practice-monitoring program, thereby meeting the JC mandate. Design: A total of 105 College of American Pathologists (CAP)-defined metrics were created. Metrics were based on the job descriptions of pathologists' duties in the laboratory, and metric development was aided by experience from the Q-Probes and Q-Tracks programs. The program was offered in a Web-based format, allowing secure data entry, customization of metrics, and central data collection for future benchmarking. Results: The program was live for 3 years, with 347 pathologists subscribed from 61 practices (median, 4 per institution; range, 1-35). Subscribers used 93 of the CAP-defined metrics and created 109 custom metrics. The median number of CAP-defined metrics used per pathologist was 5 (range, 1-43), and the median custom-defined metrics per pathologist was 2 (range, 1-5). Most frequently, 1 to 3 metrics were monitored (42.7%), with 20% each following 4 to 6 metrics, 5 to 9 metrics, or greater than 10 metrics. Anatomic pathology metrics were used more commonly than clinical pathology metrics. Owing to low registration, the program was discontinued in 2016. Conclusions: Through careful vetting of metrics it was possible to develop a pathologist-specific management tool to address the JC mandate. While this initial product failed, valuable metrics were developed and implementation knowledge was gained that may be used to address new regulatory requirements for emerging value-based payment systems.

UR - http://www.scopus.com/inward/record.url?scp=85016455752&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85016455752&partnerID=8YFLogxK

U2 - 10.5858/arpa.2016-0275-CP

DO - 10.5858/arpa.2016-0275-CP

M3 - Article

VL - 141

SP - 551

EP - 558

JO - Archives of Pathology and Laboratory Medicine

JF - Archives of Pathology and Laboratory Medicine

SN - 0003-9985

IS - 4

ER -