Evaluating estimation techniques in medical imaging without a gold standard: Experimental validation

John W. Hoppin, Matthew A Kupinski, Donald W. Wilson, Todd Peterson, Benjamin Gershman, George Kastis, Eric W Clarkson, Lars R Furenlid, Harrison H Barrett

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Citations (Scopus)

Abstract

Imaging is often used for the purpose of estimating the value of some parameter of interest. For example, a cardiologist may measure the ejection fraction (EF) of the heart to quantify how much blood is being pumped out of the heart on each stroke. In clinical practice, however, it is difficult to evaluate an estimation method because the gold standard is not known, e.g., a cardiologist does not know the true EF of a patient. An estimation method is typically evaluated by plotting its results against the results of another (more accepted) estimation method. This approach results in the use of one set of estimates as the pseudo-gold standard. We have developed a maximum-likelihood approach for comparing different estimation methods to the gold standard without the use of the gold standard. In previous works we have displayed the results of numerous simulation studies indicating the method can precisely and accurately estimate the parameters of a regression line without a gold standard, i.e., without the x-axis. In an attempt to further validate our method we have designed an experiment performing volume estimation using a physical phantom and two imaging systems (SPECT,CT).

Original languageEnglish (US)
Title of host publicationProceedings of SPIE - The International Society for Optical Engineering
EditorsP. Chakraborty, E.A. Krupinski
Pages230-237
Number of pages8
Volume5034
DOIs
StatePublished - 2003
EventMedical Imaging 2003: Image Perception, Observer Performance, and Technology Assessment - San Diego, CA, United States
Duration: Feb 18 2003Feb 20 2003

Other

OtherMedical Imaging 2003: Image Perception, Observer Performance, and Technology Assessment
CountryUnited States
CitySan Diego, CA
Period2/18/032/20/03

Fingerprint

Medical imaging
ejection
plotting
estimates
strokes
Imaging systems
Maximum likelihood
blood
regression analysis
Blood
estimating
Imaging techniques
simulation
Experiments

Keywords

  • Image quality
  • Parameter estimation
  • Regression analysis

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Condensed Matter Physics

Cite this

Hoppin, J. W., Kupinski, M. A., Wilson, D. W., Peterson, T., Gershman, B., Kastis, G., ... Barrett, H. H. (2003). Evaluating estimation techniques in medical imaging without a gold standard: Experimental validation. In P. Chakraborty, & E. A. Krupinski (Eds.), Proceedings of SPIE - The International Society for Optical Engineering (Vol. 5034, pp. 230-237) https://doi.org/10.1117/12.480330

Evaluating estimation techniques in medical imaging without a gold standard : Experimental validation. / Hoppin, John W.; Kupinski, Matthew A; Wilson, Donald W.; Peterson, Todd; Gershman, Benjamin; Kastis, George; Clarkson, Eric W; Furenlid, Lars R; Barrett, Harrison H.

Proceedings of SPIE - The International Society for Optical Engineering. ed. / P. Chakraborty; E.A. Krupinski. Vol. 5034 2003. p. 230-237.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Hoppin, JW, Kupinski, MA, Wilson, DW, Peterson, T, Gershman, B, Kastis, G, Clarkson, EW, Furenlid, LR & Barrett, HH 2003, Evaluating estimation techniques in medical imaging without a gold standard: Experimental validation. in P Chakraborty & EA Krupinski (eds), Proceedings of SPIE - The International Society for Optical Engineering. vol. 5034, pp. 230-237, Medical Imaging 2003: Image Perception, Observer Performance, and Technology Assessment, San Diego, CA, United States, 2/18/03. https://doi.org/10.1117/12.480330
Hoppin JW, Kupinski MA, Wilson DW, Peterson T, Gershman B, Kastis G et al. Evaluating estimation techniques in medical imaging without a gold standard: Experimental validation. In Chakraborty P, Krupinski EA, editors, Proceedings of SPIE - The International Society for Optical Engineering. Vol. 5034. 2003. p. 230-237 https://doi.org/10.1117/12.480330
Hoppin, John W. ; Kupinski, Matthew A ; Wilson, Donald W. ; Peterson, Todd ; Gershman, Benjamin ; Kastis, George ; Clarkson, Eric W ; Furenlid, Lars R ; Barrett, Harrison H. / Evaluating estimation techniques in medical imaging without a gold standard : Experimental validation. Proceedings of SPIE - The International Society for Optical Engineering. editor / P. Chakraborty ; E.A. Krupinski. Vol. 5034 2003. pp. 230-237
@inproceedings{d7f7f5bd8bec410189ef6fbd403720f8,
title = "Evaluating estimation techniques in medical imaging without a gold standard: Experimental validation",
abstract = "Imaging is often used for the purpose of estimating the value of some parameter of interest. For example, a cardiologist may measure the ejection fraction (EF) of the heart to quantify how much blood is being pumped out of the heart on each stroke. In clinical practice, however, it is difficult to evaluate an estimation method because the gold standard is not known, e.g., a cardiologist does not know the true EF of a patient. An estimation method is typically evaluated by plotting its results against the results of another (more accepted) estimation method. This approach results in the use of one set of estimates as the pseudo-gold standard. We have developed a maximum-likelihood approach for comparing different estimation methods to the gold standard without the use of the gold standard. In previous works we have displayed the results of numerous simulation studies indicating the method can precisely and accurately estimate the parameters of a regression line without a gold standard, i.e., without the x-axis. In an attempt to further validate our method we have designed an experiment performing volume estimation using a physical phantom and two imaging systems (SPECT,CT).",
keywords = "Image quality, Parameter estimation, Regression analysis",
author = "Hoppin, {John W.} and Kupinski, {Matthew A} and Wilson, {Donald W.} and Todd Peterson and Benjamin Gershman and George Kastis and Clarkson, {Eric W} and Furenlid, {Lars R} and Barrett, {Harrison H}",
year = "2003",
doi = "10.1117/12.480330",
language = "English (US)",
volume = "5034",
pages = "230--237",
editor = "P. Chakraborty and E.A. Krupinski",
booktitle = "Proceedings of SPIE - The International Society for Optical Engineering",

}

TY - GEN

T1 - Evaluating estimation techniques in medical imaging without a gold standard

T2 - Experimental validation

AU - Hoppin, John W.

AU - Kupinski, Matthew A

AU - Wilson, Donald W.

AU - Peterson, Todd

AU - Gershman, Benjamin

AU - Kastis, George

AU - Clarkson, Eric W

AU - Furenlid, Lars R

AU - Barrett, Harrison H

PY - 2003

Y1 - 2003

N2 - Imaging is often used for the purpose of estimating the value of some parameter of interest. For example, a cardiologist may measure the ejection fraction (EF) of the heart to quantify how much blood is being pumped out of the heart on each stroke. In clinical practice, however, it is difficult to evaluate an estimation method because the gold standard is not known, e.g., a cardiologist does not know the true EF of a patient. An estimation method is typically evaluated by plotting its results against the results of another (more accepted) estimation method. This approach results in the use of one set of estimates as the pseudo-gold standard. We have developed a maximum-likelihood approach for comparing different estimation methods to the gold standard without the use of the gold standard. In previous works we have displayed the results of numerous simulation studies indicating the method can precisely and accurately estimate the parameters of a regression line without a gold standard, i.e., without the x-axis. In an attempt to further validate our method we have designed an experiment performing volume estimation using a physical phantom and two imaging systems (SPECT,CT).

AB - Imaging is often used for the purpose of estimating the value of some parameter of interest. For example, a cardiologist may measure the ejection fraction (EF) of the heart to quantify how much blood is being pumped out of the heart on each stroke. In clinical practice, however, it is difficult to evaluate an estimation method because the gold standard is not known, e.g., a cardiologist does not know the true EF of a patient. An estimation method is typically evaluated by plotting its results against the results of another (more accepted) estimation method. This approach results in the use of one set of estimates as the pseudo-gold standard. We have developed a maximum-likelihood approach for comparing different estimation methods to the gold standard without the use of the gold standard. In previous works we have displayed the results of numerous simulation studies indicating the method can precisely and accurately estimate the parameters of a regression line without a gold standard, i.e., without the x-axis. In an attempt to further validate our method we have designed an experiment performing volume estimation using a physical phantom and two imaging systems (SPECT,CT).

KW - Image quality

KW - Parameter estimation

KW - Regression analysis

UR - http://www.scopus.com/inward/record.url?scp=0042860082&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0042860082&partnerID=8YFLogxK

U2 - 10.1117/12.480330

DO - 10.1117/12.480330

M3 - Conference contribution

AN - SCOPUS:0042860082

VL - 5034

SP - 230

EP - 237

BT - Proceedings of SPIE - The International Society for Optical Engineering

A2 - Chakraborty, P.

A2 - Krupinski, E.A.

ER -