Ideal observers and optimal ROC hypersurfaces in N-class classification

Darrin C. Edwards, Charles E. Metz, Matthew A Kupinski

Research output: Contribution to journalArticle

61 Scopus citations

Abstract

The likelihood ratio, or ideal observer, decision rule is known to be optimal for two-class classification tasks in the sense that it maximizes expected utility (or, equivalently, minimizes the Bayes risk). Furthermore, using this decision rule yields a receiver operating characteristic (ROC) curve which is never above the ROC curve produced using any other decision rule, provided the observer's misclassification rate with respect to one of the two classes is chosen as the dependent variable for the curve (i.e., an "inversion" of the more common formulation in which the observer's true-positive fraction is plotted against its false-positive fraction). It is also known that for a decision task requiring classification of observations into N classes, optimal performance in the expected utility sense is obtained using a set of N - 1 likelihood ratios as decision variables. In the N-class extension of ROC analysis, the ideal observer performance is describable in terms of an (N2 - N - 1)-parameter hypersurface in an (N2 - N)-dimensional probability space. We show that the result for two classes holds in this case as well, namely that the ROC hypersurface obtained using the ideal observer decision rule is never above the ROC hypersurface obtained using any other decision rule (where in our formulation performance is given exclusively with respect to between-class error rates rather than within-class sensitivities).

Original languageEnglish (US)
Pages (from-to)891-895
Number of pages5
JournalIEEE Transactions on Medical Imaging
Volume23
Issue number7
DOIs
Publication statusPublished - Jul 2004

    Fingerprint

Keywords

  • Ideal observer
  • N-class classification
  • ROC analysis

ASJC Scopus subject areas

  • Biomedical Engineering
  • Radiology Nuclear Medicine and imaging
  • Radiological and Ultrasound Technology
  • Electrical and Electronic Engineering
  • Computer Science Applications
  • Computational Theory and Mathematics

Cite this