Correlation between a 2D channelized Hotelling observer and human observers in a low-contrast detection task with multislice reading in CT

Lifeng Yu, Baiyu Chen, James M. Kofler, Christopher P. Favazza, Shuai Leng, Matthew A Kupinski, Cynthia H. McCollough

Research output: Contribution to journalArticle

12 Citations (Scopus)

Abstract

Purpose: Model observers have been successfully developed and used to assess the quality of static 2D CT images. However, radiologists typically read images by paging through multiple 2D slices (i.e., multislice reading). The purpose of this study was to correlate human and model observer performance in a low-contrast detection task performed using both 2D and multislice reading, and to determine if the 2D model observer still correlate well with human observer performance in multislice reading. Methods: A phantom containing 18 low-contrast spheres (6 sizes × 3 contrast levels) was scanned on a 192-slice CT scanner at five dose levels (CTDIvol = 27, 13.5, 6.8, 3.4, and 1.7 mGy), each repeated 100 times. Images were reconstructed using both filtered-backprojection (FBP) and an iterative reconstruction (IR) method (ADMIRE, Siemens). A 3D volume of interest (VOI) around each sphere was extracted and placed side-by-side with a signal-absent VOI to create a 2-alternative forced choice (2AFC) trial. Sixteen 2AFC studies were generated, each with 100 trials, to evaluate the impact of radiation dose, lesion size and contrast, and reconstruction methods on object detection. In total, 1600 trials were presented to both model and human observers. Three medical physicists acted as human observers and were allowed to page through the 3D volumes to make a decision for each 2AFC trial. The human observer performance was compared with the performance of a multislice channelized Hotelling observer (CHO-MS), which integrates multislice image data, and with the performance of previously validated CHO, which operates on static 2D images (CHO-2D). For comparison, the same 16 2AFC studies were also performed in a 2D viewing mode by the human observers and compared with the multislice viewing performance and the two CHO models. Results: Human observer performance was well correlated with the CHO-2D performance in the 2D viewing mode [Pearson product-moment correlation coefficient R = 0.972, 95% confidence interval (CI): 0.919 to 0.990] and with the CHO-MS performance in the multislice viewing mode (R = 0.952, 95% CI: 0.865 to 0.984). The CHO-2D performance, calculated from the 2D viewing mode, also had a strong correlation with human observer performance in the multislice viewing mode (R = 0.957, 95% CI: 879 to 0.985). Human observer performance varied between the multislice and 2D modes. One reader performed better in the multislice mode (P = 0.013); whereas the other two readers showed no significant difference between the two viewing modes (P = 0.057 and P = 0.38). Conclusions: A 2D CHO model is highly correlated with human observer performance in detecting spherical low contrast objects in multislice viewing of CT images. This finding provides some evidence for the use of a simpler, 2D CHO to assess image quality in clinically relevant CT tasks where multislice viewing is used.

Original languageEnglish (US)
Pages (from-to)3990-3999
Number of pages10
JournalMedical Physics
Volume44
Issue number8
DOIs
StatePublished - Aug 1 2017

Fingerprint

Reading
Confidence Intervals
Radiation

Keywords

  • channelized Hotelling observer (CHO)
  • computed tomography (CT)
  • image quality
  • model observer
  • multislice reading
  • task-based image quality assessment

ASJC Scopus subject areas

  • Biophysics
  • Radiology Nuclear Medicine and imaging

Cite this

Correlation between a 2D channelized Hotelling observer and human observers in a low-contrast detection task with multislice reading in CT. / Yu, Lifeng; Chen, Baiyu; Kofler, James M.; Favazza, Christopher P.; Leng, Shuai; Kupinski, Matthew A; McCollough, Cynthia H.

In: Medical Physics, Vol. 44, No. 8, 01.08.2017, p. 3990-3999.

Research output: Contribution to journalArticle

Yu, Lifeng ; Chen, Baiyu ; Kofler, James M. ; Favazza, Christopher P. ; Leng, Shuai ; Kupinski, Matthew A ; McCollough, Cynthia H. / Correlation between a 2D channelized Hotelling observer and human observers in a low-contrast detection task with multislice reading in CT. In: Medical Physics. 2017 ; Vol. 44, No. 8. pp. 3990-3999.
@article{daa60e5140864a0e974d4303f60f6803,
title = "Correlation between a 2D channelized Hotelling observer and human observers in a low-contrast detection task with multislice reading in CT",
abstract = "Purpose: Model observers have been successfully developed and used to assess the quality of static 2D CT images. However, radiologists typically read images by paging through multiple 2D slices (i.e., multislice reading). The purpose of this study was to correlate human and model observer performance in a low-contrast detection task performed using both 2D and multislice reading, and to determine if the 2D model observer still correlate well with human observer performance in multislice reading. Methods: A phantom containing 18 low-contrast spheres (6 sizes × 3 contrast levels) was scanned on a 192-slice CT scanner at five dose levels (CTDIvol = 27, 13.5, 6.8, 3.4, and 1.7 mGy), each repeated 100 times. Images were reconstructed using both filtered-backprojection (FBP) and an iterative reconstruction (IR) method (ADMIRE, Siemens). A 3D volume of interest (VOI) around each sphere was extracted and placed side-by-side with a signal-absent VOI to create a 2-alternative forced choice (2AFC) trial. Sixteen 2AFC studies were generated, each with 100 trials, to evaluate the impact of radiation dose, lesion size and contrast, and reconstruction methods on object detection. In total, 1600 trials were presented to both model and human observers. Three medical physicists acted as human observers and were allowed to page through the 3D volumes to make a decision for each 2AFC trial. The human observer performance was compared with the performance of a multislice channelized Hotelling observer (CHO-MS), which integrates multislice image data, and with the performance of previously validated CHO, which operates on static 2D images (CHO-2D). For comparison, the same 16 2AFC studies were also performed in a 2D viewing mode by the human observers and compared with the multislice viewing performance and the two CHO models. Results: Human observer performance was well correlated with the CHO-2D performance in the 2D viewing mode [Pearson product-moment correlation coefficient R = 0.972, 95{\%} confidence interval (CI): 0.919 to 0.990] and with the CHO-MS performance in the multislice viewing mode (R = 0.952, 95{\%} CI: 0.865 to 0.984). The CHO-2D performance, calculated from the 2D viewing mode, also had a strong correlation with human observer performance in the multislice viewing mode (R = 0.957, 95{\%} CI: 879 to 0.985). Human observer performance varied between the multislice and 2D modes. One reader performed better in the multislice mode (P = 0.013); whereas the other two readers showed no significant difference between the two viewing modes (P = 0.057 and P = 0.38). Conclusions: A 2D CHO model is highly correlated with human observer performance in detecting spherical low contrast objects in multislice viewing of CT images. This finding provides some evidence for the use of a simpler, 2D CHO to assess image quality in clinically relevant CT tasks where multislice viewing is used.",
keywords = "channelized Hotelling observer (CHO), computed tomography (CT), image quality, model observer, multislice reading, task-based image quality assessment",
author = "Lifeng Yu and Baiyu Chen and Kofler, {James M.} and Favazza, {Christopher P.} and Shuai Leng and Kupinski, {Matthew A} and McCollough, {Cynthia H.}",
year = "2017",
month = "8",
day = "1",
doi = "10.1002/mp.12380",
language = "English (US)",
volume = "44",
pages = "3990--3999",
journal = "Medical Physics",
issn = "0094-2405",
publisher = "AAPM - American Association of Physicists in Medicine",
number = "8",

}

TY - JOUR

T1 - Correlation between a 2D channelized Hotelling observer and human observers in a low-contrast detection task with multislice reading in CT

AU - Yu, Lifeng

AU - Chen, Baiyu

AU - Kofler, James M.

AU - Favazza, Christopher P.

AU - Leng, Shuai

AU - Kupinski, Matthew A

AU - McCollough, Cynthia H.

PY - 2017/8/1

Y1 - 2017/8/1

N2 - Purpose: Model observers have been successfully developed and used to assess the quality of static 2D CT images. However, radiologists typically read images by paging through multiple 2D slices (i.e., multislice reading). The purpose of this study was to correlate human and model observer performance in a low-contrast detection task performed using both 2D and multislice reading, and to determine if the 2D model observer still correlate well with human observer performance in multislice reading. Methods: A phantom containing 18 low-contrast spheres (6 sizes × 3 contrast levels) was scanned on a 192-slice CT scanner at five dose levels (CTDIvol = 27, 13.5, 6.8, 3.4, and 1.7 mGy), each repeated 100 times. Images were reconstructed using both filtered-backprojection (FBP) and an iterative reconstruction (IR) method (ADMIRE, Siemens). A 3D volume of interest (VOI) around each sphere was extracted and placed side-by-side with a signal-absent VOI to create a 2-alternative forced choice (2AFC) trial. Sixteen 2AFC studies were generated, each with 100 trials, to evaluate the impact of radiation dose, lesion size and contrast, and reconstruction methods on object detection. In total, 1600 trials were presented to both model and human observers. Three medical physicists acted as human observers and were allowed to page through the 3D volumes to make a decision for each 2AFC trial. The human observer performance was compared with the performance of a multislice channelized Hotelling observer (CHO-MS), which integrates multislice image data, and with the performance of previously validated CHO, which operates on static 2D images (CHO-2D). For comparison, the same 16 2AFC studies were also performed in a 2D viewing mode by the human observers and compared with the multislice viewing performance and the two CHO models. Results: Human observer performance was well correlated with the CHO-2D performance in the 2D viewing mode [Pearson product-moment correlation coefficient R = 0.972, 95% confidence interval (CI): 0.919 to 0.990] and with the CHO-MS performance in the multislice viewing mode (R = 0.952, 95% CI: 0.865 to 0.984). The CHO-2D performance, calculated from the 2D viewing mode, also had a strong correlation with human observer performance in the multislice viewing mode (R = 0.957, 95% CI: 879 to 0.985). Human observer performance varied between the multislice and 2D modes. One reader performed better in the multislice mode (P = 0.013); whereas the other two readers showed no significant difference between the two viewing modes (P = 0.057 and P = 0.38). Conclusions: A 2D CHO model is highly correlated with human observer performance in detecting spherical low contrast objects in multislice viewing of CT images. This finding provides some evidence for the use of a simpler, 2D CHO to assess image quality in clinically relevant CT tasks where multislice viewing is used.

AB - Purpose: Model observers have been successfully developed and used to assess the quality of static 2D CT images. However, radiologists typically read images by paging through multiple 2D slices (i.e., multislice reading). The purpose of this study was to correlate human and model observer performance in a low-contrast detection task performed using both 2D and multislice reading, and to determine if the 2D model observer still correlate well with human observer performance in multislice reading. Methods: A phantom containing 18 low-contrast spheres (6 sizes × 3 contrast levels) was scanned on a 192-slice CT scanner at five dose levels (CTDIvol = 27, 13.5, 6.8, 3.4, and 1.7 mGy), each repeated 100 times. Images were reconstructed using both filtered-backprojection (FBP) and an iterative reconstruction (IR) method (ADMIRE, Siemens). A 3D volume of interest (VOI) around each sphere was extracted and placed side-by-side with a signal-absent VOI to create a 2-alternative forced choice (2AFC) trial. Sixteen 2AFC studies were generated, each with 100 trials, to evaluate the impact of radiation dose, lesion size and contrast, and reconstruction methods on object detection. In total, 1600 trials were presented to both model and human observers. Three medical physicists acted as human observers and were allowed to page through the 3D volumes to make a decision for each 2AFC trial. The human observer performance was compared with the performance of a multislice channelized Hotelling observer (CHO-MS), which integrates multislice image data, and with the performance of previously validated CHO, which operates on static 2D images (CHO-2D). For comparison, the same 16 2AFC studies were also performed in a 2D viewing mode by the human observers and compared with the multislice viewing performance and the two CHO models. Results: Human observer performance was well correlated with the CHO-2D performance in the 2D viewing mode [Pearson product-moment correlation coefficient R = 0.972, 95% confidence interval (CI): 0.919 to 0.990] and with the CHO-MS performance in the multislice viewing mode (R = 0.952, 95% CI: 0.865 to 0.984). The CHO-2D performance, calculated from the 2D viewing mode, also had a strong correlation with human observer performance in the multislice viewing mode (R = 0.957, 95% CI: 879 to 0.985). Human observer performance varied between the multislice and 2D modes. One reader performed better in the multislice mode (P = 0.013); whereas the other two readers showed no significant difference between the two viewing modes (P = 0.057 and P = 0.38). Conclusions: A 2D CHO model is highly correlated with human observer performance in detecting spherical low contrast objects in multislice viewing of CT images. This finding provides some evidence for the use of a simpler, 2D CHO to assess image quality in clinically relevant CT tasks where multislice viewing is used.

KW - channelized Hotelling observer (CHO)

KW - computed tomography (CT)

KW - image quality

KW - model observer

KW - multislice reading

KW - task-based image quality assessment

UR - http://www.scopus.com/inward/record.url?scp=85023643653&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85023643653&partnerID=8YFLogxK

U2 - 10.1002/mp.12380

DO - 10.1002/mp.12380

M3 - Article

C2 - 28555878

AN - SCOPUS:85023643653

VL - 44

SP - 3990

EP - 3999

JO - Medical Physics

JF - Medical Physics

SN - 0094-2405

IS - 8

ER -