The Impact of Fatigue on Satisfaction of Search in Chest Radiography

Elizabeth A Krupinski, Kevin S. Berbaum, Kevin M. Schartz, Robert T. Caldwell, Mark T. Madsen

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Rationale and Objectives: To assess the nature of the satisfaction of search (SOS) effect in chest radiography when observers are fatigued; determine if we could replicate recent findings that have documented the nature of the SOS effect to be due to a threshold shift rather than a change in diagnostic accuracy as in earlier film-based studies. Materials and Methods: Nearing or at the end of a clinical workday, 20 radiologists read 64 chest images twice, once with and once without the addition of a simulated pulmonary nodule. Half of the images had different types of "test" abnormalities. Decision thresholds were analyzed using the center of the range of false-positive (FP) and true-positive (TP) fractions associated with each receiver operating characteristic (ROC) point for reporting test abnormalities. Detection accuracy was assessed with ROC technique and inspection time was recorded. Results: The SOS effect was confirmed to be a reduction in willingness to respond (threshold shift). The center of the FP range was significantly reduced (FP = 0.10 without added nodules, FP = 0.05 with added nodules, F(1,18) = 19.85, P = 0.0003). The center of the TP range was significantly reduced (TP = 0.39 without added nodules, TP = 0.33 with added nodules, F(1,18) = 10.81, P = 0.004). Conclusions: This study suggests that fatigue does not change the nature of the SOS effect, but rather may be additive with the SOS effect. SOS reduces both TP and FP responses, whereas fatigue reduces TPs more than FPs.

Original languageEnglish (US)
JournalAcademic Radiology
DOIs
StateAccepted/In press - Jan 16 2017
Externally publishedYes

Fingerprint

Radiography
Fatigue
Thorax
ROC Curve
Lung

Keywords

  • Accuracy
  • Fatigue
  • Performance
  • Satisfaction of search

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging

Cite this

The Impact of Fatigue on Satisfaction of Search in Chest Radiography. / Krupinski, Elizabeth A; Berbaum, Kevin S.; Schartz, Kevin M.; Caldwell, Robert T.; Madsen, Mark T.

In: Academic Radiology, 16.01.2017.

Research output: Contribution to journalArticle

Krupinski, Elizabeth A ; Berbaum, Kevin S. ; Schartz, Kevin M. ; Caldwell, Robert T. ; Madsen, Mark T. / The Impact of Fatigue on Satisfaction of Search in Chest Radiography. In: Academic Radiology. 2017.
@article{656b3f6c523f4846a98ee31a7c8ee946,
title = "The Impact of Fatigue on Satisfaction of Search in Chest Radiography",
abstract = "Rationale and Objectives: To assess the nature of the satisfaction of search (SOS) effect in chest radiography when observers are fatigued; determine if we could replicate recent findings that have documented the nature of the SOS effect to be due to a threshold shift rather than a change in diagnostic accuracy as in earlier film-based studies. Materials and Methods: Nearing or at the end of a clinical workday, 20 radiologists read 64 chest images twice, once with and once without the addition of a simulated pulmonary nodule. Half of the images had different types of {"}test{"} abnormalities. Decision thresholds were analyzed using the center of the range of false-positive (FP) and true-positive (TP) fractions associated with each receiver operating characteristic (ROC) point for reporting test abnormalities. Detection accuracy was assessed with ROC technique and inspection time was recorded. Results: The SOS effect was confirmed to be a reduction in willingness to respond (threshold shift). The center of the FP range was significantly reduced (FP = 0.10 without added nodules, FP = 0.05 with added nodules, F(1,18) = 19.85, P = 0.0003). The center of the TP range was significantly reduced (TP = 0.39 without added nodules, TP = 0.33 with added nodules, F(1,18) = 10.81, P = 0.004). Conclusions: This study suggests that fatigue does not change the nature of the SOS effect, but rather may be additive with the SOS effect. SOS reduces both TP and FP responses, whereas fatigue reduces TPs more than FPs.",
keywords = "Accuracy, Fatigue, Performance, Satisfaction of search",
author = "Krupinski, {Elizabeth A} and Berbaum, {Kevin S.} and Schartz, {Kevin M.} and Caldwell, {Robert T.} and Madsen, {Mark T.}",
year = "2017",
month = "1",
day = "16",
doi = "10.1016/j.acra.2017.03.021",
language = "English (US)",
journal = "Academic Radiology",
issn = "1076-6332",
publisher = "Elsevier USA",

}

TY - JOUR

T1 - The Impact of Fatigue on Satisfaction of Search in Chest Radiography

AU - Krupinski, Elizabeth A

AU - Berbaum, Kevin S.

AU - Schartz, Kevin M.

AU - Caldwell, Robert T.

AU - Madsen, Mark T.

PY - 2017/1/16

Y1 - 2017/1/16

N2 - Rationale and Objectives: To assess the nature of the satisfaction of search (SOS) effect in chest radiography when observers are fatigued; determine if we could replicate recent findings that have documented the nature of the SOS effect to be due to a threshold shift rather than a change in diagnostic accuracy as in earlier film-based studies. Materials and Methods: Nearing or at the end of a clinical workday, 20 radiologists read 64 chest images twice, once with and once without the addition of a simulated pulmonary nodule. Half of the images had different types of "test" abnormalities. Decision thresholds were analyzed using the center of the range of false-positive (FP) and true-positive (TP) fractions associated with each receiver operating characteristic (ROC) point for reporting test abnormalities. Detection accuracy was assessed with ROC technique and inspection time was recorded. Results: The SOS effect was confirmed to be a reduction in willingness to respond (threshold shift). The center of the FP range was significantly reduced (FP = 0.10 without added nodules, FP = 0.05 with added nodules, F(1,18) = 19.85, P = 0.0003). The center of the TP range was significantly reduced (TP = 0.39 without added nodules, TP = 0.33 with added nodules, F(1,18) = 10.81, P = 0.004). Conclusions: This study suggests that fatigue does not change the nature of the SOS effect, but rather may be additive with the SOS effect. SOS reduces both TP and FP responses, whereas fatigue reduces TPs more than FPs.

AB - Rationale and Objectives: To assess the nature of the satisfaction of search (SOS) effect in chest radiography when observers are fatigued; determine if we could replicate recent findings that have documented the nature of the SOS effect to be due to a threshold shift rather than a change in diagnostic accuracy as in earlier film-based studies. Materials and Methods: Nearing or at the end of a clinical workday, 20 radiologists read 64 chest images twice, once with and once without the addition of a simulated pulmonary nodule. Half of the images had different types of "test" abnormalities. Decision thresholds were analyzed using the center of the range of false-positive (FP) and true-positive (TP) fractions associated with each receiver operating characteristic (ROC) point for reporting test abnormalities. Detection accuracy was assessed with ROC technique and inspection time was recorded. Results: The SOS effect was confirmed to be a reduction in willingness to respond (threshold shift). The center of the FP range was significantly reduced (FP = 0.10 without added nodules, FP = 0.05 with added nodules, F(1,18) = 19.85, P = 0.0003). The center of the TP range was significantly reduced (TP = 0.39 without added nodules, TP = 0.33 with added nodules, F(1,18) = 10.81, P = 0.004). Conclusions: This study suggests that fatigue does not change the nature of the SOS effect, but rather may be additive with the SOS effect. SOS reduces both TP and FP responses, whereas fatigue reduces TPs more than FPs.

KW - Accuracy

KW - Fatigue

KW - Performance

KW - Satisfaction of search

UR - http://www.scopus.com/inward/record.url?scp=85019598194&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85019598194&partnerID=8YFLogxK

U2 - 10.1016/j.acra.2017.03.021

DO - 10.1016/j.acra.2017.03.021

M3 - Article

JO - Academic Radiology

JF - Academic Radiology

SN - 1076-6332

ER -