Discrimination of GutCheck NEC: A clinical risk index for necrotizing enterocolitis

Sheila M Gephart, A. R. Spitzer, J. A. Effken, E. Dodd, Melissa D Halpern, J. M. McGrath

Research output: Contribution to journalArticle

32 Citations (Scopus)

Abstract

Objective: Better measures are needed to identify infants at risk for developing necrotizing enterocolitis (NEC) and facilitate communication about risk across transitions. Although NEC is multi-factorial, quantification of composite risk for NEC in an individual infant is not clearly defined. The objective of this study was to describe the derivation, validation and calibration testing of a novel clinical NEC risk index, GutCheckNEC. Individual risk factors were weighted to assess composite odds of developing NEC. GutCheckNEC is designed to improve communication about NEC risk and coordination of care among clinicians across an infant's clinical course. Study design: On the basis of a synthesis of research evidence about NEC risk and an e-Delphi study including 35 neonatal experts, we identified NEC risk factors believed by the experts to be most relevant for a NEC risk index, then applied a logistic model building process to derive and validate GutCheck NEC. De-identified data from the Pediatrix BabySteps Clinical Data Warehouse (discharge date 2007 to 2011) were split into three samples for derivation, validation and calibration. By comparing infants with medical NEC, surgical NEC and those who died to infants without NEC, we derived the logistic model using the un-matched derivation set. Discrimination was then tested in a case-control matched validation set and an un-matched calibration set using receiver operating characteristic curves. Result: Sampled from a cohort of 58 820 infants, the randomly selected derivation set (n=35 013) revealed nine independent risk factors (gestational age, history of packed red blood cell transfusion, unit NEC rate, late-onset sepsis, multiple infections, hypotension treated with inotropic medications, Black or Hispanic race, outborn status and metabolic acidosis) and two risk reducers (human milk feeding on both days 7 and 14 of life, and probiotics). Unit NEC rate carried the most weight in the summed score. Validation using a 2:1 matched case-control sample (n=360) demonstrated fair to good discrimination. In the calibration set (n=23 447), GutCheckNEC scores (range 0 to 58) discriminated those infants who developed surgical NEC (area under the curve (AUC)=0.84, 95% confidence interval (CI) 0.82 to 0.84) and NEC leading to death (AUC=0.83, 95% CI 0.81 to 0.85), more accurately than medical NEC (AUC= 0.72, 95% CI 0.70 to 0.74). Conclusion: GutCheckNEC represents weighted composite risk for NEC and discriminated infants who developed NEC from those who did not with very good accuracy. We speculate that targeting modifiable NEC risk factors could reduce national NEC prevalence.

Original languageEnglish (US)
Pages (from-to)468-475
Number of pages8
JournalJournal of perinatology : official journal of the California Perinatal Association
Volume34
Issue number6
DOIs
StatePublished - 2014

Fingerprint

Necrotizing Enterocolitis
Calibration
Area Under Curve
Confidence Intervals
Logistic Models
Communication
Delphi Technique

ASJC Scopus subject areas

  • Obstetrics and Gynecology
  • Pediatrics, Perinatology, and Child Health
  • Medicine(all)

Cite this

Discrimination of GutCheck NEC : A clinical risk index for necrotizing enterocolitis. / Gephart, Sheila M; Spitzer, A. R.; Effken, J. A.; Dodd, E.; Halpern, Melissa D; McGrath, J. M.

In: Journal of perinatology : official journal of the California Perinatal Association, Vol. 34, No. 6, 2014, p. 468-475.

Research output: Contribution to journalArticle

@article{8e3092d241c14e07b770ee39e8373160,
title = "Discrimination of GutCheck NEC: A clinical risk index for necrotizing enterocolitis",
abstract = "Objective: Better measures are needed to identify infants at risk for developing necrotizing enterocolitis (NEC) and facilitate communication about risk across transitions. Although NEC is multi-factorial, quantification of composite risk for NEC in an individual infant is not clearly defined. The objective of this study was to describe the derivation, validation and calibration testing of a novel clinical NEC risk index, GutCheckNEC. Individual risk factors were weighted to assess composite odds of developing NEC. GutCheckNEC is designed to improve communication about NEC risk and coordination of care among clinicians across an infant's clinical course. Study design: On the basis of a synthesis of research evidence about NEC risk and an e-Delphi study including 35 neonatal experts, we identified NEC risk factors believed by the experts to be most relevant for a NEC risk index, then applied a logistic model building process to derive and validate GutCheck NEC. De-identified data from the Pediatrix BabySteps Clinical Data Warehouse (discharge date 2007 to 2011) were split into three samples for derivation, validation and calibration. By comparing infants with medical NEC, surgical NEC and those who died to infants without NEC, we derived the logistic model using the un-matched derivation set. Discrimination was then tested in a case-control matched validation set and an un-matched calibration set using receiver operating characteristic curves. Result: Sampled from a cohort of 58 820 infants, the randomly selected derivation set (n=35 013) revealed nine independent risk factors (gestational age, history of packed red blood cell transfusion, unit NEC rate, late-onset sepsis, multiple infections, hypotension treated with inotropic medications, Black or Hispanic race, outborn status and metabolic acidosis) and two risk reducers (human milk feeding on both days 7 and 14 of life, and probiotics). Unit NEC rate carried the most weight in the summed score. Validation using a 2:1 matched case-control sample (n=360) demonstrated fair to good discrimination. In the calibration set (n=23 447), GutCheckNEC scores (range 0 to 58) discriminated those infants who developed surgical NEC (area under the curve (AUC)=0.84, 95{\%} confidence interval (CI) 0.82 to 0.84) and NEC leading to death (AUC=0.83, 95{\%} CI 0.81 to 0.85), more accurately than medical NEC (AUC= 0.72, 95{\%} CI 0.70 to 0.74). Conclusion: GutCheckNEC represents weighted composite risk for NEC and discriminated infants who developed NEC from those who did not with very good accuracy. We speculate that targeting modifiable NEC risk factors could reduce national NEC prevalence.",
author = "Gephart, {Sheila M} and Spitzer, {A. R.} and Effken, {J. A.} and E. Dodd and Halpern, {Melissa D} and McGrath, {J. M.}",
year = "2014",
doi = "10.1038/jp.2014.37",
language = "English (US)",
volume = "34",
pages = "468--475",
journal = "Journal of Perinatology",
issn = "0743-8346",
publisher = "Nature Publishing Group",
number = "6",

}

TY - JOUR

T1 - Discrimination of GutCheck NEC

T2 - A clinical risk index for necrotizing enterocolitis

AU - Gephart, Sheila M

AU - Spitzer, A. R.

AU - Effken, J. A.

AU - Dodd, E.

AU - Halpern, Melissa D

AU - McGrath, J. M.

PY - 2014

Y1 - 2014

N2 - Objective: Better measures are needed to identify infants at risk for developing necrotizing enterocolitis (NEC) and facilitate communication about risk across transitions. Although NEC is multi-factorial, quantification of composite risk for NEC in an individual infant is not clearly defined. The objective of this study was to describe the derivation, validation and calibration testing of a novel clinical NEC risk index, GutCheckNEC. Individual risk factors were weighted to assess composite odds of developing NEC. GutCheckNEC is designed to improve communication about NEC risk and coordination of care among clinicians across an infant's clinical course. Study design: On the basis of a synthesis of research evidence about NEC risk and an e-Delphi study including 35 neonatal experts, we identified NEC risk factors believed by the experts to be most relevant for a NEC risk index, then applied a logistic model building process to derive and validate GutCheck NEC. De-identified data from the Pediatrix BabySteps Clinical Data Warehouse (discharge date 2007 to 2011) were split into three samples for derivation, validation and calibration. By comparing infants with medical NEC, surgical NEC and those who died to infants without NEC, we derived the logistic model using the un-matched derivation set. Discrimination was then tested in a case-control matched validation set and an un-matched calibration set using receiver operating characteristic curves. Result: Sampled from a cohort of 58 820 infants, the randomly selected derivation set (n=35 013) revealed nine independent risk factors (gestational age, history of packed red blood cell transfusion, unit NEC rate, late-onset sepsis, multiple infections, hypotension treated with inotropic medications, Black or Hispanic race, outborn status and metabolic acidosis) and two risk reducers (human milk feeding on both days 7 and 14 of life, and probiotics). Unit NEC rate carried the most weight in the summed score. Validation using a 2:1 matched case-control sample (n=360) demonstrated fair to good discrimination. In the calibration set (n=23 447), GutCheckNEC scores (range 0 to 58) discriminated those infants who developed surgical NEC (area under the curve (AUC)=0.84, 95% confidence interval (CI) 0.82 to 0.84) and NEC leading to death (AUC=0.83, 95% CI 0.81 to 0.85), more accurately than medical NEC (AUC= 0.72, 95% CI 0.70 to 0.74). Conclusion: GutCheckNEC represents weighted composite risk for NEC and discriminated infants who developed NEC from those who did not with very good accuracy. We speculate that targeting modifiable NEC risk factors could reduce national NEC prevalence.

AB - Objective: Better measures are needed to identify infants at risk for developing necrotizing enterocolitis (NEC) and facilitate communication about risk across transitions. Although NEC is multi-factorial, quantification of composite risk for NEC in an individual infant is not clearly defined. The objective of this study was to describe the derivation, validation and calibration testing of a novel clinical NEC risk index, GutCheckNEC. Individual risk factors were weighted to assess composite odds of developing NEC. GutCheckNEC is designed to improve communication about NEC risk and coordination of care among clinicians across an infant's clinical course. Study design: On the basis of a synthesis of research evidence about NEC risk and an e-Delphi study including 35 neonatal experts, we identified NEC risk factors believed by the experts to be most relevant for a NEC risk index, then applied a logistic model building process to derive and validate GutCheck NEC. De-identified data from the Pediatrix BabySteps Clinical Data Warehouse (discharge date 2007 to 2011) were split into three samples for derivation, validation and calibration. By comparing infants with medical NEC, surgical NEC and those who died to infants without NEC, we derived the logistic model using the un-matched derivation set. Discrimination was then tested in a case-control matched validation set and an un-matched calibration set using receiver operating characteristic curves. Result: Sampled from a cohort of 58 820 infants, the randomly selected derivation set (n=35 013) revealed nine independent risk factors (gestational age, history of packed red blood cell transfusion, unit NEC rate, late-onset sepsis, multiple infections, hypotension treated with inotropic medications, Black or Hispanic race, outborn status and metabolic acidosis) and two risk reducers (human milk feeding on both days 7 and 14 of life, and probiotics). Unit NEC rate carried the most weight in the summed score. Validation using a 2:1 matched case-control sample (n=360) demonstrated fair to good discrimination. In the calibration set (n=23 447), GutCheckNEC scores (range 0 to 58) discriminated those infants who developed surgical NEC (area under the curve (AUC)=0.84, 95% confidence interval (CI) 0.82 to 0.84) and NEC leading to death (AUC=0.83, 95% CI 0.81 to 0.85), more accurately than medical NEC (AUC= 0.72, 95% CI 0.70 to 0.74). Conclusion: GutCheckNEC represents weighted composite risk for NEC and discriminated infants who developed NEC from those who did not with very good accuracy. We speculate that targeting modifiable NEC risk factors could reduce national NEC prevalence.

UR - http://www.scopus.com/inward/record.url?scp=84901805887&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84901805887&partnerID=8YFLogxK

U2 - 10.1038/jp.2014.37

DO - 10.1038/jp.2014.37

M3 - Article

C2 - 24651734

AN - SCOPUS:84901805887

VL - 34

SP - 468

EP - 475

JO - Journal of Perinatology

JF - Journal of Perinatology

SN - 0743-8346

IS - 6

ER -