Reliability of scoring respiratory disturbance indices and sleep staging

Coralyn W. Whitney, Daniel J. Gottlieb, Susan Redline, Robert G. Norman, Russell R. Dodge, Eyal Shahar, Susan Surovec, F. Javier Nieto

Research output: Contribution to journalArticle

216 Citations (Scopus)

Abstract

Study Objectives: Unattended, home-based polysomnography (PSG) is increasingly used in both research and clinical settings as an alternative to traditional laboratory-based studies, although the reliability of the scoring of these studies has not been described. The purpose of this study is to describe the reliability of the PSG scoring in the Sleep Heart Health Study (SHHS), a multicenter study of the relation between sleep-disordered breathing measured by unattended, in-home PSG using a portable sleep monitor, and cardiovascular outcomes. Design: The reliability of SHHS scorers was evaluated based on 20 randomly selected studies per scorer, assessing both interscorer and intrascorer reliability. Results: Both inter- and intrascorer comparisons on epoch-by-epoch sleep staging showed excellent reliability (kappa statistics >0.80), with stage 1 having the greatest discrepancies in scoring and stage 3/4 being the most reliably discriminated. The arousal index (number of arousals per hour of sleep) was moderately reliable, with an intraclass correlation (ICC) of 0.54. The scorers were highly reliable on various respiratory disturbance indices (RDIs), which incorporate an associated oxygen desaturation in the definition of respiratory events (2% to 5%) with or without the additional use of associated EEG arousal in the definition of respiratory events (ICC>0.90). When RDI was defined without considering oxygen desaturation or arousals to define respiratory events, the RDI was moderately reliable (ICC=0.74). The additional use of associated EEG arousals, but not oxygen desaturation, in defining respiratory events did little to increase the reliability of the RDI measure (ICC=0.77). Conclusions: The SHHS achieved a high degree of intrascorer and interscorer reliability for the scoring of sleep stage and RDI in unattended in-home PSG studies.

Original languageEnglish (US)
Pages (from-to)749-757
Number of pages9
JournalSleep
Volume21
Issue number7
StatePublished - Nov 1 1998
Externally publishedYes

Fingerprint

Arousal
Sleep
Polysomnography
Oxygen
Electroencephalography
Health
Sleep Stages
Sleep Apnea Syndromes
Multicenter Studies
Research

Keywords

  • Polysomnography
  • Reliability
  • Scoring
  • Sleep apnea syndrome

ASJC Scopus subject areas

  • Physiology

Cite this

Whitney, C. W., Gottlieb, D. J., Redline, S., Norman, R. G., Dodge, R. R., Shahar, E., ... Nieto, F. J. (1998). Reliability of scoring respiratory disturbance indices and sleep staging. Sleep, 21(7), 749-757.

Reliability of scoring respiratory disturbance indices and sleep staging. / Whitney, Coralyn W.; Gottlieb, Daniel J.; Redline, Susan; Norman, Robert G.; Dodge, Russell R.; Shahar, Eyal; Surovec, Susan; Nieto, F. Javier.

In: Sleep, Vol. 21, No. 7, 01.11.1998, p. 749-757.

Research output: Contribution to journalArticle

Whitney, CW, Gottlieb, DJ, Redline, S, Norman, RG, Dodge, RR, Shahar, E, Surovec, S & Nieto, FJ 1998, 'Reliability of scoring respiratory disturbance indices and sleep staging', Sleep, vol. 21, no. 7, pp. 749-757.
Whitney CW, Gottlieb DJ, Redline S, Norman RG, Dodge RR, Shahar E et al. Reliability of scoring respiratory disturbance indices and sleep staging. Sleep. 1998 Nov 1;21(7):749-757.
Whitney, Coralyn W. ; Gottlieb, Daniel J. ; Redline, Susan ; Norman, Robert G. ; Dodge, Russell R. ; Shahar, Eyal ; Surovec, Susan ; Nieto, F. Javier. / Reliability of scoring respiratory disturbance indices and sleep staging. In: Sleep. 1998 ; Vol. 21, No. 7. pp. 749-757.
@article{812cc0dab0354076893d85b763973192,
title = "Reliability of scoring respiratory disturbance indices and sleep staging",
abstract = "Study Objectives: Unattended, home-based polysomnography (PSG) is increasingly used in both research and clinical settings as an alternative to traditional laboratory-based studies, although the reliability of the scoring of these studies has not been described. The purpose of this study is to describe the reliability of the PSG scoring in the Sleep Heart Health Study (SHHS), a multicenter study of the relation between sleep-disordered breathing measured by unattended, in-home PSG using a portable sleep monitor, and cardiovascular outcomes. Design: The reliability of SHHS scorers was evaluated based on 20 randomly selected studies per scorer, assessing both interscorer and intrascorer reliability. Results: Both inter- and intrascorer comparisons on epoch-by-epoch sleep staging showed excellent reliability (kappa statistics >0.80), with stage 1 having the greatest discrepancies in scoring and stage 3/4 being the most reliably discriminated. The arousal index (number of arousals per hour of sleep) was moderately reliable, with an intraclass correlation (ICC) of 0.54. The scorers were highly reliable on various respiratory disturbance indices (RDIs), which incorporate an associated oxygen desaturation in the definition of respiratory events (2{\%} to 5{\%}) with or without the additional use of associated EEG arousal in the definition of respiratory events (ICC>0.90). When RDI was defined without considering oxygen desaturation or arousals to define respiratory events, the RDI was moderately reliable (ICC=0.74). The additional use of associated EEG arousals, but not oxygen desaturation, in defining respiratory events did little to increase the reliability of the RDI measure (ICC=0.77). Conclusions: The SHHS achieved a high degree of intrascorer and interscorer reliability for the scoring of sleep stage and RDI in unattended in-home PSG studies.",
keywords = "Polysomnography, Reliability, Scoring, Sleep apnea syndrome",
author = "Whitney, {Coralyn W.} and Gottlieb, {Daniel J.} and Susan Redline and Norman, {Robert G.} and Dodge, {Russell R.} and Eyal Shahar and Susan Surovec and Nieto, {F. Javier}",
year = "1998",
month = "11",
day = "1",
language = "English (US)",
volume = "21",
pages = "749--757",
journal = "Sleep",
issn = "0161-8105",
publisher = "American Academy of Sleep Medicine",
number = "7",

}

TY - JOUR

T1 - Reliability of scoring respiratory disturbance indices and sleep staging

AU - Whitney, Coralyn W.

AU - Gottlieb, Daniel J.

AU - Redline, Susan

AU - Norman, Robert G.

AU - Dodge, Russell R.

AU - Shahar, Eyal

AU - Surovec, Susan

AU - Nieto, F. Javier

PY - 1998/11/1

Y1 - 1998/11/1

N2 - Study Objectives: Unattended, home-based polysomnography (PSG) is increasingly used in both research and clinical settings as an alternative to traditional laboratory-based studies, although the reliability of the scoring of these studies has not been described. The purpose of this study is to describe the reliability of the PSG scoring in the Sleep Heart Health Study (SHHS), a multicenter study of the relation between sleep-disordered breathing measured by unattended, in-home PSG using a portable sleep monitor, and cardiovascular outcomes. Design: The reliability of SHHS scorers was evaluated based on 20 randomly selected studies per scorer, assessing both interscorer and intrascorer reliability. Results: Both inter- and intrascorer comparisons on epoch-by-epoch sleep staging showed excellent reliability (kappa statistics >0.80), with stage 1 having the greatest discrepancies in scoring and stage 3/4 being the most reliably discriminated. The arousal index (number of arousals per hour of sleep) was moderately reliable, with an intraclass correlation (ICC) of 0.54. The scorers were highly reliable on various respiratory disturbance indices (RDIs), which incorporate an associated oxygen desaturation in the definition of respiratory events (2% to 5%) with or without the additional use of associated EEG arousal in the definition of respiratory events (ICC>0.90). When RDI was defined without considering oxygen desaturation or arousals to define respiratory events, the RDI was moderately reliable (ICC=0.74). The additional use of associated EEG arousals, but not oxygen desaturation, in defining respiratory events did little to increase the reliability of the RDI measure (ICC=0.77). Conclusions: The SHHS achieved a high degree of intrascorer and interscorer reliability for the scoring of sleep stage and RDI in unattended in-home PSG studies.

AB - Study Objectives: Unattended, home-based polysomnography (PSG) is increasingly used in both research and clinical settings as an alternative to traditional laboratory-based studies, although the reliability of the scoring of these studies has not been described. The purpose of this study is to describe the reliability of the PSG scoring in the Sleep Heart Health Study (SHHS), a multicenter study of the relation between sleep-disordered breathing measured by unattended, in-home PSG using a portable sleep monitor, and cardiovascular outcomes. Design: The reliability of SHHS scorers was evaluated based on 20 randomly selected studies per scorer, assessing both interscorer and intrascorer reliability. Results: Both inter- and intrascorer comparisons on epoch-by-epoch sleep staging showed excellent reliability (kappa statistics >0.80), with stage 1 having the greatest discrepancies in scoring and stage 3/4 being the most reliably discriminated. The arousal index (number of arousals per hour of sleep) was moderately reliable, with an intraclass correlation (ICC) of 0.54. The scorers were highly reliable on various respiratory disturbance indices (RDIs), which incorporate an associated oxygen desaturation in the definition of respiratory events (2% to 5%) with or without the additional use of associated EEG arousal in the definition of respiratory events (ICC>0.90). When RDI was defined without considering oxygen desaturation or arousals to define respiratory events, the RDI was moderately reliable (ICC=0.74). The additional use of associated EEG arousals, but not oxygen desaturation, in defining respiratory events did little to increase the reliability of the RDI measure (ICC=0.77). Conclusions: The SHHS achieved a high degree of intrascorer and interscorer reliability for the scoring of sleep stage and RDI in unattended in-home PSG studies.

KW - Polysomnography

KW - Reliability

KW - Scoring

KW - Sleep apnea syndrome

UR - http://www.scopus.com/inward/record.url?scp=0032211801&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0032211801&partnerID=8YFLogxK

M3 - Article

C2 - 11286351

AN - SCOPUS:0032211801

VL - 21

SP - 749

EP - 757

JO - Sleep

JF - Sleep

SN - 0161-8105

IS - 7

ER -