Investigation of an Automatic Sleep Stage Classification by Means of Multiscorer Hypnogram

Summary

Objectives: Scoring sleep visually based on polysomnography is an important but time-consuming element of sleep medicine. Whereas computer software assists human experts in the assignment of sleep stages to polysomnogram epochs, their performance is usually insufficient. This study evaluates the possibility to fully automatize sleep staging considering the reliability of the sleep stages available from human expert sleep scorers.

Methods: We obtain features from EEG, ECG and respiratory signals of polysomnograms from ten healthy subjects. Using the sleep stages provided by three human experts, we evaluate the performance of linear discriminant analysis on the entire polysomnogram and only on epochs where the three experts agree in their sleep stage scoring.

Results: We show that in polysomnogram intervals, to which all three scorers assign the same sleep stage, our algorithm achieves 90% accuracy. This high rate of agreement with the human experts is accomplished with only a small set of three frequency features from the EEG. We increase the performance to 93% by including ECG and respiration features. In contrast, on intervals of ambiguous sleep stage, the sleep stage classification obtained from our algorithm, agrees with the human consensus scorer in approximately 61%.

Conclusions: These findings suggest that machine classification is highly consistent with human sleep staging and that error in the algorithm’s assignments is rather a problem of lack of well-defined criteria for human experts to judge certain polysomnogram epochs than an insufficiency of computational procedures.

Keywords

Sleep staging - polysomnogram - linear discriminant analysis - automatic classification

• References

• 1 Rechtschaffen A, Kales A. A manual of standardized terminology, techniques and scoring system for sleep stages of human subjects. Washington DC: US Government Printing Office, US Public Health Ser-vice; 1968
• 2 Iber C, Ancoli-Israel S, Chesson A, Quan SF. The AASM Manual for the scoring of sleep and associated events: Rules, terminology and technical specifications. American Academy of Sleep Medicine. 2007
• 3 Danker-Hopfe H, Anderer P, Zeitlhofer J, Boeck M, Dorn H, Gruber G. et al. Interrater reliability (IRR) for sleep scoring according to the Rechtschaffen & Kales and the new AASM standard. J Sleep Res 2009; 18 (01) 74-84.
• 4 Anderer P, Gruber G, Parapatics S, Wörtz M, Miazhynskaia T, Klosch G. et al. An E-health solution for automatic sleep classification according to Rechtschaffen and Kales: validation study of the Somnolyzer 24 × 7 utilizing the Siesta database. Neuropsychobiology 2005; 51 (03) 115-133.
• 5 Caffarel J, Gibson GJ, Harrison JP, Griffiths CJ, Drinnan MJ. Comparison of manual sleep staging with automated neural network-based analysis in clinical practice. Med Biol Eng Comput 2006; 44 1–2 105-110.
• 6 Klösh G, Kemp B, Penzel T, Schlögl A, Rappelsberger P, Trenker E. et al. The SIESTA project poly-graphic and clinical database. IEEE Eng Med Biol Mag 2001; 20 (03) 51-57.
• 7 Welch AJ, Richardson PC. Computer sleep stage classification using heart rate data. Electroen Clin Neuro 1973; 34 (02) 145-152.
• 8 Redmond SJ, Chazal P, O’Brien C, Ryan S, McNicholas WT, Heneghan C. Sleep staging using cardiorespiratory signals. Somnologie – Schlafforschung und Schlafmedizin 2007; 11 (04) 245-256.
• 9 Task Force of The European Society of Cardiology and The North American Society of Pacing and Electrophysiology: Heart rate Variability: Standards of Measurement, Physiological Interpretation, and Clinical Use. Eur Heart J 1996; 17 (03) 354-381.
• 10 Wessel N, Malberg H, Bauernschmitt R, Kurths J. Nonlinear methods of cardiovascular physics and their clinical applicability. Int J Bif Chaos 2007; 17 (10) 3325-3371.
• 11 Wessel N, Ziehmann C, Kurths J, Meyerfeldt U, Schirdewan A, Voss A. Short-term forecasting of life-threatening cardiac arrhythmias based on symbolic dynamics and finite-time growth rates. Phys Rev E 2000; 61 (01) 733-739.
• 12 Voss A, Kurths J, Kleiner HJ, Witt A, Wessel N. Improved analysis of heart rate variability by methods of non-linear dynamics. J Electrocardiol 1995; 28 Suppl 81-88.
• 13 Voss A, Hnatkova K, Wessel N, Kurths J, Sander A, Schirdewan A. et al. Multiparametric analysis of heart rate variability used for risk stratification among survivors of acute myocardial infarction. Pacing Clin Electrophysiol 1998; 21 1 Pt 2 186-192.
• 14 Wessel N, Malberg H, Meyerfeldt U, Schirdewan A, Kurths J. Classifying simulated and physiological heart rate variability signals. Comput Cardiol 2002; 29: 133-135.
• 15 Wessel N, Malberg H, Heringer-Walther S, Schultheiss HP, Walther T. The angiotensin-(1–7) receptor agonist AVE0991 dominates the circadian rhythm and baroreflex in spontaneously hypertensive rats. J Cardiovasc Pharmacol 2007; 49 (02) 67-73.
• 16 Wessel N, Bauernschmitt R, Wernicke D, Kurths J, Malberg H. Autonomic cardiac control in animal models of cardiovascular diseases I. Methods of variability analysis. Biomed Tech (Berl) 2007; 52 (01) 43-49.
• 17 Wessel N, Voss A, Malberg H, Ziehmann C, Voss HU, Schirdewan A. et al. Nonlinear analysis of complex phenomena in cardiological data. Herzschr Elektrophys 2000; 11 (03) 159-173.
• 18 Voss A, Kurths J, Kleiner HJ, Witt A, Wessel N, Saparin P. et al. The application of methods of non-linear dynamics for the improved and predictive recognition of patients threatened by sudden cardiac death. Cardiovasc Res 1996; 31 (03) 419-433.
• 19 Hastie T, Tibshirani R, Friedman J. The elements of statistical learning: data mining, inference, and prediction. Springer; 2001
• 20 Kaufman L, Rousseeuw PJ. Finding groups in data: an introduction to cluster analysis. John Wiley & Sons; 1990
• 21 Penzel T, Conradt R. Computer based sleep recording and analysis. Sleep Med Rev 2000; 4 (02) 131-148.
• 22 Penzel T, Behler PG, von Buttlar M, Conradt R, Meier M, Möller A. et al. Reliabilität der visuellen Schlafauswertung nach Rechtschaffen und Kales von acht Aufzeichnungen durch neun Schlaflabore. Somnologie 2003; 7 (02) 49-58.
• 23 Danker-Hopfe H, Kunz D, Gruber G, Klösch G, Lorenzo JL, Himanen SL. et al. Interrater reliability between scorers from eight European sleep laboratories in subjects with different sleep disorders. J Sleep Res 2004; 13 (01) 63-69.