Interobserver Agreement on Clinical Judgment of Work of Breathing in Spontaneously Breathing Children in the Pediatric Intensive Care Unit

Abstract

Clinical assessment of the work of breathing (WOB) remains a cornerstone in respiratory support decision-making in the pediatric intensive care unit (PICU). In this study, we determined the interobserver agreement of 30 observers (PICU physicians and nurses) on WOB and multiple signs of effort of breathing in 10 spontaneously breathing children admitted to the PICU. By reliability analysis, the agreement on overall WOB was poor to moderate, and only three separate signs of effort of breathing (breathing rate, stridor, and grunting) showed moderate-to-good interobserver reliability. We conclude that the interobserver agreement on the clinical WOB judgment among PICU physicians and nurses is low.

Keywords

respiratory distress - children - critical care

• References

• 1 Crow SS, Undavalli C, Warner DO. , et al. Epidemiology of pediatric critical illness in a population-based birth cohort in Olmsted County, MN. Pediatr Crit Care Med 2017; 18 (03) e137-e145
• 2 Ibiebele I, Algert CS, Bowen JR, Roberts CL. Pediatric admissions that include intensive care: a population-based study. BMC Health Serv Res 2018; 18 (01) 264
• 3 Punchak M, Hall K, Seni A. , et al. Epidemiology of disease and mortality from a PICU in Mozambique. Pediatr Crit Care Med 2018; 19 (11) e603-e610
• 4 Cabello B, Mancebo J. Work of breathing. Intensive Care Med 2006; 32 (09) 1311-1314
• 5 Shein SL, Hotz J, Khemani RG. Derivation and validation of an objective effort of breathing score in critically ill children. Pediatr Crit Care Med 2019; 20 (01) e15-e22
• 6 Bekhof J, Reimink R, Brand PL. Systematic review: insufficient validation of clinical scores for the assessment of acute dyspnoea in wheezing children. Paediatr Respir Rev 2014; 15 (01) 98-112
• 7 Maue DK, Krupp N, Rowan CM. Pediatric asthma severity score is associated with critical care interventions. World J Clin Pediatr 2017; 6 (01) 34-39
• 8 Justicia-Grande AJ, Pardo Seco J, Rivero Calle I, Martinón-Torres F. Clinical respiratory scales: which one should we use?. Expert Rev Respir Med 2017; 11 (12) 925-943
• 9 Wang EE, Milner RA, Navas L, Maj H. Observer agreement for respiratory signs and oximetry in infants hospitalized with lower respiratory infections. Am Rev Respir Dis 1992; 145 (01) 106-109
• 10 de Vet HC, Terwee CB, Knol DL, Bouter LM. When to use agreement versus reliability measures. J Clin Epidemiol 2006; 59 (10) 1033-1039
• 11 Bujang MD, Baharum N. A simplified guide to determination of sample size requirements for estimating the value of intraclass correlation coefficient: a review. Arch Orofac Sci 2017; 12: 1-11
• 12 Bekhof J, Reimink R, Bartels IM, Eggink H, Brand PL. Large observer variation of clinical assessment of dyspnoeic wheezing children. Arch Dis Child 2015; 100 (07) 649-653
• 13 Eggink H, Brand P, Reimink R, Bekhof J. Clinical scores for dyspnoea severity in children: a prospective validation study. PLoS One 2016; 11 (07) e0157724
• 14 Khemani RG, Schneider JB, Morzov R, Markovitz B, Newth CJ. Pediatric upper airway obstruction: interobserver variability is the road to perdition. J Crit Care 2013; 28 (04) 490-497
• 15 Biondi EA, Gottfried JA, Dutko Fioravanti I, Schriefer JA, Aligne CA, Leonard MS. Interobserver reliability of attending physicians and bedside nurses when using an inpatient paediatric respiratory score. J Clin Nurs 2015; 24 (9-10): 1320-1326
• 16 Qureshi F, Pestian J, Davis P, Zaritsky A. Effect of nebulized ipratropium on the hospitalization rates of children with asthma. N Engl J Med 1998; 339 (15) 1030-1035
• 17 Fleming S, Thompson M, Stevens R. , et al. Normal ranges of heart rate and respiratory rate in children from birth to 18 years of age: a systematic review of observational studies. Lancet 2011; 377 (9770): 1011-1018