Evaluation of Predictive Models for Complications following Spinal Surgery

Abstract

Background Complications rates vary across spinal surgery procedures and are difficult to predict due to heterogeneity in patient characteristics, surgical methods, and hospital volume. Incorporation of predictive models for complications may guide surgeon decision making and improve outcomes.

Methods We evaluate current independently validated predictive models for complications in spinal surgery with respect to study design and model generation, accuracy, reliability, and utility. We conducted our search using Preferred Reporting Items for Systematic Review and Meta-analysis guidelines and the Participants, Intervention, Comparison, Outcomes, Study Design model through the PubMed and Ovid Medline databases.

Results A total of 18 articles met inclusion criteria including 30 validated predictive models of complications after adult spinal surgery. National registry databases were used in 12 studies. Validation cohorts were used in seven studies for verification; three studies used other methods including random sample bootstrapping techniques or cross-validation. Reported area under the curve (AUC) values ranged from 0.37 to 1.0. Studies described treatment for deformity, degenerative conditions, inclusive spinal surgery (neoplasm, trauma, infection, deformity, degenerative), and miscellaneous (disk herniation, spinal epidural abscess). The most commonly cited risk factors for complications included in predictive models included age, body mass index, diabetes, sex, and smoking. Those models in the deformity subset that included radiographic and anatomical grading features reported higher AUC values than those that included patient demographics or medical comorbidities alone.

Conclusions We identified a cohort of 30 validated predictive models of complications following spinal surgery for degenerative conditions, deformity, infection, and trauma. Accurate evidence-based predictive models may enhance shared decision making, improve rehabilitation, reduce adverse events, and inform best practices.

Keywords

predictive models - complications - infection - spinal surgery - risk factors

Publikationsverlauf

Eingereicht: 20. Juli 2019

Angenommen: 21. Oktober 2019

Artikel online veröffentlicht:
14. August 2020

• References

• 1 Nasser R, Yadla S, Maltenfort MG. et al. Complications in spine surgery. J Neurosurg Spine 2010; 13 (02) 144-157
• 2 Yadla S, Maltenfort MG, Ratliff JK, Harrop JS. Adult scoliosis surgery outcomes: a systematic review. Neurosurg Focus 2010; 28 (03) E3
• 3 Carreon LY, Puno RM, Dimar II JR, Glassman SD, Johnson JR. Perioperative complications of posterior lumbar decompression and arthrodesis in older adults. J Bone Joint Surg Am 2003; 85 (11) 2089-2092
• 4 McDonnell MF, Glassman SD, Dimar II JR, Puno RM, Johnson JR. Perioperative complications of anterior procedures on the spine. J Bone Joint Surg Am 1996; 78 (06) 839-847
• 5 Baron EM, Albert TJ. Medical complications of surgical treatment of adult spinal deformity and how to avoid them. Spine 2006; 31 (19, Suppl:) S106-S118
• 6 Whitmore RG, Stephen JH, Vernick C. et al. ASA grade and Charlson Comorbidity Index of spinal surgery patients: correlation with complications and societal costs. Spine J 2014; 14 (01) 31-38
• 7 Oresanya LB, Lyons WL, Finlayson E. Preoperative assessment of the older patient: a narrative review. JAMA 2014; 311 (20) 2110-2120
• 8 Reis RC, de Oliveira MF, Rotta JM, Botelho RV. Risk of complications in spine surgery: a prospective study. Open Orthop J 2015; 9: 20-25
• 9 Moher D, Liberati A, Tetzlaff J, Altman DG. PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol 2009; 62 (10) 1006-1012
• 10 Zweig MH, Campbell G. Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. Clin Chem 1993; 39 (04) 561-577
• 11 Schwab FJ, Lafage V, Farcy JP, Bridwell KH, Glassman S, Shainline MR. Predicting outcome and complications in the surgical treatment of adult scoliosis. Spine 2008; 33 (20) 2243-2247
• 12 Scheer JK, Smith JS, Schwab F. et al; International Spine Study Group. Development of a preoperative predictive model for major complications following adult spinal deformity surgery. J Neurosurg Spine 2017; 26 (06) 736-743
• 13 Buchlak QD, Yanamadala V, Leveque JC, Edwards A, Nold K, Sethi R. The Seattle spine score: predicting 30-day complication risk in adult spinal deformity surgery. J Clin Neurosci 2017; 43: 247-255
• 14 Scheer JK, Osorio JA, Smith JS. et al; International Spine Study Group. Development of validated computer-based preoperative predictive model for proximal junction failure (PJF) or clinically significant PJK with 86% Accuracy Based on 510 ASD patients with 2-year follow-up. Spine 2016; 41 (22) E1328-E1335
• 15 Yagi M, Fujita N, Okada E. et al. Fine-tuning the predictive model for proximal junctional failure in surgically treated patients with adult spinal deformity. Spine 2018; 43 (11) 767-773
• 16 Pellisé F, Vila-Casademunt A, Núñez-Pereira S. et al; European Spine Study Group. The Adult Deformity Surgery Complexity Index (ADSCI): a valid tool to quantify the complexity of posterior adult spinal deformity surgery and predict postoperative complications. Spine J 2018; 18 (02) 216-225
• 17 Chitale R, Campbell PG, Yadla S, Whitmore RG, Maltenfort MG, Ratliff JK. International Classification of Disease Clinical Modification 9 modeling of a patient comorbidity score predicts incidence of perioperative complications in a nationwide inpatient sample assessment of complications in spine surgery. J Spinal Disord Tech 2015; 28 (04) 126-133
• 18 McGirt MJ, Sivaganesan A, Asher AL, Devin CJ. Prediction model for outcome after low-back surgery: individualized likelihood of complication, hospital readmission, return to work, and 12-month improvement in functional disability. Neurosurg Focus 2015; 39 (06) E13
• 19 Klemencsics I, Lazary A, Szoverfi Z, Bozsodi A, Eltes P, Varga PP. Risk factors for surgical site infection in elective routine degenerative lumbar surgeries. Spine J 2016; 16 (11) 1377-1383
• 20 Wang X, Hu Y, Zhao B, Su Y. Predictive validity of the ACS-NSQIP surgical risk calculator in geriatric patients undergoing lumbar surgery. Medicine (Baltimore) 2017; 96 (43) e8416
• 21 Kim JS, Merrill RK, Arvind V. et al. Examining the ability of artificial neural networks machine learning models to accurately predict complications following posterior lumbar spine fusion. Spine 2018; 43 (12) 853-860
• 22 Lee MJ, Cizik AM, Hamilton D, Chapman JR. Predicting surgical site infection after spine surgery: a validated model using a prospective surgical registry. Spine J 2014; 14 (09) 2112-2117
• 23 Lee MJ, Cizik AM, Hamilton D, Chapman JR. Predicting medical complications after spine surgery: a validated model using a prospective surgical registry. Spine J 2014; 14 (02) 291-299
• 24 Bekelis K, Desai A, Bakhoum SF, Missios S. A predictive model of complications after spine surgery: the National Surgical Quality Improvement Program (NSQIP) 2005-2010. Spine J 2014; 14 (07) 1247-1255
• 25 Kimmell KT, Algattas H, Joynt P. et al. Risk modeling predicts complication rates for spinal surgery. Spine 2015; 40 (23) 1836-1841
• 26 Ratliff JK, Balise R, Veeravagu A. et al. Predicting occurrence of spine surgery complications using “big data” modeling of an administrative claims database. J Bone Joint Surg Am 2016; 98 (10) 824-834
• 27 Belykh E, Krutko AV, Baykov ES, Giers MB, Preul MC, Byvaltsev VA. Preoperative estimation of disc herniation recurrence after microdiscectomy: predictive value of a multivariate model based on radiographic parameters. Spine J 2017; 17 (03) 390-400
• 28 Du JY, Schell AJ, Kim CY, Trivedi NN, Ahn UM, Ahn NU. 30-Day mortality following surgery for spinal epidural abscess: incidence, risk factors, predictive algorithm, and associated complications. Spine 2019; 44 (08) E500-E509
• 29 Dietz N, Sharma M, Alhourani A. et al. Variability in the utility of predictive models in predicting patient-reported outcomes following spine surgery for degenerative conditions: a systematic review. Neurosurg Focus 2018; 45 (05) E10
• 30 Swets JA. Measuring the accuracy of diagnostic systems. Science 1988; 240 (4857): 1285-1293
• 31 Steyerberg EW, Vickers AJ, Cook NR. et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology 2010; 21 (01) 128-138
• 32 Vittinghoff E, McCulloch CE. Relaxing the rule of ten events per variable in logistic and Cox regression. Am J Epidemiol 2007; 165 (06) 710-718
• 33 Collins GS, de Groot JA, Dutton S. et al. External validation of multivariable prediction models: a systematic review of methodological conduct and reporting. BMC Med Res Methodol 2014; 14: 40
• 34 Steyerberg EW, Harrell Jr FE, Borsboom GJ, Eijkemans MJ, Vergouwe Y, Habbema JD. Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol 2001; 54 (08) 774-781
• 35 Kasparek MF, Boettner F, Rienmueller A. et al. Predicting medical complications in spine surgery: evaluation of a novel online risk calculator. Eur Spine J 2018; 27 (10) 2449-2456
• 36 Staartjes VE, Schröder ML. Letter to the Editor. Class imbalance in machine learning for neurosurgical outcome prediction: are our models valid?. J Neurosurg Spine 2018; 29 (05) 611-612