Download PDF
J Neurol Surg A Cent Eur Neurosurg 2020; 81(06): 535-545
DOI: 10.1055/s-0040-1709709
Review Article

Evaluation of Predictive Models for Complications following Spinal Surgery

Nicholas Dietz
1   Department of Neurosurgery, University of Louisville, Louisville, Kentucky, United States
,
Mayur Sharma 
1   Department of Neurosurgery, University of Louisville, Louisville, Kentucky, United States
,
Ahmad Alhourani
1   Department of Neurosurgery, University of Louisville, Louisville, Kentucky, United States
,
Beatrice Ugiliweneza
1   Department of Neurosurgery, University of Louisville, Louisville, Kentucky, United States
,
Dengzhi Wang
1   Department of Neurosurgery, University of Louisville, Louisville, Kentucky, United States
,
Doniel Drazin
2   Department of Neurosurgery, Pacific Northwest University of Health Sciences, Yakima, Washington, United States
,
Max Boakye
1   Department of Neurosurgery, University of Louisville, Louisville, Kentucky, United States
› Author Affiliations
› Further Information
Also available at
    Permissions and Reprints

Abstract

Background Complications rates vary across spinal surgery procedures and are difficult to predict due to heterogeneity in patient characteristics, surgical methods, and hospital volume. Incorporation of predictive models for complications may guide surgeon decision making and improve outcomes.

Methods We evaluate current independently validated predictive models for complications in spinal surgery with respect to study design and model generation, accuracy, reliability, and utility. We conducted our search using Preferred Reporting Items for Systematic Review and Meta-analysis guidelines and the Participants, Intervention, Comparison, Outcomes, Study Design model through the PubMed and Ovid Medline databases.

Results A total of 18 articles met inclusion criteria including 30 validated predictive models of complications after adult spinal surgery. National registry databases were used in 12 studies. Validation cohorts were used in seven studies for verification; three studies used other methods including random sample bootstrapping techniques or cross-validation. Reported area under the curve (AUC) values ranged from 0.37 to 1.0. Studies described treatment for deformity, degenerative conditions, inclusive spinal surgery (neoplasm, trauma, infection, deformity, degenerative), and miscellaneous (disk herniation, spinal epidural abscess). The most commonly cited risk factors for complications included in predictive models included age, body mass index, diabetes, sex, and smoking. Those models in the deformity subset that included radiographic and anatomical grading features reported higher AUC values than those that included patient demographics or medical comorbidities alone.

Conclusions We identified a cohort of 30 validated predictive models of complications following spinal surgery for degenerative conditions, deformity, infection, and trauma. Accurate evidence-based predictive models may enhance shared decision making, improve rehabilitation, reduce adverse events, and inform best practices.

Keywords

predictive models - complications - infection - spinal surgery - risk factors


Publication History

Received: 20 July 2019

Accepted: 21 October 2019

Article published online:
14 August 2020

© 2020. Thieme. All rights reserved.

Georg Thieme Verlag KG
Stuttgart · New York

 

  • References

  • 1 Nasser R, Yadla S, Maltenfort MG. et al. Complications in spine surgery. J Neurosurg Spine 2010; 13 (02) 144-157
    CrossrefPubMedGoogle Scholar
  • 2 Yadla S, Maltenfort MG, Ratliff JK, Harrop JS. Adult scoliosis surgery outcomes: a systematic review. Neurosurg Focus 2010; 28 (03) E3
    CrossrefPubMedGoogle Scholar
  • 3 Carreon LY, Puno RM, Dimar II JR, Glassman SD, Johnson JR. Perioperative complications of posterior lumbar decompression and arthrodesis in older adults. J Bone Joint Surg Am 2003; 85 (11) 2089-2092
    CrossrefPubMedGoogle Scholar
  • 4 McDonnell MF, Glassman SD, Dimar II JR, Puno RM, Johnson JR. Perioperative complications of anterior procedures on the spine. J Bone Joint Surg Am 1996; 78 (06) 839-847
    CrossrefPubMedGoogle Scholar
  • 5 Baron EM, Albert TJ. Medical complications of surgical treatment of adult spinal deformity and how to avoid them. Spine 2006; 31 (19, Suppl:) S106-S118
    CrossrefPubMedGoogle Scholar
  • 6 Whitmore RG, Stephen JH, Vernick C. et al. ASA grade and Charlson Comorbidity Index of spinal surgery patients: correlation with complications and societal costs. Spine J 2014; 14 (01) 31-38
    CrossrefPubMedGoogle Scholar
  • 7 Oresanya LB, Lyons WL, Finlayson E. Preoperative assessment of the older patient: a narrative review. JAMA 2014; 311 (20) 2110-2120
    CrossrefPubMedGoogle Scholar
  • 8 Reis RC, de Oliveira MF, Rotta JM, Botelho RV. Risk of complications in spine surgery: a prospective study. Open Orthop J 2015; 9: 20-25
    CrossrefPubMedGoogle Scholar
  • 9 Moher D, Liberati A, Tetzlaff J, Altman DG. PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol 2009; 62 (10) 1006-1012
    CrossrefPubMedGoogle Scholar
  • 10 Zweig MH, Campbell G. Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. Clin Chem 1993; 39 (04) 561-577
    CrossrefPubMedGoogle Scholar
  • 11 Schwab FJ, Lafage V, Farcy JP, Bridwell KH, Glassman S, Shainline MR. Predicting outcome and complications in the surgical treatment of adult scoliosis. Spine 2008; 33 (20) 2243-2247
    CrossrefPubMedGoogle Scholar
  • 12 Scheer JK, Smith JS, Schwab F. et al; International Spine Study Group. Development of a preoperative predictive model for major complications following adult spinal deformity surgery. J Neurosurg Spine 2017; 26 (06) 736-743
    CrossrefPubMedGoogle Scholar
  • 13 Buchlak QD, Yanamadala V, Leveque JC, Edwards A, Nold K, Sethi R. The Seattle spine score: predicting 30-day complication risk in adult spinal deformity surgery. J Clin Neurosci 2017; 43: 247-255
    CrossrefPubMedGoogle Scholar
  • 14 Scheer JK, Osorio JA, Smith JS. et al; International Spine Study Group. Development of validated computer-based preoperative predictive model for proximal junction failure (PJF) or clinically significant PJK with 86% Accuracy Based on 510 ASD patients with 2-year follow-up. Spine 2016; 41 (22) E1328-E1335
    CrossrefPubMedGoogle Scholar
  • 15 Yagi M, Fujita N, Okada E. et al. Fine-tuning the predictive model for proximal junctional failure in surgically treated patients with adult spinal deformity. Spine 2018; 43 (11) 767-773
    CrossrefPubMedGoogle Scholar
  • 16 Pellisé F, Vila-Casademunt A, Núñez-Pereira S. et al; European Spine Study Group. The Adult Deformity Surgery Complexity Index (ADSCI): a valid tool to quantify the complexity of posterior adult spinal deformity surgery and predict postoperative complications. Spine J 2018; 18 (02) 216-225
    CrossrefPubMedGoogle Scholar
  • 17 Chitale R, Campbell PG, Yadla S, Whitmore RG, Maltenfort MG, Ratliff JK. International Classification of Disease Clinical Modification 9 modeling of a patient comorbidity score predicts incidence of perioperative complications in a nationwide inpatient sample assessment of complications in spine surgery. J Spinal Disord Tech 2015; 28 (04) 126-133
    CrossrefPubMedGoogle Scholar
  • 18 McGirt MJ, Sivaganesan A, Asher AL, Devin CJ. Prediction model for outcome after low-back surgery: individualized likelihood of complication, hospital readmission, return to work, and 12-month improvement in functional disability. Neurosurg Focus 2015; 39 (06) E13
    CrossrefPubMedGoogle Scholar
  • 19 Klemencsics I, Lazary A, Szoverfi Z, Bozsodi A, Eltes P, Varga PP. Risk factors for surgical site infection in elective routine degenerative lumbar surgeries. Spine J 2016; 16 (11) 1377-1383
    CrossrefPubMedGoogle Scholar
  • 20 Wang X, Hu Y, Zhao B, Su Y. Predictive validity of the ACS-NSQIP surgical risk calculator in geriatric patients undergoing lumbar surgery. Medicine (Baltimore) 2017; 96 (43) e8416
    CrossrefPubMedGoogle Scholar
  • 21 Kim JS, Merrill RK, Arvind V. et al. Examining the ability of artificial neural networks machine learning models to accurately predict complications following posterior lumbar spine fusion. Spine 2018; 43 (12) 853-860
    CrossrefPubMedGoogle Scholar
  • 22 Lee MJ, Cizik AM, Hamilton D, Chapman JR. Predicting surgical site infection after spine surgery: a validated model using a prospective surgical registry. Spine J 2014; 14 (09) 2112-2117
    CrossrefPubMedGoogle Scholar
  • 23 Lee MJ, Cizik AM, Hamilton D, Chapman JR. Predicting medical complications after spine surgery: a validated model using a prospective surgical registry. Spine J 2014; 14 (02) 291-299
    CrossrefPubMedGoogle Scholar
  • 24 Bekelis K, Desai A, Bakhoum SF, Missios S. A predictive model of complications after spine surgery: the National Surgical Quality Improvement Program (NSQIP) 2005-2010. Spine J 2014; 14 (07) 1247-1255
    CrossrefPubMedGoogle Scholar
  • 25 Kimmell KT, Algattas H, Joynt P. et al. Risk modeling predicts complication rates for spinal surgery. Spine 2015; 40 (23) 1836-1841
    CrossrefPubMedGoogle Scholar
  • 26 Ratliff JK, Balise R, Veeravagu A. et al. Predicting occurrence of spine surgery complications using “big data” modeling of an administrative claims database. J Bone Joint Surg Am 2016; 98 (10) 824-834
    CrossrefPubMedGoogle Scholar
  • 27 Belykh E, Krutko AV, Baykov ES, Giers MB, Preul MC, Byvaltsev VA. Preoperative estimation of disc herniation recurrence after microdiscectomy: predictive value of a multivariate model based on radiographic parameters. Spine J 2017; 17 (03) 390-400
    CrossrefPubMedGoogle Scholar
  • 28 Du JY, Schell AJ, Kim CY, Trivedi NN, Ahn UM, Ahn NU. 30-Day mortality following surgery for spinal epidural abscess: incidence, risk factors, predictive algorithm, and associated complications. Spine 2019; 44 (08) E500-E509
    CrossrefPubMedGoogle Scholar
  • 29 Dietz N, Sharma M, Alhourani A. et al. Variability in the utility of predictive models in predicting patient-reported outcomes following spine surgery for degenerative conditions: a systematic review. Neurosurg Focus 2018; 45 (05) E10
    CrossrefPubMedGoogle Scholar
  • 30 Swets JA. Measuring the accuracy of diagnostic systems. Science 1988; 240 (4857): 1285-1293
    CrossrefPubMedGoogle Scholar
  • 31 Steyerberg EW, Vickers AJ, Cook NR. et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology 2010; 21 (01) 128-138
    CrossrefPubMedGoogle Scholar
  • 32 Vittinghoff E, McCulloch CE. Relaxing the rule of ten events per variable in logistic and Cox regression. Am J Epidemiol 2007; 165 (06) 710-718
    CrossrefPubMedGoogle Scholar
  • 33 Collins GS, de Groot JA, Dutton S. et al. External validation of multivariable prediction models: a systematic review of methodological conduct and reporting. BMC Med Res Methodol 2014; 14: 40
    CrossrefPubMedGoogle Scholar
  • 34 Steyerberg EW, Harrell Jr FE, Borsboom GJ, Eijkemans MJ, Vergouwe Y, Habbema JD. Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol 2001; 54 (08) 774-781
    CrossrefPubMedGoogle Scholar
  • 35 Kasparek MF, Boettner F, Rienmueller A. et al. Predicting medical complications in spine surgery: evaluation of a novel online risk calculator. Eur Spine J 2018; 27 (10) 2449-2456
    CrossrefPubMedGoogle Scholar
  • 36 Staartjes VE, Schröder ML. Letter to the Editor. Class imbalance in machine learning for neurosurgical outcome prediction: are our models valid?. J Neurosurg Spine 2018; 29 (05) 611-612
    CrossrefPubMedGoogle Scholar