Survival after Major Cardiac Surgery: Performance and Comparison of Predictive Ability of EuroSCORE II and Logistic EuroSCORE in a Sample of Mediterranean Population

Abstract

Background The European System for Cardiac Operative Risk Evaluation (EuroSCORE) II has been recently introduced to improve mortality prediction in cardiac surgery. We compare the predictive ability of the new EuroSCORE II with that of the original logistic EuroSCORE and we made an evaluation of a sample of our population submitted to major cardiac surgery in the context of a Mediterranean country.

Materials and Methods Predicted and observed mortality were recorded in 1,200 consecutive patients undergoing major cardiac surgery at our institution with both logistic EuroSCORE and EuroSCORE II. Patients were grouped according to type of surgery: isolated valvular (n = 538), isolated coronary (n = 322), combined (n = 192), and miscellaneous (n = 148). Predictive capacity of both scales was compared for overall population and for each group in terms of calibration and discrimination using the observed by expected mortality rate, Hosmer–Lemeshow test, and C-statistic.

Results Overall mortality was 6.8%, whereas that predicted by logistic EuroSCORE and EuroSCORE II was 9.7 and 3.7%, respectively. Mortality in our population was higher than mortality expected according to the original EuroSCORE II database. For all groups included in our population, logistic EuroSCORE overestimated mortality and EuroSCORE II underestimated the outcome even more. However, EuroSCORE II showed better calibration than logistic EuroSCORE for overall, valvular, and combined surgery. In contrast, logistic EuroSCORE demonstrated better calibration for coronary surgery. Discrimination capacity was good for both risk scores, but it was superior for logistic EuroSCORE than for EuroSCORE II in all considered subgroups unless combined surgery.

Conclusion Mortality in our population was higher than the mortality that would have been expected by the new EuroSCORE II analysis. Although EuroSCORE II has good calibration and discrimination capacity, both are worse than those demonstrated by logistic EuroSCORE. Forthcoming evaluations are necessary when the new model will be widely used.

Keywords

cardiac - surgery - mortality - risk assessment

• References

• 1 Nashef SAM, Roques F, Michel P, Gauducheau E, Lemeshow S, Salamon R. European System for Cardiac Operative Risk Evaluation (EuroSCORE). Eur J Cardiothorac Surg 1999; 16 (1) 9-13
• 2 Roques F, Nashef SAM, Michel P , et al. Risk factors and outcome in European cardiac surgery: analysis of the EuroSCORE multinational database of 19030 patients. Eur J Cardiothorac Surg 1999; 15 (6) 816-822 , discussion 822–823
• 3 Roques F, Michel P, Goldstone AR, Nashef SA. The logistic EuroSCORE. Eur Heart J 2003; 24 (9) 881-882
• 4 Nashef SA, Roques F, Hammill BG , et al; EurpSCORE Project Group. Validation of European System for Cardiac Operative Risk Evaluation (EuroSCORE) in North American cardiac surgery. Eur J Cardiothorac Surg 2002; 22 (1) 101-105
• 5 Roques F, Nashef SAM, Michel P, Pinna Pintor P, David M, Baudet E ; EuroSCORE Study Group. Does EuroSCORE work in individual European countries?. Eur J Cardiothorac Surg 2000; 18 (1) 27-30
• 6 Nilsson J, Algotsson L, Höglund P, Lührs C, Brandt J. Early mortality in coronary bypass surgery: the EuroSCORE versus The Society of Thoracic Surgeons risk algorithm. Ann Thorac Surg 2004; 77 (4) 1235-1239 , discussion 1239–1240
• 7 Yap CH, Reid C, Yii M , et al. Validation of the EuroSCORE model in Australia. Eur J Cardiothorac Surg 2006; 29 (4) 441-446 , discussion 446
• 8 Ngaage DL. The EuroSCORE has served us well. Eur J Cardiothorac Surg 2010; 38 (1) 114 , author reply 114–115
• 9 Siregar S, Groenwold RHH, de Heer F, Bots ML, van der Graaf Y, van Herwerden LA. Performance of the original EuroSCORE. Eur J Cardiothorac Surg 2012; 41 (4) 746-754
• 10 Nissinen J, Biancari F, Wistbacka JO , et al. Is it possible to improve the accuracy of EuroSCORE?. Eur J Cardiothorac Surg 2009; 36 (5) 799-804
• 11 Biancari F, Vasques F, Mikkola R, Martin M, Lahtinen J, Heikkinen J. Validation of EuroSCORE II in patients undergoing coronary artery bypass surgery. Ann Thorac Surg 2012; 93 (6) 1930-1935
• 12 Basraon J, Chandrashekhar YS, John R , et al. Comparison of risk scores to estimate perioperative mortality in aortic valve replacement surgery. Ann Thorac Surg 2011; 92 (2) 535-540
• 13 Gogbashian A, Sedrakyan A, Treasure T. EuroSCORE: a systematic review of international performance. Eur J Cardiothorac Surg 2004; 25 (5) 695-700
• 14 Chalmers J, Pullan M, Fabri B , et al. Validation of EuroSCORE II in a modern cohort of patients undergoing cardiac surgery. Eur J Cardiothorac Surg 2013; 43 (4) 688-694
• 15 Choong CK, Sergeant P, Nashef SA, Smith JA, Bridgewater B. The EuroSCORE risk stratification system in the current era: how accurate is it and what should be done if it is inaccurate?. Eur J Cardiothorac Surg 2009; 35: 59-61
• 16 Nashef SA, Roques F, Sharples LD , et al. EuroSCORE II. Eur J Cardiothorac Surg 2012; 41 (4) 734-744 , discussion 744–745
• 17 Carnero-Alcázar M, Silva Guisasola JA, Reguillo Lacruz FJ , et al. Validation of EuroSCORE II on a single-centre 3800 patient cohort. Interact Cardiovasc Thorac Surg 2013; 16 (3) 293-300
• 18 Collart F, Feier H, Kerbaul F , et al. Valvular surgery in octogenarians: operative risks factors, evaluation of Euroscore and long term results. Eur J Cardiothorac Surg 2005; 27 (2) 276-280
• 19 Qadir I, Salick MM, Perveen S, Sharif H. Mortality from isolated coronary bypass surgery: a comparison of the Society of Thoracic Surgeons and the EuroSCORE risk prediction algorithms. Interact Cardiovasc Thorac Surg 2012; 14 (3) 258-262
• 20 Di Dedda U, Pelissero G, Agnelli B, De Vincentiis C, Castelvecchio S, Ranucci M. Accuracy, calibration and clinical performance of the new EuroSCORE II risk stratification system. Eur J Cardiothorac Surg 2013; 43 (1) 27-32
• 21 Barili F, Pacini D, Capo A , et al. Does EuroSCORE II perform better than its original versions? A multicentre validation study. Eur Heart J 2013; 34 (1) 22-29
• 22 Grant SW, Hickey GL, Dimarakis I , et al. How does EuroSCORE II perform in UK cardiac surgery; an analysis of 23 740 patients from the Society for Cardiothoracic Surgery in Great Britain and Ireland National Database. Heart 2012; 98 (21) 1568-1572
• 23 Nezic D, Borzanovic M, Spasic T, Vukovic P. Calibration of the EuroSCORE II risk stratification model: is the Hosmer-Lemeshow test acceptable anymore?. Eur J Cardiothorac Surg 2013; 43 (1) 206
• 24 Hosmer DW, Lemeshow S. Assessing the Fit of the Model, Applied Logistic Regression, 2nd ed. New Jersey: Wiley-Blackwell; 2012: 143-203
• 25 Choong CK, Sergeant P, Nashef SA, Smith JA, Bridgewater B. The EuroSCORE risk stratification system in the current era: how accurate is it and what should be done if it is inaccurate?. Eur J Cardiothorac Surg 2009; 35 (1) 59-61
• 26 Sergeant P, Meuris B, Pettinari M. EuroSCORE II, illum qui est gravitates magni observe. Eur J Cardiothorac Surg 2012; 41 (4) 729-731
• 27 Hickey GL, Grant SW, Bridgewater B. Validation of the EuroSCORE II: should we be concerned with retrospective performance?. Eur J Cardiothorac Surg 2013; 43 (3) 655
• 28 Hickey GL, Bridgewater B. How well calibrated is EuroSCORE II?. Eur J Cardiothorac Surg 2013; 43 (1) 208
• 29 Poullis M, Fabri B, Pullan M, Chalmers J. Sampling time error in EuroSCORE II. Interact Cardiovasc Thorac Surg 2012; 14 (5) 640-641
• 30 Lebreton G, Merle S, Inamo J , et al. Limitations in the inter-observer reliability of EuroSCORE: what should change in EuroSCORE II?. Eur J Cardiothorac Surg 2011; 40 (6) 1304-1308
• 31 Collins GS, Altman DG. Design flaws in EuroSCORE II. Eur J Cardiothorac Surg 2013; 43 (4) 871
• 32 Nashef SA, Sharples LD, Roques F, Lockowandt U. EuroSCORE II and the art and science of risk modelling. Eur J Cardiothorac Surg 2013; 43 (4) 695-696