Bleeding Risk Assessment in End-Stage Kidney Disease: Validation of Existing Risk Scores and Evaluation of a Machine Learning-Based Approach

Abstract

Background Patients with end-stage kidney disease (ESKD) on hemodialysis (HD) are at increased risk for bleeding. However, despite relevant clinical implications regarding dialysis modalities or anticoagulation, no bleeding risk assessment strategy has been established in this challenging population.

Methods Analyses on bleeding risk assessment models were performed in the population-based Vienna InVestigation of Atrial fibrillation and thromboemboLism in patients on hemoDialysIs (VIVALDI) study including 625 patients. In this cohort study, patients were prospectively followed for a median observation period of 3.5 years for the occurrence of major bleeding. First, performances of existing bleeding risk scores (i.e., HAS-BLED, HEMORR₂HAGES, ATRIA, and four others) were evaluated in terms of discrimination and calibration. Second, four machine learning-based prediction models that included clinical, dialysis-specific, and laboratory parameters were developed and tested using Monte Carlo cross-validation.

Results Of 625 patients (median age: 66 years, 37% women), 89 (14.2%) developed major bleeding, with a 1-year, 2-year, and 3-year cumulative incidence of 6.1% (95% confidence interval [CI]: 4.2–8.0), 10.3% (95% CI: 8.0–12.8), and 13.5% (95% CI: 10.8–16.2), respectively. C-statistics of the seven contemporary bleeding risk scores ranged between 0.54 and 0.59 indicating poor discriminatory performance. The HAS-BLED score showed the highest C-statistic of 0.59 (95% CI: 0.53–0.66). Similarly, all four machine learning-based predictions models performed poorly in internal validation (C-statistics ranging from 0.49 to 0.55).

Conclusion Existing bleeding risk scores and a machine learning approach including common clinical parameters fail to assist in bleeding risk prediction of patients on HD. Therefore, new approaches, including novel biomarkers, to improve bleeding risk prediction in patients on HD are needed.

Keywords

renal anemia - hemodialysis - risk assessment - hemorrhage - atrial fibrillation

• References

• 1 Lutz J, Menke J, Sollinger D, Schinzel H, Thürmel K. Haemostasis in chronic kidney disease. Nephrol Dial Transplant 2014; 29 (01) 29-40
• 2 Sood MM, Bota SE, McArthur E. et al. The three-year incidence of major hemorrhage among older adults initiating chronic dialysis. Can J Kidney Health Dis 2014; 1: 21
• 3 Molnar AO, Bota SE, Garg AX. et al. The risk of major hemorrhage with CKD. J Am Soc Nephrol 2016; 27 (09) 2825-2832
• 4 Wasse H, Gillen DL, Ball AM. et al. Risk factors for upper gastrointestinal bleeding among end-stage renal disease patients. Kidney Int 2003; 64 (04) 1455-1461
• 5 Trivedi H, Yang J, Szabo A. Gastrointestinal bleeding in patients on long-term dialysis. J Nephrol 2015; 28 (02) 235-243
• 6 Kuo CC, Kuo HW, Lee IM, Lee CT, Yang CY. The risk of upper gastrointestinal bleeding in patients treated with hemodialysis: a population-based cohort study. BMC Nephrol 2013; 14: 15
• 7 Olesen JB, Lip GYH, Kamper A-L. et al. Stroke and bleeding in atrial fibrillation with chronic kidney disease. N Engl J Med 2012; 367 (07) 625-635
• 8 Wong CX, Odutayo A, Emdin CA, Kinnear NJ, Sun MT. Meta-analysis of anticoagulation use, stroke, thromboembolism, bleeding, and mortality in patients with atrial fibrillation on dialysis. Am J Cardiol 2016; 117 (12) 1934-1941
• 9 Hindricks G, Potpara T, Dagres N. et al. 2020 ESC guidelines for the diagnosis and management of atrial fibrillation developed in collaboration with the European Association for Cardio-Thoracic Surgery (EACTS): The Task Force for the diagnosis and management of atrial fibrillation of the European Society of Cardiology (ESC) Developed with the special contribution of the European Heart Rhythm Association (EHRA) of the ESC. Eur Heart J 2021; 42 (05) 373-498
• 10 Konstantinides SV, Meyer G, Becattini C. et al; The Task Force for the diagnosis and management of acute pulmonary embolism of the European Society of Cardiology (ESC). 2019 ESC guidelines for the diagnosis and management of acute pulmonary embolism developed in collaboration with the European Respiratory Society (ERS): The Task Force for the diagnosis and management of acute pulmonary embolism of the European Society of Cardiology (ESC). Eur Respir J 2019; 54 (03) 2019
• 11 Sousa-Uva M, Neumann F-J, Ahlsson A. et al; ESC Scientific Document Group. 2018 ESC/EACTS guidelines on myocardial revascularization. Eur J Cardiothorac Surg 2019; 55 (01) 4-90
• 12 Meschia JF, Bushnell C, Boden-Albala B. et al; American Heart Association Stroke Council, Council on Cardiovascular and Stroke Nursing, Council on Clinical Cardiology, Council on Functional Genomics and Translational Biology, Council on Hypertension. Guidelines for the primary prevention of stroke: a statement for healthcare professionals from the American Heart Association/American Stroke Association. Stroke 2014; 45 (12) 3754-3832
• 13 van Eck van der Sluijs A, Abrahams AC, Rookmaaker MB. et al. Bleeding risk of haemodialysis and peritoneal dialysis patients. Nephrol Dial Transplant 2021; 36 (01) 170-175
• 14 Wang IK, Cheng YK, Lin CL. et al. Comparison of subdural hematoma risk between hemodialysis and peritoneal dialysis patients with ESRD. Clin J Am Soc Nephrol 2015; 10 (06) 994-1001
• 15 Huang K-W, Leu H-B, Luo J-C. et al. Different peptic ulcer bleeding risk in chronic kidney disease and end-stage renal disease patients receiving different dialysis. Dig Dis Sci 2014; 59 (04) 807-813
• 16 Königsbrügge O, Meisel H, Beyer A. et al. Anticoagulation use and the risk of stroke and major bleeding in patients on hemodialysis: from the VIVALDI, a population-based prospective cohort study. J Thromb Haemost 2021; 19 (12) 2984-2996
• 17 Van Der Meersch H, De Bacquer D, De Vriese AS. Vitamin K antagonists for stroke prevention in hemodialysis patients with atrial fibrillation: a systematic review and meta-analysis. Am Heart J 2017; 184: 37-46
• 18 Hayashi M, Takamatsu I, Kanno Y, Yoshida T, Abe T, Sato Y. Japanese Calciphylaxis Study Group. A case-control study of calciphylaxis in Japanese end-stage renal disease patients. Nephrol Dial Transplant 2012; 27 (04) 1580-1584
• 19 Tan J, Liu S, Segal JB, Alexander GC, McAdams-DeMarco M. Warfarin use and stroke, bleeding and mortality risk in patients with end stage renal disease and atrial fibrillation: a systematic review and meta-analysis. BMC Nephrol 2016; 17 (01) 157
• 20 Königsbrügge O, Lorenz M, Auinger M. et al. Venous thromboembolism and vascular access thrombosis in patients with end-stage renal disease on maintenance hemodialysis: cross-sectional results of the Vienna InVestigation of AtriaL fibrillation and thromboembolism in patients on hemoDIalysis (VIVALDI). Thromb Res 2017; 158: 59-64
• 21 Schulman S, Angerås U, Bergqvist D, Eriksson B, Lassen MR, Fisher W. Subcommittee on Control of Anticoagulation of the Scientific and Standardization Committee of the International Society on Thrombosis and Haemostasis. Definition of major bleeding in clinical investigations of antihemostatic medicinal products in surgical patients. J Thromb Haemost 2010; 8 (01) 202-204
• 22 Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): the TRIPOD statement. J Clin Epidemiol 2015; 68 (02) 134-143
• 23 Nopp S, Ay C. Bleeding risk assessment in patients with venous thromboembolism. Hamostaseologie 2021; 41 (04) 267-274
• 24 Chang G, Xie Q, Ma L. et al. Accuracy of HAS-BLED and other bleeding risk assessment tools in predicting major bleeding events in atrial fibrillation: a network meta-analysis. J Thromb Haemost 2020; 18 (04) 791-801
• 25 van Es N, Wells PS, Carrier M. Bleeding risk in patients with unprovoked venous thromboembolism: a critical appraisal of clinical prediction scores. Thromb Res 2017; 152: 52-60
• 26 Pisters R, Lane DA, Nieuwlaat R, de Vos CB, Crijns HJ, Lip GY. A novel user-friendly score (HAS-BLED) to assess 1-year risk of major bleeding in patients with atrial fibrillation: the Euro Heart Survey. Chest 2010; 138 (05) 1093-1100
• 27 Fang MC, Go AS, Chang Y. et al. A new risk scheme to predict warfarin-associated hemorrhage: the ATRIA (Anticoagulation and Risk Factors in Atrial Fibrillation) Study. J Am Coll Cardiol 2011; 58 (04) 395-401
• 28 O'Brien EC, Holmes DN, Thomas L. et al. Therapeutic strategies following major, clinically relevant nonmajor, and nuisance bleeding in atrial fibrillation: findings from ORBIT-AF. J Am Heart Assoc 2018; 7 (12) e006391
• 29 Landefeld CS, Goldman L. Major bleeding in outpatients treated with warfarin: incidence and prediction by factors known at the start of outpatient therapy. Am J Med 1989; 87 (02) 144-152
• 30 Beyth RJ, Quinn LM, Landefeld CS. Prospective evaluation of an index for predicting the risk of major bleeding in outpatients treated with warfarin. Am J Med 1998; 105 (02) 91-99
• 31 Shireman TI, Mahnken JD, Howard PA, Kresowik TF, Hou Q, Ellerbeck EF. Development of a contemporary bleeding risk model for elderly warfarin recipients. Chest 2006; 130 (05) 1390-1396
• 32 Chawla NV, Bowyer KW, Hall LO. et al. SMOTE: Synthetic Minority Over-sampling Technique. J Artif Intell Res 2002; 16: 321-357
• 33 Pedregosa F, Varoquaux G, Gramfort A. et al. Scikit-learn: machine learning in Python. J Mach Learn Res 2011; 12: 2825-2830
• 34 Waskom ML. seaborn: statistical data visualization. J Open Source Softw 2021; 6 (60) 3021
• 35 Hunter JD. Matplotlib: a 2D graphics environment. Comput Sci Eng 2007; 9 (03) 90-95
• 36 Svd W, Colbert SC, Varoquaux G. The NumPy array: a structure for efficient numerical computation. Comput Sci Eng 2011; 13 (02) 22-30
• 37 McKinney W. pandas: a Foundational Python Library for Data Analysis and Statistics. 2011 . Accessed February 7, 2022 at https://www.dlr.de/sc/portaldata/15/resources/dokumente/pyhpc2011/submissions/pyhpc2011_submission_9.pdf
• 38 Guillaume Lemaître FNaCKA. Imbalanced-learn: a Python toolbox to tackle the curse of imbalanced datasets in machine learning. J Mach Learn Res 2017; 18 (17) 1-5
• 39 Gage BF, Yan Y, Milligan PE. et al. Clinical classification schemes for predicting hemorrhage: results from the National Registry of Atrial Fibrillation (NRAF). Am Heart J 2006; 151 (03) 713-719
• 40 Nopp S, Ay C. Bleeding risk assessment in patients with venous thromboembolism. Hamostaseologie 2021; 41 (04) 267-274
• 41 Zulkifly H, Lip GYH, Lane DA. Bleeding risk scores in atrial fibrillation and venous thromboembolism. Am J Cardiol 2017; 120 (07) 1139-1145
• 42 Riva N, Bellesini M, Di Minno MN. et al. Poor predictive value of contemporary bleeding risk scores during long-term treatment of venous thromboembolism. A multicentre retrospective cohort study. Thromb Haemost 2014; 112 (03) 511-521
• 43 de Winter MA, Dorresteijn JAN, Ageno W. et al. Estimating bleeding risk in patients with cancer-associated thrombosis: evaluation of existing risk scores and development of a new risk score. Thromb Haemost 2021;
• 44 McAlister FA, Wiebe N, Jun M. et al. Are existing risk scores for nonvalvular atrial fibrillation useful for prediction or risk adjustment in patients with chronic kidney disease?. Can J Cardiol 2017; 33 (02) 243-252
• 45 Borre ED, Goode A, Raitz G. et al. Predicting thromboembolic and bleeding event risk in patients with non-valvular atrial fibrillation: a systematic review. Thromb Haemost 2018; 118 (12) 2171-2187
• 46 Chao T-F, Joung B, Takahashi Y. et al. 2021 focused update consensus guidelines of the Asia Pacific Heart Rhythm Society on Stroke Prevention in Atrial Fibrillation: executive summary. Thromb Haemost 2022; 122 (01) 20-47
• 47 Proietti M, Romiti GF, Vitolo M, Potpara TS, Boriani G, Lip GYH. Comparison of HAS-BLED and ORBIT bleeding risk scores in AF patients treated with NOACs: a report from the ESC-EHRA EORP-AF general long-term registry. Eur Heart J Qual Care Clin Outcomes 2021;
• 48 Wattanaruengchai P, Nathisuwan S, Karaketklang K, Wongcharoen W, Phrommintikul A, Lip GYH. Comparison of the HAS-BLED versus ORBIT scores in predicting major bleeding among Asians receiving direct-acting oral anticoagulants. Br J Clin Pharmacol 2022; 88 (05) 2203-2212
• 49 Gao X, Cai X, Yang Y, Zhou Y, Zhu W. Diagnostic accuracy of the HAS-BLED bleeding score in VKA- or DOAC-treated patients with atrial fibrillation: a systematic review and meta-analysis. Front Cardiovasc Med 2021; 8 (1543): 757087
• 50 Guo Y, Lane DA, Chen Y, Lip GYH. mAF-App II Trial investigators. Regular bleeding risk assessment associated with reduction in bleeding outcomes: the mAFA-II randomized trial. Am J Med 2020; 133 (10) 1195.e2-1202.e2
• 51 Ocak G, Ramspek C, Rookmaaker MB. et al. Performance of bleeding risk scores in dialysis patients. Nephrol Dial Transplant 2019; 34 (07) 1223-1231
• 52 Kourou K, Exarchos TP, Exarchos KP, Karamouzis MV, Fotiadis DI. Machine learning applications in cancer prognosis and prediction. Comput Struct Biotechnol J 2014; 13: 8-17
• 53 Obermeyer Z, Emanuel EJ. Predicting the future - big data, machine learning, and clinical medicine. N Engl J Med 2016; 375 (13) 1216-1219
• 54 Sood MM, Larkina M, Thumma JR. et al. Major bleeding events and risk stratification of antithrombotic agents in hemodialysis: results from the DOPPS. Kidney Int 2013; 84 (03) 600-608
• 55 Hijazi Z, Oldgren J, Lindbäck J. et al; ARISTOTLE and RE-LY Investigators. The novel biomarker-based ABC (age, biomarkers, clinical history)-bleeding risk score for patients with atrial fibrillation: a derivation and validation study. Lancet 2016; 387 (10035): 2302-2311