Download PDF
Thromb Haemost 2022; 122(09): 1558-1566
DOI: 10.1055/a-1754-7551
Stroke, Systemic or Venous Thromboembolism

Bleeding Risk Assessment in End-Stage Kidney Disease: Validation of Existing Risk Scores and Evaluation of a Machine Learning-Based Approach

Stephan Nopp
1   Clinical Division of Haematology and Hemostaseology, Department of Medicine I, Medical University of Vienna, Vienna, Austria
,
Clemens P. Spielvogel
2   Division of Nuclear Medicine, Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria
3   Christian Doppler Laboratory for Applied Metabolomics, Vienna, Austria
,
Sabine Schmaldienst
4   Department of Medicine I, Clinic Favoriten, Vienna, Austria
,
Renate Klauser-Braun
5   Department of Medicine III, Clinic Donaustadt, Vienna, Austria
,
Matthias Lorenz
6   Vienna Dialysis Centre, Vienna, Austria
,
Benedikt N. Bauer
1   Clinical Division of Haematology and Hemostaseology, Department of Medicine I, Medical University of Vienna, Vienna, Austria
,
Ingrid Pabinger
1   Clinical Division of Haematology and Hemostaseology, Department of Medicine I, Medical University of Vienna, Vienna, Austria
,
Marcus Säemann
7   Department of Medicine VI, Clinic Ottakring, Vienna, Austria
,
Oliver Königsbrügge
1   Clinical Division of Haematology and Hemostaseology, Department of Medicine I, Medical University of Vienna, Vienna, Austria
,
Cihan Ay
1   Clinical Division of Haematology and Hemostaseology, Department of Medicine I, Medical University of Vienna, Vienna, Austria
› Author Affiliations Funding The VIVALDI study was supported by an unrestricted grant from the Austrian National Bank (Jubiläumsfond Österreichische Nationalbank, Project Number 16433), Joseph-Skoda-Prize of the Austrian Association of Internal Medicine (ÖGIM), and the Austrian Science Fund (FWF), Special Research Program (SFB) 54.
› Further Information
   Permissions and Reprints

Abstract

Background Patients with end-stage kidney disease (ESKD) on hemodialysis (HD) are at increased risk for bleeding. However, despite relevant clinical implications regarding dialysis modalities or anticoagulation, no bleeding risk assessment strategy has been established in this challenging population.

Methods Analyses on bleeding risk assessment models were performed in the population-based Vienna InVestigation of Atrial fibrillation and thromboemboLism in patients on hemoDialysIs (VIVALDI) study including 625 patients. In this cohort study, patients were prospectively followed for a median observation period of 3.5 years for the occurrence of major bleeding. First, performances of existing bleeding risk scores (i.e., HAS-BLED, HEMORR2HAGES, ATRIA, and four others) were evaluated in terms of discrimination and calibration. Second, four machine learning-based prediction models that included clinical, dialysis-specific, and laboratory parameters were developed and tested using Monte Carlo cross-validation.

Results Of 625 patients (median age: 66 years, 37% women), 89 (14.2%) developed major bleeding, with a 1-year, 2-year, and 3-year cumulative incidence of 6.1% (95% confidence interval [CI]: 4.2–8.0), 10.3% (95% CI: 8.0–12.8), and 13.5% (95% CI: 10.8–16.2), respectively. C-statistics of the seven contemporary bleeding risk scores ranged between 0.54 and 0.59 indicating poor discriminatory performance. The HAS-BLED score showed the highest C-statistic of 0.59 (95% CI: 0.53–0.66). Similarly, all four machine learning-based predictions models performed poorly in internal validation (C-statistics ranging from 0.49 to 0.55).

Conclusion Existing bleeding risk scores and a machine learning approach including common clinical parameters fail to assist in bleeding risk prediction of patients on HD. Therefore, new approaches, including novel biomarkers, to improve bleeding risk prediction in patients on HD are needed.

Keywords

renal anemia - hemodialysis - risk assessment - hemorrhage - atrial fibrillation

Supplementary Material



Publication History

Received: 08 November 2021

Accepted: 27 January 2022

Accepted Manuscript online:
28 January 2022

Article published online:
19 June 2022

© 2022. Thieme. All rights reserved.

Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany

 

  • References

  • 1 Lutz J, Menke J, Sollinger D, Schinzel H, Thürmel K. Haemostasis in chronic kidney disease. Nephrol Dial Transplant 2014; 29 (01) 29-40
    CrossrefPubMedGoogle Scholar
  • 2 Sood MM, Bota SE, McArthur E. et al. The three-year incidence of major hemorrhage among older adults initiating chronic dialysis. Can J Kidney Health Dis 2014; 1: 21
    CrossrefPubMedGoogle Scholar
  • 3 Molnar AO, Bota SE, Garg AX. et al. The risk of major hemorrhage with CKD. J Am Soc Nephrol 2016; 27 (09) 2825-2832
    CrossrefPubMedGoogle Scholar
  • 4 Wasse H, Gillen DL, Ball AM. et al. Risk factors for upper gastrointestinal bleeding among end-stage renal disease patients. Kidney Int 2003; 64 (04) 1455-1461
    CrossrefPubMedGoogle Scholar
  • 5 Trivedi H, Yang J, Szabo A. Gastrointestinal bleeding in patients on long-term dialysis. J Nephrol 2015; 28 (02) 235-243
    CrossrefPubMedGoogle Scholar
  • 6 Kuo CC, Kuo HW, Lee IM, Lee CT, Yang CY. The risk of upper gastrointestinal bleeding in patients treated with hemodialysis: a population-based cohort study. BMC Nephrol 2013; 14: 15
    CrossrefPubMedGoogle Scholar
  • 7 Olesen JB, Lip GYH, Kamper A-L. et al. Stroke and bleeding in atrial fibrillation with chronic kidney disease. N Engl J Med 2012; 367 (07) 625-635
    CrossrefPubMedGoogle Scholar
  • 8 Wong CX, Odutayo A, Emdin CA, Kinnear NJ, Sun MT. Meta-analysis of anticoagulation use, stroke, thromboembolism, bleeding, and mortality in patients with atrial fibrillation on dialysis. Am J Cardiol 2016; 117 (12) 1934-1941
    CrossrefPubMedGoogle Scholar
  • 9 Hindricks G, Potpara T, Dagres N. et al. 2020 ESC guidelines for the diagnosis and management of atrial fibrillation developed in collaboration with the European Association for Cardio-Thoracic Surgery (EACTS): The Task Force for the diagnosis and management of atrial fibrillation of the European Society of Cardiology (ESC) Developed with the special contribution of the European Heart Rhythm Association (EHRA) of the ESC. Eur Heart J 2021; 42 (05) 373-498
    Google Scholar
  • 10 Konstantinides SV, Meyer G, Becattini C. et al; The Task Force for the diagnosis and management of acute pulmonary embolism of the European Society of Cardiology (ESC). 2019 ESC guidelines for the diagnosis and management of acute pulmonary embolism developed in collaboration with the European Respiratory Society (ERS): The Task Force for the diagnosis and management of acute pulmonary embolism of the European Society of Cardiology (ESC). Eur Respir J 2019; 54 (03) 2019
    CrossrefPubMedGoogle Scholar
  • 11 Sousa-Uva M, Neumann F-J, Ahlsson A. et al; ESC Scientific Document Group. 2018 ESC/EACTS guidelines on myocardial revascularization. Eur J Cardiothorac Surg 2019; 55 (01) 4-90
    CrossrefPubMedGoogle Scholar
  • 12 Meschia JF, Bushnell C, Boden-Albala B. et al; American Heart Association Stroke Council, Council on Cardiovascular and Stroke Nursing, Council on Clinical Cardiology, Council on Functional Genomics and Translational Biology, Council on Hypertension. Guidelines for the primary prevention of stroke: a statement for healthcare professionals from the American Heart Association/American Stroke Association. Stroke 2014; 45 (12) 3754-3832
    CrossrefPubMedGoogle Scholar
  • 13 van Eck van der Sluijs A, Abrahams AC, Rookmaaker MB. et al. Bleeding risk of haemodialysis and peritoneal dialysis patients. Nephrol Dial Transplant 2021; 36 (01) 170-175
    CrossrefPubMedGoogle Scholar
  • 14 Wang IK, Cheng YK, Lin CL. et al. Comparison of subdural hematoma risk between hemodialysis and peritoneal dialysis patients with ESRD. Clin J Am Soc Nephrol 2015; 10 (06) 994-1001
    CrossrefPubMedGoogle Scholar
  • 15 Huang K-W, Leu H-B, Luo J-C. et al. Different peptic ulcer bleeding risk in chronic kidney disease and end-stage renal disease patients receiving different dialysis. Dig Dis Sci 2014; 59 (04) 807-813
    CrossrefPubMedGoogle Scholar
  • 16 Königsbrügge O, Meisel H, Beyer A. et al. Anticoagulation use and the risk of stroke and major bleeding in patients on hemodialysis: from the VIVALDI, a population-based prospective cohort study. J Thromb Haemost 2021; 19 (12) 2984-2996
    CrossrefPubMedGoogle Scholar
  • 17 Van Der Meersch H, De Bacquer D, De Vriese AS. Vitamin K antagonists for stroke prevention in hemodialysis patients with atrial fibrillation: a systematic review and meta-analysis. Am Heart J 2017; 184: 37-46
    CrossrefPubMedGoogle Scholar
  • 18 Hayashi M, Takamatsu I, Kanno Y, Yoshida T, Abe T, Sato Y. Japanese Calciphylaxis Study Group. A case-control study of calciphylaxis in Japanese end-stage renal disease patients. Nephrol Dial Transplant 2012; 27 (04) 1580-1584
    CrossrefPubMedGoogle Scholar
  • 19 Tan J, Liu S, Segal JB, Alexander GC, McAdams-DeMarco M. Warfarin use and stroke, bleeding and mortality risk in patients with end stage renal disease and atrial fibrillation: a systematic review and meta-analysis. BMC Nephrol 2016; 17 (01) 157
    CrossrefPubMedGoogle Scholar
  • 20 Königsbrügge O, Lorenz M, Auinger M. et al. Venous thromboembolism and vascular access thrombosis in patients with end-stage renal disease on maintenance hemodialysis: cross-sectional results of the Vienna InVestigation of AtriaL fibrillation and thromboembolism in patients on hemoDIalysis (VIVALDI). Thromb Res 2017; 158: 59-64
    CrossrefPubMedGoogle Scholar
  • 21 Schulman S, Angerås U, Bergqvist D, Eriksson B, Lassen MR, Fisher W. Subcommittee on Control of Anticoagulation of the Scientific and Standardization Committee of the International Society on Thrombosis and Haemostasis. Definition of major bleeding in clinical investigations of antihemostatic medicinal products in surgical patients. J Thromb Haemost 2010; 8 (01) 202-204
    CrossrefPubMedGoogle Scholar
  • 22 Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): the TRIPOD statement. J Clin Epidemiol 2015; 68 (02) 134-143
    CrossrefPubMedGoogle Scholar
  • 23 Nopp S, Ay C. Bleeding risk assessment in patients with venous thromboembolism. Hamostaseologie 2021; 41 (04) 267-274
    Article in Thieme ConnectPubMedGoogle Scholar
  • 24 Chang G, Xie Q, Ma L. et al. Accuracy of HAS-BLED and other bleeding risk assessment tools in predicting major bleeding events in atrial fibrillation: a network meta-analysis. J Thromb Haemost 2020; 18 (04) 791-801
    CrossrefPubMedGoogle Scholar
  • 25 van Es N, Wells PS, Carrier M. Bleeding risk in patients with unprovoked venous thromboembolism: a critical appraisal of clinical prediction scores. Thromb Res 2017; 152: 52-60
    CrossrefPubMedGoogle Scholar
  • 26 Pisters R, Lane DA, Nieuwlaat R, de Vos CB, Crijns HJ, Lip GY. A novel user-friendly score (HAS-BLED) to assess 1-year risk of major bleeding in patients with atrial fibrillation: the Euro Heart Survey. Chest 2010; 138 (05) 1093-1100
    Google Scholar
  • 27 Fang MC, Go AS, Chang Y. et al. A new risk scheme to predict warfarin-associated hemorrhage: the ATRIA (Anticoagulation and Risk Factors in Atrial Fibrillation) Study. J Am Coll Cardiol 2011; 58 (04) 395-401
    CrossrefPubMedGoogle Scholar
  • 28 O'Brien EC, Holmes DN, Thomas L. et al. Therapeutic strategies following major, clinically relevant nonmajor, and nuisance bleeding in atrial fibrillation: findings from ORBIT-AF. J Am Heart Assoc 2018; 7 (12) e006391
    CrossrefPubMedGoogle Scholar
  • 29 Landefeld CS, Goldman L. Major bleeding in outpatients treated with warfarin: incidence and prediction by factors known at the start of outpatient therapy. Am J Med 1989; 87 (02) 144-152
    CrossrefPubMedGoogle Scholar
  • 30 Beyth RJ, Quinn LM, Landefeld CS. Prospective evaluation of an index for predicting the risk of major bleeding in outpatients treated with warfarin. Am J Med 1998; 105 (02) 91-99
    CrossrefPubMedGoogle Scholar
  • 31 Shireman TI, Mahnken JD, Howard PA, Kresowik TF, Hou Q, Ellerbeck EF. Development of a contemporary bleeding risk model for elderly warfarin recipients. Chest 2006; 130 (05) 1390-1396
    CrossrefPubMedGoogle Scholar
  • 32 Chawla NV, Bowyer KW, Hall LO. et al. SMOTE: Synthetic Minority Over-sampling Technique. J Artif Intell Res 2002; 16: 321-357
    CrossrefPubMedGoogle Scholar
  • 33 Pedregosa F, Varoquaux G, Gramfort A. et al. Scikit-learn: machine learning in Python. J Mach Learn Res 2011; 12: 2825-2830
    PubMedGoogle Scholar
  • 34 Waskom ML. seaborn: statistical data visualization. J Open Source Softw 2021; 6 (60) 3021
    CrossrefPubMedGoogle Scholar
  • 35 Hunter JD. Matplotlib: a 2D graphics environment. Comput Sci Eng 2007; 9 (03) 90-95
    CrossrefPubMedGoogle Scholar
  • 36 Svd W, Colbert SC, Varoquaux G. The NumPy array: a structure for efficient numerical computation. Comput Sci Eng 2011; 13 (02) 22-30
    CrossrefPubMedGoogle Scholar
  • 37 McKinney W. pandas: a Foundational Python Library for Data Analysis and Statistics. 2011 . Accessed February 7, 2022 at https://www.dlr.de/sc/portaldata/15/resources/dokumente/pyhpc2011/submissions/pyhpc2011_submission_9.pdf
    PubMedGoogle Scholar
  • 38 Guillaume Lemaître FNaCKA. Imbalanced-learn: a Python toolbox to tackle the curse of imbalanced datasets in machine learning. J Mach Learn Res 2017; 18 (17) 1-5
    PubMedGoogle Scholar
  • 39 Gage BF, Yan Y, Milligan PE. et al. Clinical classification schemes for predicting hemorrhage: results from the National Registry of Atrial Fibrillation (NRAF). Am Heart J 2006; 151 (03) 713-719
    CrossrefPubMedGoogle Scholar
  • 40 Nopp S, Ay C. Bleeding risk assessment in patients with venous thromboembolism. Hamostaseologie 2021; 41 (04) 267-274
    Article in Thieme ConnectPubMedGoogle Scholar
  • 41 Zulkifly H, Lip GYH, Lane DA. Bleeding risk scores in atrial fibrillation and venous thromboembolism. Am J Cardiol 2017; 120 (07) 1139-1145
    CrossrefPubMedGoogle Scholar
  • 42 Riva N, Bellesini M, Di Minno MN. et al. Poor predictive value of contemporary bleeding risk scores during long-term treatment of venous thromboembolism. A multicentre retrospective cohort study. Thromb Haemost 2014; 112 (03) 511-521
    PubMedGoogle Scholar
  • 43 de Winter MA, Dorresteijn JAN, Ageno W. et al. Estimating bleeding risk in patients with cancer-associated thrombosis: evaluation of existing risk scores and development of a new risk score. Thromb Haemost 2021; DOI: 10.1055/s-0041-1735251.
    Article in Thieme ConnectPubMedGoogle Scholar
  • 44 McAlister FA, Wiebe N, Jun M. et al. Are existing risk scores for nonvalvular atrial fibrillation useful for prediction or risk adjustment in patients with chronic kidney disease?. Can J Cardiol 2017; 33 (02) 243-252
    CrossrefPubMedGoogle Scholar
  • 45 Borre ED, Goode A, Raitz G. et al. Predicting thromboembolic and bleeding event risk in patients with non-valvular atrial fibrillation: a systematic review. Thromb Haemost 2018; 118 (12) 2171-2187
    Article in Thieme ConnectPubMedGoogle Scholar
  • 46 Chao T-F, Joung B, Takahashi Y. et al. 2021 focused update consensus guidelines of the Asia Pacific Heart Rhythm Society on Stroke Prevention in Atrial Fibrillation: executive summary. Thromb Haemost 2022; 122 (01) 20-47
    Article in Thieme ConnectPubMedGoogle Scholar
  • 47 Proietti M, Romiti GF, Vitolo M, Potpara TS, Boriani G, Lip GYH. Comparison of HAS-BLED and ORBIT bleeding risk scores in AF patients treated with NOACs: a report from the ESC-EHRA EORP-AF general long-term registry. Eur Heart J Qual Care Clin Outcomes 2021; DOI: 10.1093/ehjqcco/qcab069.
    CrossrefPubMedGoogle Scholar
  • 48 Wattanaruengchai P, Nathisuwan S, Karaketklang K, Wongcharoen W, Phrommintikul A, Lip GYH. Comparison of the HAS-BLED versus ORBIT scores in predicting major bleeding among Asians receiving direct-acting oral anticoagulants. Br J Clin Pharmacol 2022; 88 (05) 2203-2212
    PubMedGoogle Scholar
  • 49 Gao X, Cai X, Yang Y, Zhou Y, Zhu W. Diagnostic accuracy of the HAS-BLED bleeding score in VKA- or DOAC-treated patients with atrial fibrillation: a systematic review and meta-analysis. Front Cardiovasc Med 2021; 8 (1543): 757087
    CrossrefPubMedGoogle Scholar
  • 50 Guo Y, Lane DA, Chen Y, Lip GYH. mAF-App II Trial investigators. Regular bleeding risk assessment associated with reduction in bleeding outcomes: the mAFA-II randomized trial. Am J Med 2020; 133 (10) 1195.e2-1202.e2
    PubMedGoogle Scholar
  • 51 Ocak G, Ramspek C, Rookmaaker MB. et al. Performance of bleeding risk scores in dialysis patients. Nephrol Dial Transplant 2019; 34 (07) 1223-1231
    CrossrefPubMedGoogle Scholar
  • 52 Kourou K, Exarchos TP, Exarchos KP, Karamouzis MV, Fotiadis DI. Machine learning applications in cancer prognosis and prediction. Comput Struct Biotechnol J 2014; 13: 8-17
    CrossrefPubMedGoogle Scholar
  • 53 Obermeyer Z, Emanuel EJ. Predicting the future - big data, machine learning, and clinical medicine. N Engl J Med 2016; 375 (13) 1216-1219
    CrossrefPubMedGoogle Scholar
  • 54 Sood MM, Larkina M, Thumma JR. et al. Major bleeding events and risk stratification of antithrombotic agents in hemodialysis: results from the DOPPS. Kidney Int 2013; 84 (03) 600-608
    CrossrefPubMedGoogle Scholar
  • 55 Hijazi Z, Oldgren J, Lindbäck J. et al; ARISTOTLE and RE-LY Investigators. The novel biomarker-based ABC (age, biomarkers, clinical history)-bleeding risk score for patients with atrial fibrillation: a derivation and validation study. Lancet 2016; 387 (10035): 2302-2311
    CrossrefPubMedGoogle Scholar