Subscribe to RSS

DOI: 10.1055/a-2642-0241
Performance of Bleeding Risk Scores for Major Bleeding in Anticoagulated Patients with Pulmonary Embolism: Insights from the CURES Registry-2
Funding The Fund of the National Key Research and Development Program of China (grant number 2023YFC2507200); the CAMS Innovation Fund for Medical Sciences (CIFMS) (grant numbers 2021-I2M-1-061, 2021-I2M-1-049); the National High Level Hospital Clinical Research Funding (grant number 2022-NHLHCRF-LX-01); and the National Natural Science Foundation of China (No. 82241029).
Abstract
Background
Most bleeding risk scores for pulmonary embolism (PE) were developed in patients receiving traditional anticoagulants. Evidence in East Asian populations and its applicability to direct oral anticoagulants (DOACs) remain limited.
Methods
This post-hoc analysis was based on a multicentre, prospective study (NCT02943343) conducted from 2016 to 2021. The predictive performance of bleeding risk scores was assessed using a time-dependent area under the receiver operating characteristic curve (AUC), net reclassification improvement (NRI), and decision curve analysis (DCA). Propensity score matching (PSM) was adjusted for baseline characteristics. We analyzed the impact of initial DOAC versus low-molecular-weight heparin (LMWH) on outcomes. The endpoint was major bleeding (MB) within 90 days and composite outcomes (all-cause mortality, recurrent VTE, and MB).
Results
Of 7,619 patients with PE, 1.4% (107 patients) experienced MB within 90 days. The RIETE score showed a modest predictive ability (AUC: 0.70; 95% CI, 0.65–0.75) for predicting 90-day MB and demonstrated a predictive advantage in the DCA results. NRI also revealed significantly better reclassification capability than the other scores, except for HAS-BLED. Among low-risk patients classified by the RIETE score, initial DOAC treatment significantly reduced 14-day composite outcomes compared with LMWH (HR = 0.13; 95% CI, 0.02–0.93). Furthermore, DOACs at discharge did not increase the risk of MB or composite outcomes.
Conclusion
RIETE score shows modest performance in predicting MB and identifying low bleeding risk in PE patients, which could potentially guide early DOAC use. Further studies are needed to test its clinical utility, especially in East Asian populations.
Introduction
Pulmonary embolism (PE) is one of the major causes of cardiovascular morbidity and mortality, significantly contributing to global healthcare burdens.[1] Despite advances in anticoagulation and thrombolysis, managing PE remains challenging because of the associated risk of major bleeding (MB).[2] Identifying risk factors for MB and developing individualized treatment strategies are crucial to improving patient outcomes.
The Kuijer score has demonstrated good clinical utility in predicting MB and mortality in patients with venous thromboembolism (VTE).[3] [4] The BACS (Bleeding, Age, Cancer, Syncope) score, developed to assess bleeding risk in PE patients undergoing systemic thrombolysis, has been externally validated using the COMMAND VTE (Contemporary Management and Outcomes in VTE) dataset.[5] The PE-SARD score (Syncope, Anemia, Renal Dysfunction) was designed to predict early MB risk in patients with PE.[6] Although simple and clinically applicable,[7] the PE-SARD score has shown suboptimal performance during external validation, especially in older patients.[8] The RIETE (Registro Informatizado de Enfermedad TromboEmbólica) bleeding risk score (RIETE BRS) effectively identifies bleeding risk in patients with PE; however, caution is advised when applying it to subgroups such as cancer patients and the elderly.[9] [10] The HAS-BLED score has been widely validated in atrial fibrillation (AF) patients, helping to guide anticoagulant therapy, reduce MB risks, and improve treatment outcomes.[11] [12] [13] [14] It is one of the most reliable tools for predicting bleeding events, including intracranial haemorrhage (ICH).[15] Additionally, it has shown potential in predicting bleeding risk in VTE populations.[16] Similarly, the DOAC[17] and ATRIA scores,[18] developed for AF patients, effectively predict MB events. However, their predictive performance in the VTE populations of China requires further prospective validation.
Individualized management based on bleeding risk assessment remains a critical area of study. Despite advances in bleeding risk scores for PE, their integration into clinical practice is still limited. Most of these scores were developed and validated in Western populations with different genetics, treatment doses, and comorbidities. The “East Asian Paradox” has been proposed by scholars, highlighting the unique balance of thrombosis and bleeding risks observed in East Asian populations compared with Western populations during antithrombotic treatment, underscoring the need for tailored antithrombotic strategies for East Asians.[19] Varying clinical settings and patient-specific differences further influence the accuracy of existing scores. Notably, these bleeding risk scores have not been prospectively tested in large Chinese cohorts of PE patients. Furthermore, Chinese guidelines for managing PE bleeding risk still rely on the 2012 ACCP guidelines, highlighting the need to test these scores and develop tools tailored to Chinese populations.
This study aims to evaluate the performance of four VTE-related bleeding risk scores in predicting MB associated with anticoagulation within 90 days of PE diagnosis and to determine whether a bleeding risk score with better predictive performance can effectively guide the selection of appropriate initial anticoagulants. The study will also explore the predictive value of bleeding risk scores derived from the AF population in patients with PE.
Methods
Study Design
The China pUlmonary thromboembolism REgistry Study (CURES) is a multicentre, prospective, observational study of consecutive patients with PE (NCT02943343). The study followed the Declaration of Helsinki and was approved by institutional review boards and ethics committees (approval No. 2016-SSW-7). Informed consent was obtained from all patients or their legal representatives. Patients were enrolled from 1 January 2016 to 31 December 2021, with at least 90 days of follow-up. Adults with newly confirmed PE were included, while those with significant baseline missing data or who refused long-term follow-up were excluded. This study adhered to the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) statement ([Supplementary Method S1], available in the online version).
Data Collection and Study Endpoints
Data were prospectively collected for all patients, covering demographic characteristics, clinical presentation, comorbidities, risk factors, laboratory findings, acute-phase treatment details, and outcomes. For the missing data variables, including labile INR, alcohol use, antiplatelet use, and nonsteroidal anti-inflammatory drug (NSAID) use, we assigned a default value of 0 for these variables. The primary outcome was the occurrence of MB within 90 days of diagnosis, defined according to the International Society on Thrombosis and Haemostasis (ISTH) criteria. The composite outcome was all-cause mortality, recurrent VTE, or MB ([Supplementary Method S2], available in the online version). A central adjudication committee reviewed all suspected events based on original medical documentation. Outcome data were collected during follow-up through in-person assessments, telephone interviews, and regular examinations of inpatient medical records. If patients experienced multiple events, only the first MB was recorded.
Statistical Analysis
Baseline characteristics of categorical variables were expressed as percentages. The proportion of missing data are detailed in [Supplementary Method S3] (available in the online version), with missing values imputed using multiple imputations. The discriminative performance of the PE-SARD, BACS, Kuijer, RIETE, HAS-BLED, ATRIA, and DOAC scores was evaluated using a time-dependent area under the receiver operating characteristic (ROC) curve (AUC) analysis. Sensitivity, specificity, positive and negative predictive values, and likelihood ratios (LRs) were calculated for each score. Risk reclassification was assessed using continuous net reclassification improvement (NRI) and integrated discrimination improvement (IDI), accounting for competing risks. Decision curve analysis (DCA) was used to evaluate the clinical usefulness of the prediction scores.[20]
We performed a calibration plot and conducted the Hosmer-Lemeshow goodness-of-fit test to evaluate the calibration performance of the seven bleeding scores for MB. A Cox regression model was applied to identify risk factors for MB in the presence of competing risks. Factors with a P-value <0.1 or those deemed clinically relevant were included in the multivariate analysis. The risks of high- and intermediate-risk groups were compared with the low-risk group across the four scores using unadjusted sub-hazard ratios (sHRs) with 95% confidence intervals (CIs). Kaplan-Meier curves were used to assess the cumulative incidence of MB among patients classified as low, intermediate, and high risk. The Fine-Gray subdistribution hazard model was applied to estimate cumulative incidence, accounting for all-cause mortality as a competing event. Propensity score matching (PSM) was employed to minimize confounding influences. For the initial anticoagulant choice, patients in the DOACs and LMWH groups were matched at a 1:4 ratio (random sampling method; clamp value of 0.05) based on factors associated with MB and mortality risk. At discharge, the anticoagulant groups were compared in a 1:1 ratio (random sampling method; clamp value of 0.001). The balance between the two groups after matching was assessed using standardized mean differences (SMD). Group comparisons of rates were then performed using either Fisher's exact test or the chi-square test.
Patients lost to follow-up were censored at the last visit. Sensitivity analyses were conducted to assess the impact of imputation on model predictions using both imputed and original datasets and to assess the effect of excluding patients lost to follow-up. Bonferroni correction was applied for pairwise comparisons between groups to adjust P-values. A two-sided P-value <0 0.05 was considered statistically significant. All analyses were performed using R software version 4.0.2.
Results
Patient Characteristics
A total of 7,619 patients with acute PE were included in the analysis ([Supplementary Fig. S1], available in the online version). The mean age was 63, with 3,987 men (52.3%), and the mean BMI was 24.2 kg/m2. Overall, 1,098 patients (14.4%) had cancer, and 112 (1.5%) had a history of MB. Syncope as presentation of PE was recorded in 585 patients (7.7%), 751 (9.9%) had a pulse rate of ≥110 beats/min, and 1,635 (21.5%) showed signs of right ventricular dysfunction (RVD). At admission, 3,025 patients (39.7%) had anaemia, and 898 (11.8%) had renal dysfunction. During the acute treatment phase, 6,052 patients (79.4%) received LMWH, 652 (8.6%) were treated with DOACs, and 392 (5.1%) underwent systemic thrombolysis ([Table 1]). Of all participants, 412 (5.4%) were lost to follow-up, and 521 (6.8%) died within 90 days. The MB rate was 1.4% (107 patients), and 35 (0.5%) experienced recurrent VTE. We also compared the baseline characteristics with those from other cohorts ([Supplementary Tables S1] and [S2], available in the online version).
Characteristics |
All (N = 7,619) |
---|---|
Clinical characteristics |
|
Age, mean ± sd (y) |
63 ± 15 |
Age >75, n (%) |
1,737 (22.8) |
Sex, male, n (%) |
3,987 (52.3) |
Body mass index (kg/m2) |
24.2 ± 3.8 |
Underweight (BMI <18.5) |
377 (4.9) |
Risk factors and comorbid diseases, n (%) |
|
History of VTE |
1840 (24.2) |
Cancer |
1,098 (14.4) |
Active cancer |
799 (10.5) |
Recent surgery[a] |
906 (11.9) |
Immobility ≥3 days |
621 (8.2) |
Chronic lung disease |
1,044 (13.7) |
Congestive heart failure |
476 (6.2) |
Previous stroke |
750 (9.8) |
Stroke/transient ischaemic attack/embolism history |
1,739 (22.8) |
Hypertension |
2,749 (36.1) |
Uncontrolled hypertension |
408 (5.4) |
Diabetes |
923 (12.1) |
History of bleeding[a] |
362 (4.8) |
Recent major bleeding[a] |
112 (1.5) |
Clinical symptoms and signs at presentation, n (%) |
|
Systolic blood pressure (mmHg) |
127.8 ± 19.6 |
Syncope[b] |
585 (7.7) |
Pulse ≥110 beats/min |
751 (9.9) |
Right ventricular dysfunction |
1,635 (21.5) |
Simplified PESI score ≥1 |
4,820 (63.3) |
ESC-defined risk categories, n (%) |
|
High risk |
450 (5.9) |
Intermediate-high risk |
1,137 (14.9) |
Intermediate-low risk |
4,310 (56.6) |
Low risk |
1,722 (22.6) |
Laboratory findings, n (%) |
|
Anaemia |
3,025 (39.7) |
Platelet count <100 × 109·L−1 |
364 (4.8) |
Positive troponin[c] |
1,545 (20.3) |
Liver dysfunction |
156 (2.0) |
Renal dysfunction[d] |
898 (11.8) |
eGFR 30–59 |
806 (10.6) |
eGFR <30 |
92 (1.2) |
Serum creatinine, mean ± sd |
74.3 ± 33.1 |
Creatinine levels >1.2 mg/dL |
633 (8.3) |
Treatment in the acute phase, n (%) |
|
LMWH |
6,052 (79.4) |
Unfractioned heparin |
353 (4.6) |
DOACs |
652 (8.6) |
Vitamin K antagonist |
163 (2.1) |
Thrombolysis[e] |
392 (5.1) |
Inferior vena cava filter use |
16 (0.2) |
Other/unknown |
115 (1.5) |
No anticoagulation |
284 (3.7) |
Anticoagulation of discharge, n (%) |
|
LMWH |
1,088 (14.3) |
DOACs |
3,507 (46.0) |
Vitamin K antagonist |
2,501 (32.8) |
Other/unknown |
202 (2.7) |
No anticoagulation |
321 (4.2) |
Outcome, 90 days, n (%) |
|
Major bleeding |
107 (1.4) |
Clinically relevant non-major bleeding |
421 (5.5) |
Recurrent VTE |
35 (0.5) |
Overall death |
521 (6.8) |
Abbreviations: COPD, chronic obstructive pulmonary disease; CURES, China pUlmonary thromboembolism REgistry Study; DOACs, direct oral anticoagulants; DVT, deep venous thrombosis; eGFR, estimated glomerular filtration rate; ESC, European Society of Cardiology; LMWH, low-molecular-weight heparin; N, number; PE, pulmonary embolism; PESI, Pulmonary Embolism Severity Index; SD, standard deviation; VTE, venous thromboembolism.
Note: aWithin the past 3 months.
b Self-reported by the patient (or witnesses).
c Troponin I >0.4 or troponin T >1.
d Renal dysfunction was defined by eGFR values of <60 mL/min/1.73 m2 (the eGFR values were based on the simplified Chronic Kidney Disease Epidemiology Collaboration (eGFRCKD-EPI) formula).
e Systemic thrombolysis, with most patients receiving anticoagulation therapy prior to thrombolysis.
Risk Stratification Based on Scores Derived from VTE Populations
The RIETE, Kuijer, PE-SARD, and BACS scores classified 342 (4.5%), 940 (12.3%), 508 (6.7%), and 32 (0.4%) patients as high risk, respectively; 7,277 (95.5%), 5,365 (70.4%), 2,837 (37.2%), and 2,756 (36.2%) patients as intermediate risk; and 0, 1,314 (17.2%), 4,274 (56.1%), and 4,831 (63.4%) patients as low risk. The RIETE BRS did not classify any patient as low risk, as every patient was assigned 1 point for diagnosing PE ([Table 2]). The predicted bleeding rates were similar to observed rates across all four scores ([Supplementary Fig. S2], available in the online version). The cumulative incidence of MB increased with higher risk stratification levels across all four scores (adjusted P-value <0.05). However, no significant difference was observed between intermediate- and high-risk patients classified using the Kuijer and PE-SARD scores (adjusted P-value >0.1; [Fig. 1]).
Scores |
Low risk |
Intermediate risk |
High risk |
|||
---|---|---|---|---|---|---|
n/N [a] |
% (95% CI) |
n/N [a] |
% (95% CI) |
n/N [a] |
% (95% CI) |
|
RIETE |
NA |
89/7,277 |
1.23 (0.98–1.49) |
18/342 |
5.28 (2.90–7.65) |
|
Kuijer |
6/1,314 |
0.46 (0.09–0.83) |
82/5,365 |
1.54 (1.21–1.87) |
19/940 |
2.03 (1.13–2.93) |
PE-SARD |
33/4,274 |
0.78 (0.51–1.04) |
59/2,837 |
2.10 (1.57–2.63) |
15/508 |
2.96 (1.48–4.44) |
BACS |
45/4,831 |
0.94 (0.67–1.21) |
57/2,756 |
2.08 (1.55–2.62) |
5/32 |
15.63 (2.84–28.41) |
Note: aNumber of major bleeding (n) and overall number of participants in risk group (N).


Performance of Bleeding Risk Scores Derived from VTE Populations
No significant collinearity was found between thrombolysis, 2019 European Society of Cardiology (ESC) risk stratification, and bleeding risk scores ([Supplementary Table S3], available in the online version). Patients classified as high risk by the RIETE BRS had a significantly higher MB risk compared with those at intermediate risk (90 days, adjusted sHR: 4.11, 95% CI, 2.47–6.87; P-value <0.05), with similar findings at 14-day and 30-day follow-ups. For the other scores, patients at high or intermediate risk had a significantly higher MB risk than those at low risk ([Supplementary Table S4], available in the online version). During the 90-day follow-up, all scores had AUCs between 0.6 and 0.7, with the RIETE BRS having the highest AUC (0.70, 95% CI, 0.65–0.75) and the Kuijer score having the lowest (0.60, 95% CI, 0.55–0.65) ([Table 3], [Fig. 2], [Supplementary Table S5], and [Supplementary Fig. S3], available in the online version). The RIETE, PE-SARD, Kuijer, and BACS scores showed similar Brier scores, with acceptable calibration for all except the BACS score in predicting MB at 90 days ([Table 3], [Supplementary Fig. S4], available in the online version).
Abbreviations: DOAC, direct oral anticoagulant; MB, major bleeding.


Comparison of Bleeding Risk Scores Derived from VTE and AF Populations
HAS-BLED, ATRIA, and DOAC scores, originally designed for AF, were compared with VTE-derived scores in this study. Throughout the follow-up, their AUCs ranged from 0.6 to 0.7. All three scores showed similar Brier scores, with only HAS-BLED and DOAC demonstrating acceptable calibration ([Table 3], [Fig. 2], [Supplementary Table S6], [Supplementary Figs. S3] and [S5], available in the online version). Moreover, at the 90-day follow-up, the RIETE BRS showed a significantly higher overall NRI and negative NRI than the other scores, except compared with the HAS-BLED score. Specifically, the RIETE BRS correctly reclassified 12.37% of patients into the high-risk group and incorrectly reclassified 18.98% into the low-risk group compared with HAS-BLED. Although RIETE BRS showed an improvement in IDI, the improvement did not reach statistical significance when compared with HAS-BLED and BACS scores ([Table 4]). The RIETE BRS demonstrated a higher net benefit across a broad range of threshold probabilities than all other scores except the BACS score. The RIETE BRS outperformed the BACS score in the 0 to 3%, while the BACS score was superior in the 3 to 10% range ([Supplementary Fig. S6], available in the online version). Similar results were observed at the 14-day and 30-day follow-ups.
Abbreviations: IDI, integrated discrimination improvement; NRI, net reclassification improvement.
Predictors of Major Bleeding
The results of the univariable analysis for potential predictors are shown in [Supplementary Fig. S7] (available in the online version). Multivariate analysis indicated that age ≥65 years (sHR = 1.61, 95% CI, 1.06–2.47), active cancer (sHR = 1.68, 95% CI, 1.02–2.74), gastrointestinal diseases (sHR = 2.04, 95% CI, 1.17–3.55), prior MB (sHR = 5.75, 95% CI, 2.97–11.15), pulse >100 beats/min (sHR = 1.61, 95% CI, 1.07–2.43), anaemia (sHR = 2.49, 95% CI, 1.61–3.83), PLT <100 × 109/L (sHR = 2.72, 95% CI, 1.55–4.76), and CR >1.2 mg/dL (sHR = 1.77, 95% CI, 1.02–3.07) were independent predictors of MB at 90 days ([Supplementary Fig. S8], available in the online version). Similar results were observed in the subgroup of patients receiving anticoagulation. Additionally, connective tissue disease (CTD, sHR = 2.46, 95% CI, 1.09–5.53) and neurological disease (sHR = 1.95, 95% CI, 1.13–3.38) were also predictors of MB in anticoagulated patients ([Supplementary Figs. S9] and [S10], available in the online version).
Subgroup Analyses
In a subgroup analysis of 6,921 anticoagulated patients, the AUCs for predicting MB at 90 days were as follows: RIETE BRS, 0.71 (95% CI, 0.66–0.77); Kuijer score, 0.58 (95% CI, 0.53–0.64); PE-SARD score, 0.65 (95% CI, 0.60–0.71); BACS score, 0.62 (95% CI, 0.56–0.68); HAS-BLED score, 0.70 (95% CI, 0.65–0.75); ATRIA score, 0.70 (95% CI, 0.65–0.76) and DOAC score, 0.64 (95% CI, 0.58–0.70) ([Supplementary Table S7], available in the online version). Among the scores that effectively predict MB, the RIETE BRS also exhibited the highest sensitivity (75.35%, 95% CI, 64.75–84.01) and Negative Predictive Value (NPV) (99.47%, 95% CI, 99.26–99.62). The NRI and IDI results were generally consistent with those observed in the overall population. Compared with the Kuijer, PE-SARD, BACS, ATRIA, and DOAC scores, the RIETE BRS showed superior NRIs of 60.70, 48.60, 45.10, 41.08, and 42.77%, respectively. Compared with HAS-BLED, the RIETE BRS showed a decrease in NRI of 11.45%, but this difference was not statistically significant. Similar results were observed at other follow-up intervals ([Supplementary Table S8], available in the online version). In non-cancer patients, AUCs ranged from 0.57 to 0.72. In cancer patients, performance was generally poor, with AUCs ranging from 0.44 to 0.63 ([Supplementary Tables S9] and [S10], available in the online version).
Sensitivity Analyses
We also performed a sensitivity analysis based on scores derived from the VTE population. After excluding patients with missing values, the four bleeding scores showed moderate discriminative performance for MB at 14, 30, and 90 days, with AUCs ranging from 0.6 to 0.7. The RIETE BRS had the highest AUC at 90 days (0.70, 95% CI, 0.65–0.75), consistent with the primary findings. Excluding patients lost to follow-up within 90 days did not affect the scores' discriminative performance. A similar analysis in the anticoagulated subgroup showed results consistent with the primary findings ([Supplementary Table S11], available in the online version).
Clinical Application
Patients with PE who received anticoagulation and subsequently experienced MB had significantly worse 90-day outcomes, including a higher risk of death (adjusted HR = 4.12, 95% CI, 2.78–6.11) and composite events (adjusted HR = 4.34, 95% CI, 2.93–6.42) ([Supplementary Table S12], [Supplementary Fig. S11], available in the online version). To assess the impact of initial anticoagulant choice, we analyzed outcomes in patients receiving either LMWH or DOACs without thrombolysis. For patients where data were available, the initial doses were administered according to guidelines, with dosage adjustments during treatment based on the physician's clinical judgement.
The optimal threshold of the RIETE BRS was used to categorize patients into low- and high-risk groups, with PSM balancing covariates between the two anticoagulant groups ([Supplementary Table S13] [available in the online version], [Fig. 3]). Among low-risk patients, initial use of DOACs was associated with a lower incidence of composite outcomes within 14 days compared with LMWH (HR = 0.13, 95% CI, 0.02–0.93, [Supplementary Tables S14] and [S15], available in the online version). In high-risk patients, the initial anticoagulant choice did not significantly affect outcomes ([Supplementary Table S16], available in the online version). Considering that patients may switch anticoagulants at discharge, we excluded those who died in hospital and categorized the remaining patients into LMWH and DOAC groups based on discharge medication. After adjusting for confounding factors using PSM, patients in the low-risk group discharged on sequential DOACs did not have a higher risk of MB or composite outcomes than LMWH ([Supplementary Fig. S12], [Supplementary Tables S17–S20], available in the online version).


Discussion
The main finding of this study indicated that the seven bleeding risk scores demonstrated modest predictive accuracy, with the RIETE BRS showing relatively better performance in predicting MB compared with other scores. Patients with low bleeding risk showed improved 14-day composite outcomes with the initial use of DOACs compared with LMWH.
Despite widespread validation in other populations, the Kuijer score showed suboptimal performance in our study.[4] [21] [22] The BACS score effectively predicted MB in thrombolysis patients,[5] but its performance in anticoagulated patients was limited. The PE-SARD score demonstrated moderate discriminatory ability, similar to the RIETE (AUC = 0.65) and COMMAND-VTE (AUC = 0.64) data, but underperformed in elderly patients (AUC = 0.52), limiting its applicability in specific subgroups. The RIETE BRS in our external validation confirmed an AUC of 0.70, showing modest predictive ability, consistent with previous studies. Lecumberri et al[10] reported an AUC of 0.70 in 82,239 acute VTE patients, and Chopard et al[6] reported 0.69 in the BFC-FRANCE registry. The RIETE BRS demonstrated relatively high sensitivity and NPV, which may help identify low bleeding risk patients, suggesting it could potentially play a role in guiding anticoagulation.
The HAS-BLED and ATRIA scores are primarily used to assess bleeding risk in AF patients and have been widely validated in cardiovascular diseases.[14] [23] [24] However, their effectiveness in predicting MB risk in PE patients remains controversial. Some studies suggest that the HAS-BLED and ATRIA scores poorly predict MB in PE patients.[25] [26] [27] The DOAC score developed recently is used to predict bleeding risk in AF patients treated with DOACs,[17] but it has been less evaluated in VTE populations. Although AF and VTE patients differ in clinical complexity and comorbidity burden, they share key bleeding risk factors, such as age, renal function, and history of bleeding. Given the lack of VTE-specific bleeding risk scores recommended in clinical practice guidelines and their current use by physicians for bleeding risk assessment in Pulmonary Thromboembolism (PTE) patients, evaluating the applicability of AF-derived scores in PE patients remains clinically relevant. In this study, we externally tested all three scores derived from the AF population, and the results showed moderate predictive performance, suggesting their potential applicability to PE patients. Since this study focused on validating bleeding risk scores derived from the VTE population and some key variables from AF-derived bleeding scores were missing, further external validation is needed.
Our study indicates that the RIETE BRS showed better reclassification ability than other scores, except HAS-BLED, suggesting its potential role in risk stratification. However, all scores showed limited predictive accuracy in cancer patients, highlighting the need for better tools for these subgroups. This finding is consistent with previous research indicating that traditional scores often lack precision in diverse populations.[28] [29] A questionnaire among CURES regional centres ([Supplementary Table S21], available in the online version) revealed that patients assessed with the RIETE BRS had a lower rate of MB (0.9%) than those evaluated with other scores, indicating its potential to guide anticoagulant treatment in PE better. Future research should focus on enhancing existing scores or developing new ones, particularly for high-risk groups like cancer patients. We emphasize that while metrics like AUC assess predictive performance, clinical decisions should consider individual patient characteristics and other clinical factors. Risk scores should serve as supplementary tools, not the sole basis for decision-making.
We identified anaemia, thrombocytopaenia, and advanced age as independent risk factors for MB in patients with PE, consistent with previous research.[6] [30] [31] [32] Bleeding risk factors varied slightly among patients receiving anticoagulation, with neurological diseases and CTD increasing the risk. Studies have shown that patients with a history of stroke have a significantly higher risk of MB during anticoagulation compared with those without stroke.[33] [34] Patients with CTD face elevated bleeding risks, likely due to pathological features, platelet dysfunction, and altered coagulation factors.[35] [36] Notably, although we confirmed that active cancer is associated with MB in PE patients, the location, treatment, and stage of cancer also significantly influence bleeding risk.[37] [38] This aspect requires further exploration in future studies. Clinicians should consider these factors when developing anticoagulation plans to minimize bleeding and improve outcomes in PE patients. In the CURES cohort, bleeding risk factors differed from those identified in other cohorts, highlighting the need for further research into a PE bleeding risk score tailored to the Chinese population.
Our study supports the importance of optimizing anticoagulant choice to improve patient outcomes. In addition to comorbidities and individual factors, the choice of anticoagulant influences bleeding risk. Patients who experienced MB in our study had much higher risks of adverse outcomes. Research suggests that bleeding risk scores can help guide treatment decisions.[9] [39] [40] [41] Previous studies have shown that DOACs are safe and effective for acute PE and cancer-associated VTE, with better safety profiles than LMWH.[42] [43] [44] A meta-analysis also found DOACs non-inferior to LMWH for composite outcomes.[45] Furthermore, DOACs are more cost-effective and improve patient adherence, which can help reduce recurrence risk.[46] [47] After adjusting for baseline risks, we found that low bleeding risk patients initially treated with DOACs had fewer adverse outcomes at 14 days than those treated with LMWH, and sequential use of DOACs after discharge did not increase the risk of MB or composite outcomes. Therefore, the RIETE BRS might be a useful tool for guiding anticoagulant selection, with DOACs potentially being preferred for low-risk patients due to their safety, cost-effectiveness, and improved adherence, though further validation is required.
The consensus statement on bleeding highlights the interaction between modifiable and non-modifiable bleeding risks, recommending that bleeding risk be assessed at the initiation of anticoagulation and during follow-up.[14] More frequent reassessment is advised for high-risk patients (such as those with a high RIETE BRS), along with closer monitoring and adjustments according to modifiable risk factors. The appropriate use of a validated bleeding risk score is essential. Ethnic differences in bleeding risk, particularly between Asian and Western populations, have been widely acknowledged and may impact both treatment strategies and patient outcomes.[48] The growing body of evidence suggests that bleeding risk scores should be tailored to ethnic populations, particularly in East Asians, where the balance of bleeding and thrombosis risks differs significantly.[19] The East Asian paradox reveals the impact of racial differences on bleeding risks, which is likely a multifactorial phenomenon. Future large-scale prospective studies incorporating genetic, pharmacological, environmental, and clinical factors will help further elucidate the nature of this paradox, providing more substantial personalized evidence for treatment strategies in PE. This also highlights the need for further research and developing bleeding risk scores tailored to different racial groups.
This study has several limitations. Residual confounding may influence the study results, even after adjusting for multiple covariates. Although the cohort is large, its generalizability may be limited, particularly for cancer patients, so bleeding risk scores should be used with caution in these subgroups. Additionally, we could not analyze cancer location or stage due to data limitations, which could significantly affect bleeding risk. Another limitation is that thrombocytopaenia was assessed based on admission platelet counts without further analysis of its severity or underlying causes. Although the RIETE BRS showed better predictive ability than other scores, its overall performance remains modest, classifying patients only into high or intermediate risk, suggesting room for improvement. Moreover, although the bleeding risk scores used at discharge were based on baseline characteristics, the components of the RIETE BRS are unlikely to change significantly in the short term, meaning that the patient's risk is relatively stable. Furthermore, certain factors included in the HAS-BLED and DOAC scores, such as NSAID use and alcohol consumption, were not collected in our dataset. As a result, these factors were assigned a default value of 0 in our analysis, which may have affected the external validity of the models. Finally, our study focused solely on the choice of anticoagulant, as dosing and treatment duration are largely guided by existing guidelines, individual assessments, and ongoing monitoring. Future research should refine risk stratification tools for better personalized anticoagulation and explore their role in determining initial doses and treatment duration.
Conclusion
This study tested bleeding risk scores derived from VTE or AF populations and showed moderate predictive performance. Among these, the RIETE BRS demonstrated a modest ability to predict MB and might help identify low-risk patients for whom DOACs could be preferable to LMWH for anticoagulation. However, given the modest performance of the score, further studies are required to test these findings and refine the clinical use of bleeding risk scores in the management of acute PE.
What is known about this topic?
-
Bleeding risk assessment is crucial before initiating anticoagulation for PE, with several scores (Kuijer, BACS, PE-SARD, RIETE, HAS-BLED, ATRIA, and DOAC) demonstrating potential effectiveness.
-
These scores have not been prospectively validated in large Chinese PE cohorts, and Chinese guidelines still rely on older international protocols.
What does this paper add?
-
Among the evaluated scores, the RIETE Bleeding Risk Score (BRS) showed modest predictive capability for major bleeding, with an AUC of 0.70, and could potentially be useful in identifying patients at low risk for bleeding.
-
For patients classified as low risk by RIETE BRS, initial treatment with DOACs was associated with fewer adverse events within 14 days compared with low-molecular-weight heparin (HR = 0.13, 95% CI, 0.02–0.93).
Conflict of Interest
None declared.
Acknowledgment
We express our gratitude to the CURES investigators. All investigators contributed to the collection of data and gave final approval.
Data Availability Statement
The data underlying this article cannot be shared publicly due to ethical reasons. The data will be shared on reasonable request to the corresponding author.
Authors' Contribution
Concept and design: Y.T., H.C., C.D., J.Z., Y.S., X.X., C.W., and Z.Z.; acquisition, analysis, or interpretation of data: all authors; drafting of the manuscript: Y.T., H.C., C.D., M.W., L.Z., L.X., Y.Z., C.W., and Z.Z.; critical review of the manuscript for important intellectual content: all authors; statistical analysis: Y.T., J.S., Y.J., H.C., Z.C., Y.T., L.R., D.W., G.F., and S.W.; obtained funding: C.W. and Z.Z.; administrative, technical, or material support: Y.L., C.D., Q.L., P.L., Y.Y., C.W., and Z.Z.; supervision: J.W., W.X., C.W., and Z.Z. Y.T. and Z.Z. had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
* The members of the CURES are listed in the [Supplementary Appendix] (available in the online version).
-
References
- 1 Barca-Hernando M, García-Ortega A, Martínez-Meñaca A, Ramírez-Martín MP, Rivas-Guerrero A, Tenes A. [Pulmonary embolism]. Open Respir Arch 2024; 6 (04) 100342
- 2 Farmakis IT, Keller K, Barco S, Konstantinides SV, Hobohm L. From acute pulmonary embolism to post-pulmonary embolism sequelae. Vasa 2023; 52 (01) 29-37
- 3 Kuijer PM, Hutten BA, Prins MH, Büller HR. Prediction of the risk of bleeding during anticoagulant treatment for venous thromboembolism. Arch Intern Med 1999; 159 (05) 457-460
- 4 Keller K, Münzel T, Hobohm L, Ostad MA. Predictive value of the Kuijer score for bleeding and other adverse in-hospital events in patients with venous thromboembolism. Int J Cardiol 2021; 329: 179-184
- 5 Jara-Palomares L, Jiménez D, Bikdeli B. et al; RIETE investigators, RIETE Steering Committee Members: Members of the RIETE Group. Derivation and validation of a clinical prediction rule for thrombolysis-associated major bleeding in patients with acute pulmonary embolism: the BACS score. Eur Respir J 2020; 56 (06) 2002336
- 6 Chopard R, Piazza G, Falvo N. et al. An original risk score to predict early major bleeding in acute pulmonary embolism: the syncope, anemia, renal dysfunction (PE-SARD) bleeding score. Chest 2021; 160 (05) 1832-1843
- 7 Chopard R, Bertoletti L, Piazza G. et al. External validation of the PE-SARD risk score for predicting early bleeding in acute pulmonary embolism in the RIETE Registry. Thromb Res 2024; 235: 22-31
- 8 Villiger R, Méan M, Stalder O. et al. Prediction of very early major bleeding risk in acute pulmonary embolism: an independent external validation of the Pulmonary Embolism-Syncope, Anemia, and Renal Dysfunction (PE-SARD) bleeding score. J Thromb Haemost 2023; 21 (10) 2884-2893
- 9 Nopp S, Ay C. Bleeding risk assessment in patients with venous thromboembolism. Hamostaseologie 2021; 41 (04) 267-274
- 10 Lecumberri R, Jiménez L, Ruiz-Artacho P. et al; RIETE investigators. Prediction of major bleeding in anticoagulated patients for venous thromboembolism: comparison of the RIETE and the VTE-BLEED scores. TH Open 2021; 5 (03) e319-e328
- 11 Pisters R, Lane DA, Nieuwlaat R, de Vos CB, Crijns HJ, Lip GY. A novel user-friendly score (HAS-BLED) to assess 1-year risk of major bleeding in patients with atrial fibrillation: the Euro Heart Survey. Chest 2010; 138 (05) 1093-1100
- 12 Apostolakis S, Lane DA, Guo Y, Buller H, Lip GY. Performance of the HEMORR(2)HAGES, ATRIA, and HAS-BLED bleeding risk-prediction scores in patients with atrial fibrillation undergoing anticoagulation: the AMADEUS (evaluating the use of SR34006 compared to warfarin or acenocoumarol in patients with atrial fibrillation) study. J Am Coll Cardiol 2012; 60 (09) 861-867
- 13 Senoo K, Lip GY. Predictive abilities of the HAS-BLED and ORBIT bleeding risk scores in non-warfarin anticoagulated atrial fibrillation patients: an ancillary analysis from the AMADEUS trial. Int J Cardiol 2016; 221: 379-382
- 14 Gorog DA, Gue YX, Chao TF. et al. Assessment and mitigation of bleeding risk in atrial fibrillation and venous thromboembolism: executive summary of a European and Asia-Pacific expert consensus paper. Thromb Haemost 2022; 122 (10) 1625-1652
- 15 Lip GY, Lin HJ, Hsu HC. et al. Comparative assessment of the HAS-BLED score with other published bleeding risk scoring schemes, for intracranial haemorrhage risk in a non-atrial fibrillation population: the Chin-Shan community cohort tudy. Int J Cardiol 2013; 168 (03) 1832-1836
- 16 Brown JD, Goodin AJ, Lip GYH, Adams VR. Risk stratification for bleeding complications in patients with venous thromboembolism: application of the HAS-BLED bleeding score during the first 6 months of anticoagulant treatment. J Am Heart Assoc 2018; 7 (06) e007901
- 17 Aggarwal R, Ruff CT, Virdone S. et al. Development and validation of the DOAC score: a novel bleeding risk prediction tool for patients with atrial fibrillation on direct-acting oral anticoagulants. Circulation 2023; 148 (12) 936-946
- 18 Fang MC, Go AS, Chang Y. et al. A new risk scheme to predict warfarin-associated hemorrhage: the ATRIA (Anticoagulation and Risk Factors in Atrial Fibrillation) Study. J Am Coll Cardiol 2011; 58 (04) 395-401
- 19 Kim HK, Tantry US, Smith Jr SC. et al. The East Asian paradox: an updated position statement on the challenges to the current antithrombotic strategy in patients with cardiovascular disease. Thromb Haemost 2021; 121 (04) 422-432
- 20 Vickers AJ, Cronin AM, Elkin EB, Gonen M. Extensions to decision curve analysis, a novel method for evaluating diagnostic tests, prediction models and molecular markers. BMC Med Inform Decis Mak 2008; 8: 53
- 21 Ortiz Gómez S, Ruiz-Talero P, Muñoz O, Hoyos Pumarejo LM. Validation of the RIETE, Kuijer, and HAS-BLED models to assess 3-month bleeding risk in anticoagulated patients diagnosed with venous thromboembolic disease. Clin Appl Thromb Hemost 2024 ;30:10760296241271351
- 22 Zhang Z, Lei J, Zhai Z. et al. Comparison of prediction value of four bleeding risk scores for pulmonary embolism with anticoagulation: a real-world study in Chinese patients. Clin Respir J 2019; 13 (03) 139-147
- 23 Lip GY, Lane DA. Assessing bleeding risk in atrial fibrillation with the HAS-BLED and ORBIT scores: clinical application requires focus on the reversible bleeding risk factors. Eur Heart J 2015; 36 (46) 3265-3267
- 24 Raval AN, Cigarroa JE, Chung MK. et al; American Heart Association Clinical Pharmacology Subcommittee of the Acute Cardiac Care and General Cardiology Committee of the Council on Clinical Cardiology; Council on Cardiovascular Disease in the Young; and Council on Quality of Care and Outcomes Research. Management of patients on non-vitamin K antagonist oral anticoagulants in the acute care and periprocedural setting: a scientific statement from the American Heart Association. Circulation 2017; 135 (10) e604-e633
- 25 Skowrońska M, Furdyna A, Ciurzyński M. et al. D-dimer levels enhance the discriminatory capacity of bleeding risk scores for predicting in-hospital bleeding events in acute pulmonary embolism. Eur J Intern Med 2019; 69: 8-13
- 26 Vizzotto LJH, Sepeda CDR, Miranda CH. Bleeding in patients hospitalized with acute pulmonary embolism in Brazil. Clinics (Sao Paulo) 2025; 80: 100573
- 27 Klok FA, Niemann C, Dellas C, Hasenfuß G, Konstantinides S, Lankeit M. Performance of five different bleeding-prediction scores in patients with acute pulmonary embolism. J Thromb Thrombolysis 2016; 41 (02) 312-320
- 28 Nishimoto Y, Yamashita Y, Morimoto T. et al; COMMAND VTE Registry-2 Investigators. External validation of the Pulmonary Embolism-Syncope, Anemia, and Renal Dysfunction bleeding score for early major bleeding in patients with acute pulmonary embolism: from the COMMAND VTE Registry-2. J Thromb Haemost 2024; 22 (10) 2784-2796
- 29 de Winter MA, Dorresteijn JAN, Ageno W. et al. Estimating bleeding risk in patients with cancer-associated thrombosis: evaluation of existing risk scores and development of a new risk score. Thromb Haemost 2022; 122 (05) 818-829
- 30 Maestre A, Escribano JC, Lobo JL. et al; RIETE Investigators. Major bleeding in patients with pulmonary embolism presenting with syncope. Eur J Clin Invest 2022; 52 (07) e13774
- 31 Gaboreau Y, Zenatti N, Vermorel C, Imbert P, Bosson JL, Pernod G. Anemia and bleeding in patients receiving anticoagulant therapy for venous thromboembolism: comment. J Thromb Thrombolysis 2018; 46 (01) 84-87
- 32 den Exter PL, Woller SC, Robert-Ebadi H. et al. Management of bleeding risk in patients who receive anticoagulant therapy for venous thromboembolism: Communication from the ISTH SSC Subcommittee on Predictive and Diagnostic Variables in Thrombotic Disease. J Thromb Haemost 2022; 20 (08) 1910-1919
- 33 Yoshimoto T, Toyoda K, Ihara M. et al. Impact of previous stroke on clinical outcome in elderly patients with nonvalvular atrial fibrillation: ANAFIE Registry. Stroke 2022; 53 (08) 2549-2558
- 34 Garcia DA, Fisher DA, Mulder H. et al. Gastrointestinal bleeding in patients with atrial fibrillation treated with apixaban or warfarin: insights from the Apixaban for Reduction in Stroke and Other Thromboembolic Events in Atrial Fibrillation (ARISTOTLE) trial. Am Heart J 2020; 221: 1-8
- 35 Yerramilli SK, Kokula P, Gupta SK. et al. Connective tissue abnormalities in patients with ruptured intracranial aneurysms and no known systemic connective tissue disorder. World Neurosurg 2020; 141: e829-e835
- 36 Severance S, Daylor V, Petrucci T, Gensemer C, Patel S, Norris RA. Hypermobile Ehlers-Danlos syndrome and spontaneous CSF leaks: the connective tissue conundrum. Front Neurol 2024; 15: 1452409
- 37 Crawford J, Herndon D, Gmitter K, Weiss J. The impact of myelosuppression on quality of life of patients treated with chemotherapy. Future Oncol 2024; 20 (21) 1515-1530
- 38 Falanga A, Marchetti M. Cancer-associated thrombosis: enhanced awareness and pathophysiologic complexity. J Thromb Haemost 2023; 21 (06) 1397-1408
- 39 Chu G, Valerio L, van der Wall SJ. et al. Tailoring anticoagulant treatment of patients with atrial fibrillation using a novel bleeding risk score. Heart 2020; 107: 549-555
- 40 Mihatov N, Secemsky EA, Kereiakes DJ. et al. Individualizing dual antiplatelet therapy (DAPT) duration based on bleeding risk, ischemic risk, or both: an analysis from the DAPT study. Cardiovasc Revasc Med 2022; 41: 105-112
- 41 Brinza C, Burlacu A, Tinica G, Covic A, Macovei L. A systematic review on bleeding risk scores' accuracy after percutaneous coronary interventions in acute and elective settings. Healthcare (Basel) 2021; 9 (02) 148
- 42 Becattini C, Agnelli G, Diamanti M. et al; COPE Investigators. Contemporary anticoagulant treatment strategies in patients with acute pulmonary embolism at different risk for death. Vascul Pharmacol 2023; 153: 107245
- 43 Lee A, Oley Jr F, Lo M. et al. Direct oral anticoagulants or low-molecular-weight heparins for venous thromboembolism in patients with brain tumors. Thromb Res 2021; 208: 148-155
- 44 Swartz AW, Drappatz J. Safety of direct oral anticoagulants in central nervous system malignancies. Oncologist 2021; 26 (05) 427-432
- 45 Camilli M, Lombardi M, Vescovo GM. et al. Efficacy and safety of novel oral anticoagulants versus low molecular weight heparin in cancer patients with venous thromboembolism: a systematic review and meta-analysis. Crit Rev Oncol Hematol 2020; 154: 103074
- 46 Kang W, Peng K, Yan VKC. et al. Direct oral anticoagulants versus low-molecular-weight heparin in patients with cancer-associated venous thrombosis: a cost-effectiveness analysis. J Pharm Policy Pract 2024; 17 (01) 2375269
- 47 Schaefer JK, Li M, Wu Z. et al. Anticoagulant medication adherence for cancer-associated thrombosis: a comparison of LMWH to DOACs. J Thromb Haemost 2021; 19 (01) 212-220
- 48 Kang DS, Yang PS, Kim D. et al. Racial differences in bleeding risk: an ecological epidemiological study comparing Korea and United Kingdom subjects. Thromb Haemost 2024; 124 (09) 842-851
Address for correspondence
Publication History
Received: 25 December 2024
Accepted: 21 June 2025
Accepted Manuscript online:
24 June 2025
Article published online:
17 July 2025
© 2025. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution License, permitting unrestricted use, distribution, and reproduction so long as the original work is properly cited. (https://creativecommons.org/licenses/by/4.0/)
Georg Thieme Verlag KG
Oswald-Hesse-Straße 50, 70469 Stuttgart, Germany
-
References
- 1 Barca-Hernando M, García-Ortega A, Martínez-Meñaca A, Ramírez-Martín MP, Rivas-Guerrero A, Tenes A. [Pulmonary embolism]. Open Respir Arch 2024; 6 (04) 100342
- 2 Farmakis IT, Keller K, Barco S, Konstantinides SV, Hobohm L. From acute pulmonary embolism to post-pulmonary embolism sequelae. Vasa 2023; 52 (01) 29-37
- 3 Kuijer PM, Hutten BA, Prins MH, Büller HR. Prediction of the risk of bleeding during anticoagulant treatment for venous thromboembolism. Arch Intern Med 1999; 159 (05) 457-460
- 4 Keller K, Münzel T, Hobohm L, Ostad MA. Predictive value of the Kuijer score for bleeding and other adverse in-hospital events in patients with venous thromboembolism. Int J Cardiol 2021; 329: 179-184
- 5 Jara-Palomares L, Jiménez D, Bikdeli B. et al; RIETE investigators, RIETE Steering Committee Members: Members of the RIETE Group. Derivation and validation of a clinical prediction rule for thrombolysis-associated major bleeding in patients with acute pulmonary embolism: the BACS score. Eur Respir J 2020; 56 (06) 2002336
- 6 Chopard R, Piazza G, Falvo N. et al. An original risk score to predict early major bleeding in acute pulmonary embolism: the syncope, anemia, renal dysfunction (PE-SARD) bleeding score. Chest 2021; 160 (05) 1832-1843
- 7 Chopard R, Bertoletti L, Piazza G. et al. External validation of the PE-SARD risk score for predicting early bleeding in acute pulmonary embolism in the RIETE Registry. Thromb Res 2024; 235: 22-31
- 8 Villiger R, Méan M, Stalder O. et al. Prediction of very early major bleeding risk in acute pulmonary embolism: an independent external validation of the Pulmonary Embolism-Syncope, Anemia, and Renal Dysfunction (PE-SARD) bleeding score. J Thromb Haemost 2023; 21 (10) 2884-2893
- 9 Nopp S, Ay C. Bleeding risk assessment in patients with venous thromboembolism. Hamostaseologie 2021; 41 (04) 267-274
- 10 Lecumberri R, Jiménez L, Ruiz-Artacho P. et al; RIETE investigators. Prediction of major bleeding in anticoagulated patients for venous thromboembolism: comparison of the RIETE and the VTE-BLEED scores. TH Open 2021; 5 (03) e319-e328
- 11 Pisters R, Lane DA, Nieuwlaat R, de Vos CB, Crijns HJ, Lip GY. A novel user-friendly score (HAS-BLED) to assess 1-year risk of major bleeding in patients with atrial fibrillation: the Euro Heart Survey. Chest 2010; 138 (05) 1093-1100
- 12 Apostolakis S, Lane DA, Guo Y, Buller H, Lip GY. Performance of the HEMORR(2)HAGES, ATRIA, and HAS-BLED bleeding risk-prediction scores in patients with atrial fibrillation undergoing anticoagulation: the AMADEUS (evaluating the use of SR34006 compared to warfarin or acenocoumarol in patients with atrial fibrillation) study. J Am Coll Cardiol 2012; 60 (09) 861-867
- 13 Senoo K, Lip GY. Predictive abilities of the HAS-BLED and ORBIT bleeding risk scores in non-warfarin anticoagulated atrial fibrillation patients: an ancillary analysis from the AMADEUS trial. Int J Cardiol 2016; 221: 379-382
- 14 Gorog DA, Gue YX, Chao TF. et al. Assessment and mitigation of bleeding risk in atrial fibrillation and venous thromboembolism: executive summary of a European and Asia-Pacific expert consensus paper. Thromb Haemost 2022; 122 (10) 1625-1652
- 15 Lip GY, Lin HJ, Hsu HC. et al. Comparative assessment of the HAS-BLED score with other published bleeding risk scoring schemes, for intracranial haemorrhage risk in a non-atrial fibrillation population: the Chin-Shan community cohort tudy. Int J Cardiol 2013; 168 (03) 1832-1836
- 16 Brown JD, Goodin AJ, Lip GYH, Adams VR. Risk stratification for bleeding complications in patients with venous thromboembolism: application of the HAS-BLED bleeding score during the first 6 months of anticoagulant treatment. J Am Heart Assoc 2018; 7 (06) e007901
- 17 Aggarwal R, Ruff CT, Virdone S. et al. Development and validation of the DOAC score: a novel bleeding risk prediction tool for patients with atrial fibrillation on direct-acting oral anticoagulants. Circulation 2023; 148 (12) 936-946
- 18 Fang MC, Go AS, Chang Y. et al. A new risk scheme to predict warfarin-associated hemorrhage: the ATRIA (Anticoagulation and Risk Factors in Atrial Fibrillation) Study. J Am Coll Cardiol 2011; 58 (04) 395-401
- 19 Kim HK, Tantry US, Smith Jr SC. et al. The East Asian paradox: an updated position statement on the challenges to the current antithrombotic strategy in patients with cardiovascular disease. Thromb Haemost 2021; 121 (04) 422-432
- 20 Vickers AJ, Cronin AM, Elkin EB, Gonen M. Extensions to decision curve analysis, a novel method for evaluating diagnostic tests, prediction models and molecular markers. BMC Med Inform Decis Mak 2008; 8: 53
- 21 Ortiz Gómez S, Ruiz-Talero P, Muñoz O, Hoyos Pumarejo LM. Validation of the RIETE, Kuijer, and HAS-BLED models to assess 3-month bleeding risk in anticoagulated patients diagnosed with venous thromboembolic disease. Clin Appl Thromb Hemost 2024 ;30:10760296241271351
- 22 Zhang Z, Lei J, Zhai Z. et al. Comparison of prediction value of four bleeding risk scores for pulmonary embolism with anticoagulation: a real-world study in Chinese patients. Clin Respir J 2019; 13 (03) 139-147
- 23 Lip GY, Lane DA. Assessing bleeding risk in atrial fibrillation with the HAS-BLED and ORBIT scores: clinical application requires focus on the reversible bleeding risk factors. Eur Heart J 2015; 36 (46) 3265-3267
- 24 Raval AN, Cigarroa JE, Chung MK. et al; American Heart Association Clinical Pharmacology Subcommittee of the Acute Cardiac Care and General Cardiology Committee of the Council on Clinical Cardiology; Council on Cardiovascular Disease in the Young; and Council on Quality of Care and Outcomes Research. Management of patients on non-vitamin K antagonist oral anticoagulants in the acute care and periprocedural setting: a scientific statement from the American Heart Association. Circulation 2017; 135 (10) e604-e633
- 25 Skowrońska M, Furdyna A, Ciurzyński M. et al. D-dimer levels enhance the discriminatory capacity of bleeding risk scores for predicting in-hospital bleeding events in acute pulmonary embolism. Eur J Intern Med 2019; 69: 8-13
- 26 Vizzotto LJH, Sepeda CDR, Miranda CH. Bleeding in patients hospitalized with acute pulmonary embolism in Brazil. Clinics (Sao Paulo) 2025; 80: 100573
- 27 Klok FA, Niemann C, Dellas C, Hasenfuß G, Konstantinides S, Lankeit M. Performance of five different bleeding-prediction scores in patients with acute pulmonary embolism. J Thromb Thrombolysis 2016; 41 (02) 312-320
- 28 Nishimoto Y, Yamashita Y, Morimoto T. et al; COMMAND VTE Registry-2 Investigators. External validation of the Pulmonary Embolism-Syncope, Anemia, and Renal Dysfunction bleeding score for early major bleeding in patients with acute pulmonary embolism: from the COMMAND VTE Registry-2. J Thromb Haemost 2024; 22 (10) 2784-2796
- 29 de Winter MA, Dorresteijn JAN, Ageno W. et al. Estimating bleeding risk in patients with cancer-associated thrombosis: evaluation of existing risk scores and development of a new risk score. Thromb Haemost 2022; 122 (05) 818-829
- 30 Maestre A, Escribano JC, Lobo JL. et al; RIETE Investigators. Major bleeding in patients with pulmonary embolism presenting with syncope. Eur J Clin Invest 2022; 52 (07) e13774
- 31 Gaboreau Y, Zenatti N, Vermorel C, Imbert P, Bosson JL, Pernod G. Anemia and bleeding in patients receiving anticoagulant therapy for venous thromboembolism: comment. J Thromb Thrombolysis 2018; 46 (01) 84-87
- 32 den Exter PL, Woller SC, Robert-Ebadi H. et al. Management of bleeding risk in patients who receive anticoagulant therapy for venous thromboembolism: Communication from the ISTH SSC Subcommittee on Predictive and Diagnostic Variables in Thrombotic Disease. J Thromb Haemost 2022; 20 (08) 1910-1919
- 33 Yoshimoto T, Toyoda K, Ihara M. et al. Impact of previous stroke on clinical outcome in elderly patients with nonvalvular atrial fibrillation: ANAFIE Registry. Stroke 2022; 53 (08) 2549-2558
- 34 Garcia DA, Fisher DA, Mulder H. et al. Gastrointestinal bleeding in patients with atrial fibrillation treated with apixaban or warfarin: insights from the Apixaban for Reduction in Stroke and Other Thromboembolic Events in Atrial Fibrillation (ARISTOTLE) trial. Am Heart J 2020; 221: 1-8
- 35 Yerramilli SK, Kokula P, Gupta SK. et al. Connective tissue abnormalities in patients with ruptured intracranial aneurysms and no known systemic connective tissue disorder. World Neurosurg 2020; 141: e829-e835
- 36 Severance S, Daylor V, Petrucci T, Gensemer C, Patel S, Norris RA. Hypermobile Ehlers-Danlos syndrome and spontaneous CSF leaks: the connective tissue conundrum. Front Neurol 2024; 15: 1452409
- 37 Crawford J, Herndon D, Gmitter K, Weiss J. The impact of myelosuppression on quality of life of patients treated with chemotherapy. Future Oncol 2024; 20 (21) 1515-1530
- 38 Falanga A, Marchetti M. Cancer-associated thrombosis: enhanced awareness and pathophysiologic complexity. J Thromb Haemost 2023; 21 (06) 1397-1408
- 39 Chu G, Valerio L, van der Wall SJ. et al. Tailoring anticoagulant treatment of patients with atrial fibrillation using a novel bleeding risk score. Heart 2020; 107: 549-555
- 40 Mihatov N, Secemsky EA, Kereiakes DJ. et al. Individualizing dual antiplatelet therapy (DAPT) duration based on bleeding risk, ischemic risk, or both: an analysis from the DAPT study. Cardiovasc Revasc Med 2022; 41: 105-112
- 41 Brinza C, Burlacu A, Tinica G, Covic A, Macovei L. A systematic review on bleeding risk scores' accuracy after percutaneous coronary interventions in acute and elective settings. Healthcare (Basel) 2021; 9 (02) 148
- 42 Becattini C, Agnelli G, Diamanti M. et al; COPE Investigators. Contemporary anticoagulant treatment strategies in patients with acute pulmonary embolism at different risk for death. Vascul Pharmacol 2023; 153: 107245
- 43 Lee A, Oley Jr F, Lo M. et al. Direct oral anticoagulants or low-molecular-weight heparins for venous thromboembolism in patients with brain tumors. Thromb Res 2021; 208: 148-155
- 44 Swartz AW, Drappatz J. Safety of direct oral anticoagulants in central nervous system malignancies. Oncologist 2021; 26 (05) 427-432
- 45 Camilli M, Lombardi M, Vescovo GM. et al. Efficacy and safety of novel oral anticoagulants versus low molecular weight heparin in cancer patients with venous thromboembolism: a systematic review and meta-analysis. Crit Rev Oncol Hematol 2020; 154: 103074
- 46 Kang W, Peng K, Yan VKC. et al. Direct oral anticoagulants versus low-molecular-weight heparin in patients with cancer-associated venous thrombosis: a cost-effectiveness analysis. J Pharm Policy Pract 2024; 17 (01) 2375269
- 47 Schaefer JK, Li M, Wu Z. et al. Anticoagulant medication adherence for cancer-associated thrombosis: a comparison of LMWH to DOACs. J Thromb Haemost 2021; 19 (01) 212-220
- 48 Kang DS, Yang PS, Kim D. et al. Racial differences in bleeding risk: an ecological epidemiological study comparing Korea and United Kingdom subjects. Thromb Haemost 2024; 124 (09) 842-851





