Bleeding Classification in Clinical Trials: Observer Variability and Clinical Relevance

Summary

To evaluate the bleeding classification in a recent trial on venous thrombosis treatment, a selection of reported bleeding episodes was adjudicated twice by an independent committee and graded by the treating physician and independent clinical experts on the clinical severity and impact on the patient’s life.

The kappa values for the dichotomy major bleeding versus minor or no bleeding were 0.79 (95% CI, 0.57-1.0) for the agreement between the two members of the adjudication committee and 0.77 (95% CI, 0.52-1.0) for the agreement between both adjudication sessions. The kappa values for the dichotomy major or minor bleeding versus no bleeding were 0.42 and 0.44. The weighted kappa values for the agreement between the treating physician and the independent experts were 0.76 for the Clinical severity and 0.79 for the impact on the patient’s life (95% CI, 0.63-0.88 and 0.70-0.89). The association between the adjudication result expressed as major bleeding or minor or no bleeding and the Clinical grading by the treating physician resulted in an ROC curve with an area under the curve of 0.98 for the Clinical severity and 0.99 for the impact on the patient’s life. The dichotomy major or minor bleeding versus no bleeding resulted in areas under the curve of 0.70 and 0.66.

In conCIusion, the applied criteria for major bleeding are reproducible and Clinically relevant. The criteria for minor bleeding are not reproducible and are less associated with the observed Clinical relevance.

• References

• 1 Prandoni P, Lensing AWA, BÜller HR, Carta M, Cogo A, Vigo M, Casara D, Ruol A, Ten CateJW. Comparison of subcutaneous low-molecular- weight heparin with intravenous standard heparin in proximal deep-vein thrombosis. Lancet 1992; 339: 441-445
• 2 Schulman S, Lockner D, Juhlin-Dannfelt A. The duration of oral anticoagulation after deep vein thrombosis. A randomized study. Acta Med Scand 1985; 217: 547-552
• 3 Albada J, Nieuwenhuis HK, Sixma JJ. Treatement of acute venous thromboembolism with low molecular weight heparin (Fragmin). Results of a double-blind randomized study. Circulation 1989; 80: 935-940
• 4 Goldhaber SZ, Meyerovitz MF, Green D, Vogelzang RL, Citrin P, Heit J, Sobel M, Wheeler HB, Plante D, Kim H, Hopkins A, Tufte M, Stump D, Braunwald E. Randomized controlled trial of tissue plasminogen activator in proximal deep venous thrombosis. Am J Med 1990; 88: 235-240
• 5 Robertson BR, Nilsson IM, Nylander G. Thrombolytic effect of streptokinase as evaluated by phlebography of deep venous thrombi of the leg. Acta Chir Scand 1970; 136: 173-180
• 6 Tibbutt DA, Williams EW, Walker MW, Chesterman CN, Holt JM, Sharp AA. Controlled trial of ancrod and streptokinase in the treatment of deep vein thrombosis of lower limb. Br J Haematol 1974; 27: 407-414
• 7 Kakkar VV, Flanc C, Howe CT, O’Shea M, Flute PT. Treatement of deep vein thrombosis. A trial of heparin, streptokinase, and arvin. Br Med J 1969; 1: 806-810
• 8 Hull RD, Raskob GE, Rosenbloom D, Panju AA, Brill-Edwards P, Ginsberg J, Hirsh J, Martin GJ, Green D. Heparin for 5 days as compared with 10 days in the initial treatment of proximal venous thrombosis. N Engl J Med 1990; 322: 1260-1264
• 9 Verhaeghe R, Besse P, Bounameaux H, Marbet GA. Multicenter pilot study of the efficacy and safety of systemic rt-PA administration in the treatment of deep vein thrombosis of the lower extremities and/or pelvis. Thromb Res 1989; 55: 05-11
• 10 Pini M, Pattacini C, Quintavalla R, Poli T, Tagliaferri A, Manotti C, Dettori AG. Subcutaneous vs intravenous heparin in the treatment of deep venous thrombosis - a randomized clinical trial. Thromb Haemost 1990; 64: 222-226
• 11 Landefeld CS, Anderson PA, Goodnough LT, Moir TW, Horn DL, Rosenblatt MW, Goldman L. The bleeding severity index: Validation and comparison to other methods for classifying bleeding complications of medical therapy. J Clin Epidemiol 1989; 42: 711-718
• 12 Koopman MMW, Prandoni P, Piovella F, Ockelford PA, Brandjes DPM, van derMeer J, Gallus AS, Simmonneau G, Chesterman C, Prins MH, Bossuyt PMM, de HaesH, van denBelt AGM, Sagnard L, d’Azemar P, Büller HR. for the TASMAN study group Treatment of venous thrombosis with intravenous unfractionated heparin administered in the hospital as compared with subcutaneous low-molecular-weight heparin administered at home. N Engl J Med 1996; 334: 682-687
• 13 De HaanR, Limburg M, Bossuyt P, Van derMeulen J, Aaronson N. The clinical meaning of Rankin ‘handicap’ grades after stroke. Stroke 1995; 26: 2027-2030
• 14 Kramer MS, Feinstein AR. Clinical biostatistics: LIV. The biostatistics concordance. Clin Pharmacol Ther 1981; 29: 111-123
• 15 Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982; 143: 29-36
• 16 Levine M, Gent M, Hirsh J, Leclerc J, Anderson D, Weitz J, Ginsberg J, Turpie AGG, Demers C, Kovacs M, Geerts W, Kassis J, Desjardins L, Cusson J, Cruickshank M, Powers P, Brien W, Haley S, Willan A. A comparison of low-molecular-weight heparin administered primarily at home with unfractionated heparin administered in the hospital for proximal deep-vein thrombosis. N Engl J Med 1996; 334: 677-681
• 17 Hull RD, Raskob GE, Pineo GR, Green D, Trowbridge AA, Elliot G, Lerner RG, Hall J, Sparlling T, Brettell HR, Norton J, Carter CJ, George R, Merli G, Ward J, Mayo W, Rosenbloom D, Brant R. Subcutaneous low-molecular-weight heparin compared with continuous intravenous heparin in the treatment of proximal-vein thrombosis. N Engl J Med 1992; 326: 975-982