Information Content of Diagnostic Tests in the Medical Literature

Abstract

Diagnostic tests provide information about the presence or absence of disease. However, even after application of diagnostic tests, significant uncertainty about the state of the patient often remains. This uncertainty can be quantified through the use of information theory. The “information” contained in diagnostic tests published in the medical literature of the years 1982 through 1986 was evaluated using Shannon information functions. Information content, averaged over all prior probabilities of disease, ranged from 0.002 bits to 0.720 bits of information; the tests therefore provided from 0.3% to 100% of the information needed for diagnostic certainty. Median average information was 0.395 bits, corresponding to only 55% of the information required for diagnostic certainty. Reclassifying test results into multiple mutually exclusive outcome categories allowed extraction of a median of 14% and a maximum of 109% more average information than that obtained using a dichotomous positive/negative classification. We conclude that the “information” provided by many of the tests published in the medical literature is insufficient to overcome diagnostic uncertainty. Information theory can quantify the uncertainty associated with diagnostic testing and suggest strategies for reducing this uncertainty.

Key-Words

Information Theory - Diagnostic Tests

• REFERENCES

• 1 Ransohoff D F, Feinstein A R. Problems of spectrum and bias in evaluating the efficacy of diagnostic tests. N Engl J Med 1978; 299: 926-30.
• 2 Department of Clinical Epidemiology and Biostatistics, McMaster University Health Sciences Center. How to read clinical journals: II. To learn about a diagnostic test. Can Med Assoc J 1981; 124: 703-10.
• 3 Heckerling P S. Confidence in diagnostic testing. J Gen Intern Med 1988; 03: 604-6.
• 4 Shannon E C, Weaver W. The Mathematical Theory of Communication . Chicago: Univ. of Illinois Press; 1949
• 5 Barnoon S, Wolfe H. Measuring the Effectiveness of Medical Decisions: An Operations Research Approach . Springfield: Charles C. Thomas; 1972: 53-73.
• 6 Diamond G A, Hirsch M, Forrester J S. et al. Application of information theory to clinical diagnostic testing: the electrocardiographic stress test. Circulation 1981; 63: 915-21.
• 7 Rifkin R D. Maximum Shannon information content of diagnostic medical testing: including application to multiple non-independent tests. Med Decis Making 1985; 05: 179-90.
• 8 Khinchin A I. Mathematical Foundations of Information Theory. New York: Dover Publ Inc; 1957
• 9 Green D M, Swets J A. Signal Detection Theory and Psychophysics. New York: John Wiley and Sons Inc; 1974: 45-49.
• 10 Hanley J A, McNeil B J. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982; 143: 29-36.