A Prospective Evaluation of the Medical Consultation System CADIAG-II/RHEUMA in a Rheumatological Outpatient Clinic

Abstract:

To evaluate the performance of CADIAG-II/RHEUMA as consultant in the primary evaluation of patients visiting a rheumatological outpatient clinic, a CADIAG-II/RHEUMA consultation was done for 54 patients and the list of generated diagnostic hypotheses was compared to each clinical discharge diagnosis. For 26 of a total of 126 rheumatological discharge diagnoses, no matching CADIAG-II/RHEUMA diagnosis was available. 94% of all other discharge diagnoses were found in the list of CADIAG-II/RHEUMA hypotheses, 82% among the first third of the list of hypotheses and 48% among the first five hypotheses. We identified the following factors limiting the ability of CADIAG-II/RHEUMA to generate a comprehensive and correctly ranked list of diagnostic hypotheses: (1) a large percentage of patients with early stages of not clearly identified rheumatological conditions; (2) the limited number of CADIAG-II/RHEUMA diagnoses compared to the large number of known rheumatological conditions; (3) the fact that rheumato-logical diseases are rarely characterized by a single pathognomonic feature but are usually diagnosed by combinations of rather unspecific findings.

Keywords:

Fuzzy Set Theory - Expert Systems - Rheumatology - Evaluation - CADIAG-II

• REFERENCES

• 1 Spindelberger W, Grabner G. Ein Computerverfahren zur diagnostischen Hilfestellung. In: Fellinger K. ed. Computer in der Medizin – Probleme, Erfahrungen, Projekte. Vienna: Verlag Brüder Hollinek; 1968: 189-221.
• 2 Moser W, Adlassnig K-P. Consistency checking of binary relationships in a medical knowledge base. Artif Intell Med 1992; 4: 389-407.
• 3 Adlassnig K-P. A fuzzy logical model of computer-assisted medical diagnosis. Method Inform Med 1980; 19: 141-8.
• 4 Adlassnig K-P, Kolarz G, Scheithauer W. Approach to a hospital-based application of a medical expert system. Med Inform 1986; 11: 205-23.
• 5 Adlassnig K-P, Kolarz G, Scheithauer W, Effenberger H, Grabner G. Computer-assisted medical diagnosis. Comp Biol Med 1985; 15: 315-35.
• 6 Adlassnig K-P, Kolarz G, Scheithauer W. Present state of the medical expert system CADIAG-2. Method Inform Med 1985; 24: 13-20.
• 7 Adlassnig K-P. Fuzzy set theory in medical diagnosis. IEEE Transactions on Systems, Man, Cybernetics SMC 1986; 16: 260-5.
• 8 Adlassnig K-P, Kolarz G. Representation and semiautomatic acquisition of medical knowledge in CADIAG-1 and CADIAG-2. Comp Biomed Res 1986; 19: 63-79.
• 9 Adlassnig K-P. Uniform Representation of vagueness and imprecision in patient’s medical findings using fuzzy sets. In: Trappl R. ed. Proceedings of Cybernetics and Systems ’88. Dordrecht: Kluwer Academic Publishers; 1988: 685-92.
• 10 Kolousek G. The system architecture of an integrated medical consultation system and its implementation based on fuzzy technology. Ph.D. Thesis, Technical University of Vienna; Austria: 1997
• 11 Bögl K. Design and implementation of a web-based knowledge acquisition toolkit for medical expert consultation systems. Ph. D. Thesis Technical University of Vienna; Austria: 1997
• 12 Bögl K, Leitich H, Kolousek G, Rothenfluh TE, Adlassnig K-P. Clinical data interpretation in MEDFRAME/CADIAG-4 using fuzzy sets. Biomed Eng Appl, Basis Communications 1996; 8: 488-95.
• 13 Rothenfluh TE, Bögl K, Adlassnig K-P. Representation and acquisition of knowledge for a fuzzy medical consultation system. In: Szczepaniak PS, Lisboa PJ, Tsumoto S. eds. Fuzzy Systems in Medicine. Heidelberg, New York: Springer; 2000: 636-51.
• 14 Brein L. Das medizinische Expertensystem CADIAG-IV: Inferenzprozeß, Erklärungen und Untersuchungsvorschläge. Master Thesis Technical University of Vienna; Austria: 1997
• 15 Zadeh LA. Fuzzy Sets. Inform Contr 1965; 8: 338-53.
• 16 Adlassnig K-P, Kolarz G. CADIAG-2: Computer-assisted medical diagnosis using fuzzy subsets. In: Gupta MM, Sanchez E. eds. Approximate Reasoning in Decision Analysis. Amsterdam: North-Holland Publishing Company; 1982: 219-47.
• 17 Kolarz G, Adlassnig K-P. Problems in establishing the medical expert systems CADIAG-1 and CADIAG-2 in rheumatology. J Med Syst 1986; 10: 395-405.
• 18 Adlassnig K-P, Leitich H, Kolarz G. On the applicability of diagnostic criteria for the diagnosis of rheumatoid arthritis in an expert system. Exp Syst Appl 1993; 6: 441-8.
• 19 Leitich H, Adlassnig K-P, Schuh C, Kolarz G. Improving diagnostic performance with fuzzy logic: a demonstration with the medical expert system CADIAG-2. In: Trappl R. ed. Proceedings of Cybernetics and Systems ’94. Singapore: World Scientific Publishing; 1994: 263-70.
• 20 Leitich H, Adlassnig K-P, Kolarz G. Development and evaluation of fuzzy criteria for the diagnosis of rheumatoid arthritis. Method Inform Med 1996; 35: 334-42.
• 21 Miller RA, Pople HE, Myers JD. INTER-NIST-I, an experimental computer-based diagnostic consultant for general internal medicine. N Engl J Med 1982; 307: 468-76.
• 22 Bankowitz RA, McNeil MA, Challinor SM, Parker RC, Kapoor WN, Miller RA. A computer-assisted medical diagnostic consultation service. Implementation and prospective evaluation of a prototype. Ann Intern Med 1989; 110: 824-32.
• 23 Warner HR. ILIAD: Moving medical decision making into new frontiers. Method Inform Med 1989; 28: 370-2.
• 24 Bergeron B. ILIAD: A diagnostic consultant and patient simulator. MD Computing 1991; 8: 46-53.
• 25 Kingsland LC III, Lindberg DAB, Sharp GC. AI/RHEUM: a consultant system for rheumatology. J Med Syst 1983; 7: 221-7.
• 26 Belmonte-Serrano M, Sierra C, Lopez de Mantaras R. RENOIR: An expert system using fuzzy logic for rheumatology diagnosis. Int J Intell Syst 1994; 9: 985-1000.
• 27 Hernandez C, Sancho JJ, Belmonte MA, Sierra C, Sanz F. Validation of the medical expert system RENOIR. Comput Biomed Res 1994; 27: 456-71.
• 28 Horn W. MESICAR – A medical expert system integrating causal and associative reasoning. Appl Artif Intell 1989; 3: 305-56.
• 29 Horn W. Utilizing detailed anatomical knowledge for hypothesis formation and hypothesis testing in rheumatological decision support. Artif Intell Med 1991; 3: 21-39.
• 30 Schewe S, Herzer P, Krüger K. Prospective application of an expert system for the medical history of joint pain. Klin Wochenschr 1990; 68: 466-71.
• 31 Schewe S, Schreiber MA. Stepwise development of a clinical expert system in rheumatology. Clin Investig 1993; 71: 139-44.
• 32 Bernelot Moens HJ, Van der Korst JK. Development and validation of a computer program using Bayes’s theorem to support diagnosis of rheumatic disorders. Ann Rheum Dis 1992; 51: 266-71.
• 33 Bernelot Moens HJ, Van der Korst JK. Comparison of rheumatological diagnoses by a Bayesian program and by physicians. Method Inform Med 1991; 30: 187-93.
• 34 McCrea JD, McCredie MR, McSherry DM, Brooks PM. A controlled evaluation of diagnostic criteria in the development of a rheumatology expert system. Br J Rheumatol 1989; 28: 13-7.
• 35 Mathew B, Norris D, Hendry D, Waddell G. Artificial intelligence in the diagnosis of low back pain and sciatica. Spine 1988; 13: 168-72.
• 36 Bernelot Moens HJ. Validation of the AI/RHEUM knowledge base with data from consecutive rheumatological outpatients. Method Inform Med 1992; 31: 175-81.
• 37 Mathies H, Otte P, Villiaumey J, St Dixon A. eds. Classification of diseases of the locomotor apparatus. Compendia Rheumatologica 4. Basel: Eular Publishers; 1978