The Measurement of Performance in Probabilistic Diagnosis V. General Recommendations

Guidelines are offered concerning the use of evaluation tools, with emphasis on the simplest and most informative ones amongst those proposed in Parts I—IV of this series. Moreover, the main areas of future research and development, as the authors see them, are pointed out.

Es werden Richtlinien zur Anwendung von Auswertungsmethoden gegeben unter Hervorhebung der einfachsten und informativsten unter den in Teil I—IV dieser Artikelserie vorgeschlagenen. Weiterhin wird auf die nach Auffassung der Autoren wichtigsten Gebiete der zukünftigen Forschung und Entwicklung hingewiesen.

Key-Words:

Computer-aided Diagnosis - Probabilistic Diagnosis - Evaluation of Diagnoses - Evaluation of Medical Decision Aids

Schlüssel-Wörter:

Computerunterstützte Diagnostik - wahrscheinlichkeitstheoretische Diagnose - Auswertung von Diagnosen - Auswertung medizinischer Entscheidungshilfen

• References

• 1 Card W. I, Rusinkiewicz M, Phillips C. I. Utility Estimation of a Set of States of Health. Meth. Inform. Med 1977; 16: 168-175.
• 2 Gelpke G. J, Hadbema J. D.F. Manual for the INDEP--SELECT Programs for Multi-Criteria Selection of Variables in Discriminant Analysis. Univ. of Leiden (Dept. of Medical Statistics) and Erasmus Univ. Rotterdam. (Depts. of Neurosurgery and of Public Health and Social Medicine), Technical Report 1980
• 3 Habbema J. D. F, Hermans J. Selection of Variables in Discriminant Analysis by .F-Statistic and Error Rate. Tech-nometrics 1977; 19: 487-493.
• 4 Habbema J. D. F, Hilden J. Some Pitfalls and Difficulties in Evaluating Decision Aids in Clinical Practice. In Al-pérovitch A, de Dombal F. T, Grémy F. (Eds): Evaluation of Efficacy of Medical Action Amsterdam: North-Holland Publ. Co; 1979: 512-521.
• 5 Habbema J. D. F, Hilden J, Bjerregaard B. The Measurement of Performance in Probabilistic Diagnosis — I. The Problem, Descriptive Tools, and Measures Based on Classification Matrices. Meth. Inform. Med 1978; 17: 217-226.
• 6 Habbema J. D. F, Hilden J. The Measurement of Performance in Probabilistic Diagnosis — IV. Utility Considerations in Therapeutics and Prognostics. Meth. Inform. Med 1981; 20: 80-96.
• 7 Habbema J. D. F, van der Maas P. J. Decision Theory in Clinical Medicine: An Appraisal of its Uses, its Assumptions and its Limits. In E. Girelli-Bruni (Edit.): Teoría delle deci-sioni in medicina: Aspetti sociali, ideologici e metodologici della statistica in medicina. Verona: Bertani Editore; 1980
• 8 Hilden J. Statistical Comparison of Systems for Computer-aided Medical Diagnosis. In Hoskuldsson A, Conradsen K, Stene J. (Eds): Symposium i anvendt Statistik; biometric part Lyngby, Denmark: Northern Europe Univ. Comput. Centre; 1979: 131-159.
• 9 Hilden J, Habbema J. D.F. A Comparative Evaluation of Two Systems in Probabilistic Jaundice Diagnosis. In Al-pérovitch A, de Dombal F. T, Grémy F. (Eds): Evaluation of Efficacy of Medical Action Amsterdam: North-Holland Publ. Co; 1979: 123-132.
• 10 Hilden J, Habbema J. D. F, Bjerregaard B. The Measurement of Performance in Probabilistic Diagnosis — II. Trustworthiness of the Exact Values of the Diagnostic Probabilities. Meth. Inform. Med 1978; 17: 227-237.
• 11 Hilden J, Habbema J. D. F, Bjerregaard B. The Measurement of Performance in Probabilistic Diagnosis — III. Methods Based on Continuous Functions of the Diagnostic Probabilities. Meth. Inform. Med 1978; 17: 238-246.
• 12 Lichtenstein S, Fischhoff B, Phillips L. D. Calibration of Probabilities. The State of the Art. In Jungermann H, de Zeeuw G. (Eds): Decision Making and Change in Human Affairs Dordrecht: D. Reidel Publ. Co.; 1977: 275-324.
• 13 Titterington D. M, Murray G. D, Parker L. S, Spiegelhalter D. J, Skene A. M, Habbema J. D. F, Gelpke G. J. Comparison of Discrimination Techniques Applied to a Complex Data Set of Head Injured Patients. J. roy. Statist. Soc. A, in press 1981