A New Method to Assess the Difficulty of a Medical Diagnosis: Application to Electrocardiographic Interpretation

Abstract:

A new method to assess the relative difficulty of a medical diagnosis and the efficacy of a diagnostic procedure is described. The cases within a population are classified by N independent interpreters, i. e., medical experts or computer programs. The percentages of correctly diagnosed cases by N (unanimity), N-1, N-2, ..., zero interpreters, respectively, are calculated. These Nl + 1 percentages are presented in a histogram. A cumulative plot is derived from the “unanimity” value. The ratio “unanimity value”/“zero value” is proposed as an index of diagnostic performance. An application to the CSE database is presented which is composed of 1,220 electrocardiographic tracings interpreted by 13 cardiologists and 15 computer programs. The cumulative plots, the performance index and Log (index) values, established for eight different diagnostic statements, clearly show the relative degree of diagnostic difficulty for each of them and the particular efficacy of each approach, i. e., electrocardiography versus vectorcardiography, and computerized versus human interpretation.

Key-words

Diagnostic Performance - Evaluation - Human Interpretation - Computer-assisted Interpretation - Electrocardiography - Vectorcardiography

• REFERENCES

• 1 Willems JL, Arnaud P, van Bemmel JH. et al. Common standards for quantitative electrocardiography: Goals and main results. Meth Inform Med 1990; 29: 263-71.
• 2 Willems JL, Abreu-Lima C, Arnaud P. et al. Evaluation of ECG interpretation results obtained by computer and cardiologists. Meth Inform Med 1990; 29: 308-16.
• 3 Willems JL, Abreu-Lima C, Arnaud P. et al. The diagnostic performance of computer programs for the interpretation of electrocardiograms. New Engl J Med 1991; 325: 1767-73.
• 4 Willems JL. Common Standards for Quantitative Electrocardiography, 10th CSE Progress Report. Leuven, Belgium: Acco; 1990
• 5 Armitage P, Berry G. Statistical Methods in Medical Research. 2nd ed.. Blackwell: Scientific Publ; 1987
• 6 Michaelis J, Wellek S, Willems JL. Reference standards for software evaluation. Meth Inform Med 1990; 29: 289-97.
• 7 Morlet D, Rubel P, Willems JL. Value of scatter-graphs for the assessment of ECG computer measurement results. Meth Inform Med 1990; 29: 413-23.
• 8 Van der Lei J, Musen MA, Van der Does E, Man in ‘t Veld AJ Van Bemmel JH. Comparison of computer-aided and human review of general practitioners’ management of hypertension. Lancet 1991; 338: 1504-8.