Optimising Health Informatics Outcomes – Getting Good Evidence to Where it Matters

Summary

This editorial is part of a For-Discussion-Section of Methods of Information in Medicine about the paper “Evidence-based Health informatics: How do we know what we know?”, written by Elske Ammenwerth [1]. Health informatics uses and applications have crept up on health systems over half a century, starting as simple automation of large-scale calculations, but now manifesting in many cases as rule- and algorithm-based creation of composite clinical analyses and ‘black box’ computation of clinical aspects, as well as enablement of increasingly complex care delivery modes and consumer health access. In this process health informatics has very largely bypassed the rules of precaution, proof of effectiveness, and assessment of safety applicable to all other health sciences and clinical support systems. Evaluation of informatics applications, compilation and recognition of the importance of evidence, and normalisation of Evidence Based Health Informatics, are now long overdue on grounds of efficiency and safety. Ammenwerth has now produced a rigorous analysis of the current position on evidence, and evaluation as its lifeblood, which demands careful study then active promulgation. Decisions based on political aspirations, ‘modernisation’ hopes, and unsupported commercial claims must cease – poor decisions are wasteful and bad systems can kill. Evidence Based Health Informatics should be promoted, and expected by users, as rigorously as Cochrane promoted Effectiveness and Efficiency, and Sackett promoted Evidence Based Medicine – both of which also were introduced retrospectively to challenge the less robust and partially unsafe traditional ‘wisdom’ in vogue. Ammenwerth’s analysis gives the necessary material to promote that mission.

Keywords

Health informatics - evidence - evaluation - evidence-based health informatics - policy - effectiveness - safety

• References

• 1 Ammenwerth E. Evidence-based Health Informatics: How do we know what we know?. Methods Inf Med 2015; 54 (04) 298-307.
• 2 Carroll L. Alice in Wonderland, first published London. 1865
• 3 Grémy F, Bonnin M. Evaluation of Automatic Health Information Systems - What and How? In van Gennip EMSJ and Talmon J (eds.). Assessment and Evaluation of Information Technologies in Medicine. Amsterdam: IOS Press; 1995
• 4 European Commission. Communication from the Commission on the Precautionary Principle, COM(2000) 1, Brussels. 2000
• 5 Fisher E, Jones J, von Schomberg R. (eds) Implementing the Precautionary Principle: Perspectives and Prospects. Cheltenham, UK and Northampton, MA, US: Edward Elgar; 2006
• 6 Ritter t.. Who was at Downing Street Meeting? Computer Weekly, 17 February. 2008. available on line at http://www.computerweekly.com/blogs/public-sector/2008/02/who-was-at-downing-street-npfi.html (accessed 23 June 2015).
• 7 Magrabi F, Baker M, Sinha I, Ong MS, Harrison S, Kidd MR, Runciman WB, Coiera E. Clinical safety of England’s national programme for IT: a retrospective analysis of all reported safety events 2005 to 2011. Int J Med Inform 2015; 84 (03) 198-206.
• 8 Web list “Bad Health Informatics can Kill” (accessible via the Bad Health Informatics link at. http://iig.umit.at/efmi (accessed 23 June 2015).
• 9 Cochrane AL. Effectiveness and efficiency: random reflections on health services. Oxford: Oxford University Press; 1973
• 10 Sackett DL, Rosenberg WM. On the need for evidence-based medicine. Health Econ 1995; 4 (04) 249-254.
• 11 Ammenwerth E, Brender J, Nykänen P, Prokosch H-U, Rigby M, Talmon J. et al. Visions and strategies to improve evaluation of health information systems: Reflections and lessons based on the HIS-EVAL workshop in Innsbruck. International Journal of Medical Informatics 2004; 73 (06) 479-491.
• 12 Rigby M, Ammenwerth E, Beuscart-Zephir M-C, Brender J, Hyppönen H, Melia S, Nykänen P, Talmon J, de Keizer N. Evidence Based Health Informatics: 10 Years of Efforts to Promote the Principle - Joint Contribution of IMIA WG EVAL and EFMI WG EVAL. in Sérousi B, Jaulent M-C, Lehmann CU. (eds.) Evidence-based Health Informatics - IMIA Yearbook of Medical Informatics. 2013: 34-46.
• 13 Elske Ammenwerth, Nicolette de Keizer. Evaluation Database - A web-based inventory of evaluation studies in medical informatics; Institute for Health Information Systems. University for Health Sciences, Medical Informatics and Technology; Austria: (on-going) available at https://evaldb.umit.at/ (accessed 23 June 2015).
• 14 Lightfoot G. Early Morning Rain (available on. http://www.azlyrics.com/lyrics/gordonlightfoot/earlymorningrain.html (accessed 23 June 2015).
• 15 Talmon J, Ammenwerth E, Brender J, de Keizer N, Nykänen P, Rigby M. STARE-HI - Statement on Reporting of Evaluation Studies in Health Informatics. Int J of Medical Informatics 2009; 78 (01) 1-9.
• 16 http://www.equator-network.org/reporting-guidelines/stare-hi-statement-on-reporting-of-evaluation-studies-in-health-informatics/ (accessed 24 June 2015).
• 17 Ham C, Hunter DJ, Robinson R. Evidence-based Policy; British Medical Journal. 1995; 310: 71.
• 18 Gray JAM. Evidence-based Healthcare: How to make Health Policy and Management Decisions. 2nd ed. Edinburgh: Churchill Livingstone; 2001