Methods for Addressing Technology-induced Errors: The Current State

Summary

Objectives: The objectives of this paper are to review and discuss the methods that are being used internationally to report on, mitigate, and eliminate technology-induced errors.

Methods: The IMIA Working Group for Health Informatics for Patient Safety worked together to review and synthesize some of the main methods and approaches associated with technology-induced error reporting, reduction, and mitigation. The work involved a review of the evidence-based literature as well as guideline publications specific to health informatics.

Results: The paper presents a rich overview of current approaches, issues, and methods associated with: (1) safe HIT design, (2) safe HIT implementation, (3) reporting on technology-induced errors, (4) technology-induced error analysis, and (5) health information technology (HIT) risk management. The work is based on research from around the world. Conclusions: Internationally, researchers have been developing methods that can be used to identify, report on, mitigate, and eliminate technology-induced errors. Although there remain issues and challenges associated with the methodologies, they have been shown to improve the quality and safety of HIT. Since the first publications documenting technology-induced errors in healthcare in 2005, we have seen in a short 10 years researchers develop ways of identifying and addressing these types of errors. We have also seen organizations begin to use these approaches. Knowledge has been translated into practice in a short ten years whereas the norm for other research areas is of 20 years.

Keywords

Technology-induced error - health information technology - patient safety - risk management - safety

• References

• 1 Kohn LT, Corrigan JM, Donaldson MS. editors. To err is human: Building a Safer Health System (Vol. 6). National Academies Press; 2000
• 2 Kushniruk AW, Triola MM, Borycki EM, Stein B, Kannry JL. Technology induced error and usability: the relationship between usability problems and prescription errors when using a handheld application. Int J Med Inform 2005; Aug 31 74 (07) 519-26.
• 3 Kuziemsky CE, Borycki E, Nøhr C, Cummings E. The nature of unintended benefits in health information systems. Stud Health Technol Inform 2012; 180: 896-900.
• 4 Kuperman GJ, McGowan JJ. Potential Unintended Consequences of Health Information Exchange. J Gen Int Med 2011; 28 (12) 1663-6.
• 5 Borycki EM, Kushniruk AW. Where do technology-induced errors come from?. Towards a model for conceptualizing and diagnosing errors caused by technology. Human, Social and Organizational Aspects of Health Information Systems; 2008 p. 148-65.
• 6 Magrabi F, Ong MS, Runciman W, Coiera E. Using FDA reports to inform a classification for health information technology safety problems. J Am Med Inform Assoc 2012; Jan 1 19 (01) 45-53.
• 7 Koppel R, Metlay JP, Cohen A, Abaluck B, Localio AR, Kimmel SE. et al. Role of computerized physician order entry systems in facilitating medication errors. J Am Med Inform Assoc 2005; Mar 9 293 (10) 1197-203.
• 8 Ash JS, Berg M, Coiera E. Some unintended consequences of information technology in health care: the nature of patient care information system-related errors. J Am Med Inform Assoc 2004; Mar 1 11 (02) 104-12.
• 9 Kushniruk A, Surich J, Borycki E. Detecting and Classifying Technology-Induced Error in the Transmission of Healthcare Data. In24th International Conference of the European Federation for Medical Informatics Quality of Life Quality of Information (Vol. 26). MIE2012/CD/Short Communications.
• 10 Kirkendall ES, Kouril M, Minich T, Spooner SA. Analysis of electronic medication orders with large overdoses: opportunities for mitigating dosing errors. Appl Clin Inform 2014; 5 (01) 25-45.
• 11 Phansalkar S, Van der Sijs H, Tucker AD, Desai AA, Bell DS, Teich JM. et al. Drug—drug interactions that should be non-interruptive in order to reduce alert fatigue in electronic health records. J Am Med Inform 2013; May 1 20 (03) 489-93.
• 12 Borycki EM, Househ MS, Kushniruk AW, Nohr C, Takeda H. Empowering patients: Making health information and systems safer for patients and the public. Contribution of the IMIA Health Informatics for Patient Safety Working Group. Yearbook Med Inform 2011; Dec;7 (01) 56-64.
• 13 Househ M, Borycki E, Kushniruk AW, Alofaysan S. mHealth: A passing fad or here to stay. Telemedicine and E-health services, policies and applications: Advancements and developments 2012 Apr 30 151-73.
• 14 Borycki EM, Kushniruk AW, Keay L, Kuo A. A framework for diagnosing and identifying where technology-induced errors come from. Stud Health Tech Inform 2008 Dec 148 181-7.
• 15 Sherer SA, Meyerhoefer CD, Sheinberg M, Levick D. Integrating commercial ambulatory electronic health records with hospital systems: An evolutionary process. Int J Med Inform 2015; Sep;84 (09) 683-93.
• 16 Doupi P. National reporting Systems for Patient Safety Incidents. A review of the situation in Europe. Report 13. Helsinki: National Institute for Health and Welfare; 2009
• 17 Levtzion-Korach O, Frankel A, Alcalai H, Keohane C, Orav J, Graydon-Baker E. et al. Integrating incident data from five reporting systems to assess patient safety: Making sense of the elephant. Joint Comm J Qual Patient Saf 2010; 36 (09) 402410.
• 18 IOM. Health IT and patient safety: Building safer systems for better care. Washington, DC: The National Academies Press; 2011
• 19 Jylhä V, Saranto K, Bates DW. Preventable adverse drug events and their causes and contributing factors: the analysis of register data. Int J Qual Health Care 2011; 23 (02) 187-97.
• 20 Christiaans-Dingelhoff I, Smits M, Zwaan L, Lubberding S, Van DW, Wagner C. To what extent are adverse events found in patient records reported by patients and healthcare professionals via complaints, claims and incident reports. BMC Health Serv Res 2011; 11 (01) 49.
• 21 Gong Y, Song H-Y, Wu X, Hua L. Identifying barriers and benefits of patient safety event reporting toward user-centered design. Safety in Health 2015; 1 (01) 7.
• 22 AHRQ. Common Formats. from https://www.psoppc.org/web/patientsafety/version-1.2_documents. 2011
• 23 Gong Y. Data consistency in a voluntary medical incident reporting system. J Med Syst 2011; Aug; 35 (04) 609-15.
• 24 Hua L, Gong Y. Toward user-centered patient safety event reporting system: A trial of text prediction in clinical data entry. Stud Health Technol Inform 2015; 216: 188-92.
• 25 Liang C, Gong Y. Enhancing patient safety event reporting by K-nearest neighbor classifier. Stud Health Technol Inform 2015; 218: 406.
• 26 Liang C, Gong Y. On building an ontological knowledge base for managing patient safety events. Stud Health Technol Inform 2015; 216: 202-6.
• 27 Morisky DE, Green LW, Levine DM. Concurrent and predictive validity of a self-reported measure of medication adherence. Med Care 1986; Jan 1 24 (01) 67-74.
• 28 Vänskä J, Vainiomäki S, Kaipio J, Hyppönen H, Reponen J, Lääveri T. Potilastietojärjestelmät lääkärin työvälineenä 2014: käyttäjäkokemuksissa ei merkittäviä muutoksia. [Electronic Patient Record systems as physicians’ tools in 2014: no significant changes in user experience reported by physicians]. Finnish Med J 2014; 49 (69) 3351-8 (in Finnish, English summary).
• 29 Viitanen J, Hyppönen H, Lääveri T, Vänskä J, Reponen J, Winblad I. National questionnaire study on clinical ICT systems proofs: Physicians suffer from poor usability. Int J Med Inform 2011; 80 (10) 708-25.
• 30 Kushniruk A. Evaluation in the design of health information systems: Application of approaches emerging from usability engineering. Comput Biol Med 2002; May 31 32 (03) 141-9.
• 31 Borycki EM, Kushniruk AW, Keay L, Kuo A. A framework for diagnosing and identifying where technology-induced errors come from. Stud Health Tech Inform 2008; Dec;148: 181-7.
• 32 Borycki E, Kushniruk A, Nohr C, Takeda H, Kuwata S, Carvalho C. et al. Usability methods for ensuring health information technology safety: Evidence-based approaches. Contribution of the IMIA Working Group Health Informatics for Patient Safety. Yearb Med Inform 2012; Dec;8 (01) 20-7.
• 33 Borycki EM, Kushniruk AW, Kuwata S, Kannry J. Use of simulation approaches in the study of clinician workflow. AMIA Annual Symposium Proceedings; 2006. p. 61.
• 34 Borycki E, Kushniruk A, Anderson J, Anderson M. Designing and integrating clinical and computer-based simulations in health informatics: From real-world to virtual reality. INTECH Open Access Publisher; 2010
• 35 Carayon P. Human factors and ergonomics in health care and patient safety. In Handbook of Human Factors and Ergonomics in Patient Safety. Edited by Carayon P: CRC Press; 2007
• 36 Kensing F, Blomberg J. Participatory design: Issues and concerns. 7th edition. Computer Supported Cooperative Work: Springer Science and Business Media; 1998. p. 167-85.
• 37 Lyng KM, Pedersen BS. Participatory design for computerization of clinical practice guidelines. J Biomed Inform 2011; 44: 909-18.
• 38 Kujala S. User involvement: A review of the benefits and challenges. Behav Inform Tech 2003; 22 (01) 1-16.
• 39 Rasmussen SL, Lyng KM, Jensen S. Achieving IT-supported standardized nursing documentation through participatory design. Stud Health Technol Inform 2012; 180: 1055-9.
• 40 Technology Committee on Patient Safety in Health IT.. Health IT and patient safety: Building safer systems for better care. Institute of Medicine; 2011
• 41 Patrick J, Budd P. Ockham’s razor of design. Proceedings of the 1st ACM International Health Informatics Symposium Washington DC: Nov 2010. http://portal.acm.org/citation.cfm?id=1882998&CFID=116605072&CFTOKEN=43603995.
• 42 Senathirajah Y, Bakken S. Architectural and usability considerations in the development of a Web 2.0- based EHR. Adv Inform Tech Comm Health, IOS Press; 2009. p. 315-21.
• 43 Senathirajah Y, Kaufman D, Bakken S. The clinician in the driver’s Seat: Part 1 - A User-composable electronic health record platform. J Biomed Inform 2014; Dec 52: 165-76.
• 44 Senathirajah Y, Kaufman D, Bakken S. The clinician in the driver’s seat: Part 2 - intelligent uses of space in a drag/drop user-composable electronic health record. J Biomed Inform 2014; Dec 52: 177-88.
• 45 Trimble JP, Dayton T, Quinol M. Putting the users in charge: A Collaborative, User-composable interface for NASA’s Mission Control. 45th International Conference on System Sciences, Hawaii: 2012
• 46 Carvalho CJ, Borycki EM, Kushniruk A. Ensuring the safety of health information systems: using heuristics for patient safety. Healthc Q 2008; Dec;12: 49-54.
• 47 Coiera EW. Lessons from the NHS National Programme for IT. Med J Aust 2007; Jan 1 186 (01) 3.
• 48 Marcilly R, Peute LW, Beuscart-Zephir MC, Jaspers MW. Towards Evidence Based Usability in Health Informatics?. Stud Health Technol Inform 2015; 218: 55-60.
• 49 Marcilly R, Ammenwerth E, Vasseur F, Roehrer E, Beuscart-Zephir MC. Usability flaws of medication-related alerting functions: A systematic qualitative review. J Biomed Inform 2015; 55: 260-71.
• 50 Marcilly R, Ammenwerth E, Roehrer E, Pelayo S, Vasseur F, Beuscart-Zephir MC. Usability flaws in medication alerting systems: Impact on usage and work system. Yearb Med Inform 2015; 10 (01) 55-67.
• 51 Zahabi M, Kaber DB, Swangnetr M. Usability and safety in electronic medical records interface design: A review of recent literature and guideline formulation. Hum Factors 2015; 57 (05) 805-34.
• 52 Khajouei R, Jaspers MW. The impact of CPOE medication systems’ design aspects on usability, workflow and medication orders: a systematic review. Methods Inf Med 2010; 49 (01) 3-19.
• 53 Pereira de Araujo L, Mattos MM. A systematic literature review of evaluation methods for health collaborative systems. Proceedings of the IEEE 18th International Conference on Computer Supported Cooperative Work in Design; 2014 p. 366-9.
• 54 Wills J, Hurley K. Testing usability and measuring task-completion time in hospital-based health information systems: A systematic review. Proceedings of the 28th IEEE Canadian conference on electrical and computer engineering (CCECE); 2012 p. 1-4.
• 55 British Standards Institution (BSI).. The growing role of human factors and usability engineering for medical devices. White paper. http://www.bsigroup.com/LocalFiles/en-GB/Medical-devices/whitepapers/ [Last accessed 2015 Jul 24].
• 56 Magrabi F, Baker M, Sinha I, Ong MS, Harrison S, Kidd MR. et al. Clinical safety of England’s national programme for IT: A retrospective analysis of all reported safety events 2005 to 2011. Int J Med Inform 2015; 84 (03) 198-206.
• 57 Ash JS, Sittig DF, McMullen CK, Guappone K, Dykstra R, Carpenter J. A rapid assessment process for clinical informatics interventions. AMIA Annu Symp Proc 2008; Nov 6 26-30.
• 58 Ash JS, Sittig DF, Poon EG, Guappone K, Campbell E, Dykstra RH. The extent and importance of unintended consequences related to computerized provider order entry. J Am Med Inform Assoc 2007; Aug 31 14 (04) 415-23.
• 59 Karsh BT, Weinger MB, Abbott PA, Wears RL. Health information technology: Fallacies and sober realities. J Am Med Inform Assoc 2010; 17: 617-23.
• 60 Ash JS, Berg M, Coiera E, Ash JS, Berg M, Coiera E, Paper V, Ash JS, Berg M, Coiera E. et al. Some unintended consequences of information technology in health care: The nature of patient care information system-related errors. J Am Med Inform Assoc 2004; 11: 104-12.
• 61 Varpio L, Rashotte J, Day K, King J, Kuziemsky C, Parush A. The EHR and building the patient’s story: A qualitative investigation of how EHR use obstructs a vital clinical activity. Int J Med Inform Assoc 2015; 84 (12) 1019-28.
• 62 Xiao Y, Parker SH, Manser T. Teamwork and collaboration. Review Human Factors Ergonomics 2013; 8 (01) 55-102.
• 63 West MA, Lyubovnikova J. Illusions of team working in health care. J Health Organ Manag 2013; 27 (01) 134-42.
• 64 Kuziemsky C, Bush P. Coordination considerations of health information technology. Stud Health Tech Inform 2013; 194: 133-8.
• 65 Wong MC, Cummings E, Turner P. User-centered design in clinical handover: Exploring post-implementation outcomes for clinicians. Stud Health Tech Inform 2013; 192 1-2 253-7.
• 66 Kuziemsky CE. A model of tradeoffs for understanding health information technology implementation. Stud Health Technol Inform 2015; 215: 116-28.
• 67 Saleem JJ, Russ AL, Sanderson P, Johnson TR, Zhang J, Sittig DF. Current challenges and opportunities for better integration of human factors research with development of clinical information systems. Yearb Med Inform 2009; 48-58.
• 68 Holden RJ, Rivera-Rodriguez AJ, Faye H, Scanlon MC, Karsh BT. Automation and adaptation: Nurses’ problem-solving behavior following the implementation of bar-coded medication administration technology. Cog Tech Work 2013; 15 (03) 283-96.
• 69 Borycki EM, Kushniruk AW, Bellwood P, Brender J. Technology-induced errors. Methods Inf Med 2012; 51 (02) 95-103.
• 70 Leveson N. Engineering a safer world: Systems thinking applied to safety. MIT Press; 2011
• 71 Alemzadeh H, Chen D, Lewis A, Kalbarczyk Z, Raman J, Leveson N. et al. Systems-theoretic safety assessment of robotic telesurgical systems. Computer Safety, Reliability, and Security. LNCS 9337. Springer; 2015
• 72 Harrison MI, Koppel R, Bar-Lev S. Unintended consequences of information technologies in health care: An interactive sociotechnical analysis. J Am Med Inform Assoc 2007; 14 (05) 542-9.
• 73 Procter S, Hatcliff J. An architecturally-integrated, systems-based hazard analysis for medical applications. In: Formal Methods and Models for Codesign (MEMOCODE). 2014 Twelfth ACM/ IEEE International Conference on. IEEE; 2014. p. 124-33.
• 74 Redmill F, Chudleigh M, Catmur J. System safety: HAZOP and software HAZOP. Chichester: Wiley; 1999
• 75 Weber-Jahnke JH, Mason-Blakley F. On the safety of electronic medical records. In Foundations of Health Informatics Engineering and Systems. Berlin, Heidelberg: Springer; 2012. p. 177-94.
• 76 Bloomrosen M, Starren J, Lorenzi NM, Ash JS, Patel VL, Shortliffe EH. Anticipating and addressing the unintended consequences of health IT and policy: A report from the AMIA 2009 Health Policy Meeting. J Am Med Inform Assoc 2011; Jan 1 18 (01) 82-90.
• 77 Kushniruk A, Beuscart-Zéphir MC, Grzes A, Borycki E, Watbled L, Kannry J. Increasing the safety of healthcare information systems through improved procurement: toward a framework for selection of safe healthcare systems. Healthc Q 2009; Dec;13: 53-8.
• 78 Sittig DF, Singh H. A new sociotechnical model for studying health information technology in complex adaptive healthcare systems. Qual Saf Health Care 2010; Oct 1 19 (03) i68-74.
• 79 Ash JS, Sittig DF, Dykstra RH, Guappone K, Carpenter JD, Seshadri V. Categorizing the unintended sociotechnical consequences of computerized provider order entry. Int J Med Inform 2007; Jun 30 76: S21-7.
• 80 Neuhaus C, Röhrig R, Hofmann G, Klemm S, Neuhaus S, Hofer S. et al. Patient safety in anesthesiology : Multimodal strategies for perioperative care. Anaesthesist 2015; Dec;64 (12) 911-26.
• 81 Vincent C, Taylor-Adams S. Systems analysis of critical incidents: The London Protocol. 1999 http://www1.imperial.ac.uk/cpssq/cpssq_publications/resources_tools/the_london_protocol. Last Access: 1/11/2016.
• 82 Vincent C, Taylor-Adams S, Chapman EJ, Hewett D, Prior S, Strange P. et al. How to investigate and analyse clinical incidents: Clinical risk unit and association of litigation and risk management protocol. 2000; BMJ Mar 18 320 7237 777-81.
• 83 Borycki E, Keay E. Methods to assess the safety of health information systems. Healthc Q 2009; Dec;13: 47-52.
• 84 Zhang J, Patel VL, Johnson TR, Shortliffe EH. A cognitive taxonomy of medical errors. J Biomed Inform 2004; Jun 30 37 (03) 193-204.
• 85 Horsky J, Kuperman GJ, Patel VL. Comprehensive analysis of a medication dosing error related to CPOE. J Am Med Inform Assoc 2005; Jul 1 12 (04) 377-82.
• 86 Sittig DF, Singh H. A new sociotechnical model for studying health information technology in complex adaptive healthcare systems. Qual Saf Health Care 2010; Oct 1 19 (03) i68-74.
• 87 Canada’s Health Informatics Association. eSafety guidelines: eSafety for eHealth. COACH: Ottawa; 2013
• 88 Kushniruk AW, Bates DW, Bainbridge M, Househ MS, Borycki EM. National efforts to improve health information system safety in Canada, the United States of America and England. Int J Med Inform 2013; May 31 82 (05) e149-60.
• 89 Samaranayake NR, Cheung ST, Chui WC, Cheung BM. Technology-related medication errors in a tertiary hospital: A 5-year analysis of reported medication incidents. Int J Med Inform 2012; Dec 31 81 (12) 828-33.
• 90 Palojoki S, Mäkelä M, Lehtonen L, Saranto K. An analysis of electronic health record–related patient safety incidents. Health Inform J 2016 Mar 7.