Download PDF
Methods Inf Med 2010; 49(01): 03-19
DOI: 10.3414/ME0630
Original Articles
Schattauer GmbH

The Impact of CPOE Medication Systems’ Design Aspects on Usability, Workflow and Medication Orders

A Systematic Review
R. Khajouei
1   Department of Medical Informatics, Academic Medical Center – University of Amsterdam, Amsterdam, The Netherlands
2   Kerman University of Medical Sciences, Kerman, Iran
,
M. W. M. Jaspers
1   Department of Medical Informatics, Academic Medical Center – University of Amsterdam, Amsterdam, The Netherlands
› Author Affiliations
Further Information

Publication History

received: 17 September 2008

accepted: 03 March 2009

Publication Date:
17 January 2018 (online)

    Permissions and Reprints

Summary

Objectives: To examine the impact of design aspects of computerized physician order entry (CPOE) systems for medication ordering on usability, physicians’ workflow and on medication orders.

Methods: We systematically searched PubMed, EMBASE and Ovid MEDLINE for articles published from 1986 to 2007. We also evaluated reference lists of reviews and relevant articles captured by our search strategy, and the web-based inventory of evaluation studies in medical informatics 1982–2005. Data about design aspects were extracted from the relevant articles. Identified design aspects were categorized in groups derived from principles for computer screen and dialogue design and user guidance from the International Standard Organization, and if CPOE-specific, from the collected data.

Results: A total of 19 papers met our inclusion criteria. Sixteen studies used qualitative evaluation methods and the rest both qualitative and quantitative. In total 42 CPOE design aspects were identified and categorized in seven groups: 1) documentation and data entry components, 2) alerting, 3) visual clues and icons, 4) drop-down lists and menus, 5) safeguards, 6) screen displays, and 7) auxiliary functions.

Conclusions: Beside the range of functionalities provided by a CPOE system, their subtle design is important to increase physicians’ adoption and to reduce medication errors. This requires continuous evaluations to investigate whether interfaces of CPOE systems follow normal flow of actions in the ordering process and if they are cognitively easy to understand and use for physicians. This paper provides general recommendations for CPOE (re)design based on the characteristics of CPOE design aspects found.

Keywords

CPOE - medication systems - medication errors - assessment-evaluation - design aspects - user-computer interface - usability evaluation - human factors
 

  • References

  • 1 Kilbridge P, Welebob E, Classen D. Overview of the Leapfrog Group Evaluation Tool for Computerized Physician Order Entry (homepage on the Internet) 2008 (cited Jan 2, 2008). Available from: www.leapfroggroup.org/media/file/Leapfrog-CPOE_Evaluation2.pdf.
    PubMedGoogle Scholar
  • 2 Bates DW, Kuperman G, Teich JM. Computerized physician order entry and quality of care. Qual Manag Health Care 1994; 2 (04) 18-27.
    PubMedGoogle Scholar
  • 3 Bates DW, Gawande AA. Improving safety with information technology. N Engl J Med 2003; 348 (25) 2526-2534.
    CrossrefPubMedGoogle Scholar
  • 4 Kirk RC, Li-Meng GD, Packia J, Min KH, Ong BK. Computer calculated dose in paediatric prescribing. Drug Saf 2005; 28 (09) 817-824.
    CrossrefPubMedGoogle Scholar
  • 5 Pestotnik SL, Classen DC, Evans RS, Burke JP. Implementing antibiotic practice guidelines through computer-assisted decision support: clinical and financial outcomes. Ann Intern Med 1996; 124 (10) 884-890.
    CrossrefPubMedGoogle Scholar
  • 6 Tamblyn R, Huang A, Perreault R, Jacques A, Roy D, Hanley J. et al. The medical office of the 21st century (MOXXI): effectiveness of computerized decision-making support in reducing inappropriate prescribing in primary care. CMAJ 2003; 169 (06) 549-556.
    PubMedGoogle Scholar
  • 7 Evans RS, Pestotnik SL, Classen DC, Clemmer TP, Weaver LK, Orme Jr JF. et al. A computer-assisted management program for antibiotics and other antiinfective agents. N Engl J Med 1998; 338 (04) 232-238.
    CrossrefPubMedGoogle Scholar
  • 8 Kuperman GJ, Teich JM, Gandhi TK, Bates DW. Patient safety and computerized medication ordering at Brigham and Women’s Hospital. Jt Comm J Qual Improv 2001; 27 (10) 509-521.
    PubMedGoogle Scholar
  • 9 Tierney WM, Miller ME, Overhage JM, McDonald CJ. Physician inpatient order writing on microcomputer workstations. Effects on resource utilization. JAMA 1993; 269 (03) 379-383.
    CrossrefPubMedGoogle Scholar
  • 10 Foster RA, Antonelli PJ. Computerized physician-order entry: are we there yet?. Otolaryngol Clin North Am 2002; 35 (06) 1237-1243 vii.
    CrossrefPubMedGoogle Scholar
  • 11 Sittig DF, Stead WW. Computer-based physician order entry: the state of the art. J Am Med Inform Assoc 1994; 1 (02) 108-123.
    CrossrefPubMedGoogle Scholar
  • 12 Horsky J, Kaufman DR, Patel VL. Computer-based drug ordering: evaluation of interaction with a decision-support system. Medinfo 2004; 11 Pt 2 1063-1067.
    PubMedGoogle Scholar
  • 13 Zhan C, Hicks RW, Blanchette CM, Keyes MA, Cousins DD. Potential benefits and problems with computerized prescriber order entry: analysis of a voluntary medication error-reporting database. Am J Health Syst Pharm 2006; 63 (04) 353-358.
    CrossrefPubMedGoogle Scholar
  • 14 Cheng CH, Goldstein MK, Geller E, Levitt RE. The effects of CPOE on ICU workflow: an observational study. AMIA Annu Symp Proc 2003 pp 150-154.
    PubMedGoogle Scholar
  • 15 Horsky J, Kaufman DR, Oppenheim MI, Patel VL. A framework for analyzing the cognitive complexity of computer-assisted clinical ordering. J Biomed Inform 2003; 36 1–2 4-22.
    CrossrefPubMedGoogle Scholar
  • 16 Ash JS, Sittig DF, Dykstra RH, Guappone K, Carpenter JD, Seshadri V. Categorizing the unintended sociotechnical consequences of computerized provider order entry. Int J Med Inform 2007; 76 (01) S21-S27.
    CrossrefPubMedGoogle Scholar
  • 17 Koppel R, Metlay JP, Cohen A, Abaluck B, Localio AR, Kimmel SE. et al. Role of computerized physician order entry systems in facilitating medication errors. JAMA 2005; 293 (10) 1197-1203.
    CrossrefPubMedGoogle Scholar
  • 18 Peute LW, Jaspers MW. The significance of a usability evaluation of an emerging laboratory order entry system. Int J Med Inform 2007; 76 2–3 157-168.
    CrossrefPubMedGoogle Scholar
  • 19 International Organization for Standardization.. ISO 9126, Information technology – Software product evaluation – Quality characteristics and guidelines for their use. Geneva: ISO; 2009
    Google Scholar
  • 20 International Organization for Standardization.. ISO 9241, Ergonomic requirement fo office work with visual display terminals (VDTs) _ Part 11: Guidance on usability. Geneve: ISO; 1998
    Google Scholar
  • 21 Aarts J, Ash J, Berg M. Extending the understanding of computerized physician order entry: implications for professional collaboration, workflow and quality of care. Int J Med Inform 2007; 76 (01) S4-13.
    CrossrefPubMedGoogle Scholar
  • 22 Eslami S, Abu-Hanna A, de Keizer NF. Evaluation of outpatient computerized physician medication order entry systems: a systematic review. J Am Med Inform Assoc 2007; 14 (04) 400-406.
    CrossrefPubMedGoogle Scholar
  • 23 Kaushal R, Shojania KG, Bates DW. Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch Intern Med 2003; 163 (12) 1409-1416.
    CrossrefPubMedGoogle Scholar
  • 24 Kuperman GJ, Gibson RF. Computer physician order entry: benefits, costs, and issues. Ann Intern Med 2003; 139 (01) 31-39.
    CrossrefPubMedGoogle Scholar
  • 25 Lehmann CU, Kim GR. Computerized provider order entry and patient safety. Pediatr Clin North Am 2006; 53 (06) 1169-1184.
    CrossrefPubMedGoogle Scholar
  • 26 Oren E, Shaffer ER, Guglielmo BJ. Impact of emerging technologies on medication errors and adverse drug events. Am J Health Syst Pharm 2003; 60 (14) 1447-1458.
    PubMedGoogle Scholar
  • 27 Wolfstadt JI, Gurwitz JH, Field TS, Lee M, Kalkar S, Wu W. et al. The effect of computerized physician order entry with clinical decision support on the rates of adverse drug events: a systematic review. J Gen Intern Med 2008; 23 (04) 451-458.
    CrossrefPubMedGoogle Scholar
  • 28 de Keizer NF, Ammenwerth E. A web-based inventory of evaluation studies in medical informatics 1982-2005 (database on the Internet) 2006 (cited Jan 2, 2008). Available from: http://evaldb.umit.at index.htm.
    PubMedGoogle Scholar
  • 29 International Organization for Standardization.. ISO 9241, Ergonomic requirement fo office work with visual display terminals (VDTs) – Part 14: Menu dialogues. 1st ed. Geneve: ISO; 1997
    Google Scholar
  • 30 International Organization for Standardization.. ISO 9241, Ergonomic requirement fo office work with visual display terminals (VDTs) – Part 17: Form filing dialogues. 1st ed. Geneve: ISO; 1997
    Google Scholar
  • 31 International Organization for Standardization.. ISO 9241, Ergonomic requirement fo office work with visual display terminals (VDTs) – Part 13: User guidance. 1st ed. Geneve: ISO; 1998
    Google Scholar
  • 32 International Organization for Standardization.. ISO 9241, Ergonomic requirement fo office work with visual display terminals (VDTs) – Part 12: Presentation of information. 1st ed. Geneve: ISO; 1998
    Google Scholar
  • 33 Ahearn MD, Kerr SJ. General practitioners’ perceptions of the pharmaceutical decision-support tools in their prescribing software. Med J Aust 2003; 179 (01) 34-37.
    PubMedGoogle Scholar
  • 34 Ash JS, Gorman PN, Lavelle M, Payne TH, Massaro TA, Frantz GL. et al. A cross-site qualitative study of physician order entry. J Am Med Inform Assoc 2003; 10 (02) 188-200.
    CrossrefPubMedGoogle Scholar
  • 35 Banet GA, Jeffe DB, Williams JA, Asaro PV. Effects of implementing computerized practitioner order entry and nursing documentation on nursing workflow in an emergency department. J Healthc Inf Manag 2006; 20 (02) 45-54.
    PubMedGoogle Scholar
  • 36 Bates DW, Teich JM, Lee J, Seger D, Kuperman GJ, Ma’Luf N. et al. The impact of computerized physician order entry on medication error prevention. J Am Med Inform Assoc 1999; 6 (04) 313-321.
    CrossrefPubMedGoogle Scholar
  • 37 Beuscart-Zephir MC, Pelayo S, Anceaux F, Meaux JJ, Degroisse M, Degoulet P. Impact of CPOE on doctor-nurse cooperation for the medication ordering and administration process. Int J Med Inform 2005; 74 7–8 629-641.
    CrossrefPubMedGoogle Scholar
  • 38 Bradley VM, Steltenkamp CL, Hite KB. Evaluation of reported medication errors before and after implementation of computerized practitioner order entry. J Healthc Inf Manag 2006; 20 (04) 46-53.
    PubMedGoogle Scholar
  • 39 Caudill-Slosberg M, Weeks WB. Case study: identifying potential problems at the human/technical interface in complex clinical systems. Am J Med Qual 2005; 20 (06) 353-357.
    CrossrefPubMedGoogle Scholar
  • 40 Feldstein A, Simon SR, Schneider J, Krall M, Laferriere D, Smith DH. et al. How to design computerized alerts to safe prescribing practices. Jt Comm J Qual Saf 2004; 30 (11) 602-613.
    PubMedGoogle Scholar
  • 41 Glassman PA, Simon B, Belperio P, Lanto A. Improving recognition of drug interactions: benefits and barriers to using automated drug alerts. Med Care 2002; 40 (12) 1161-1171.
    CrossrefPubMedGoogle Scholar
  • 42 Horsky J, Kuperman GJ, Patel VL. Comprehensive analysis of a medication dosing error related to CPOE. J Am Med Inform Assoc 2005; 12 (04) 377-382.
    CrossrefPubMedGoogle Scholar
  • 43 Horsky J, Kaufman DR, Patel VL. When you come to a fork in the road, take it: strategy selection in order entry. AMIA Annu Symp Proc 2005 pp 350-354.
    PubMedGoogle Scholar
  • 44 Mullett CJ, Evans RS, Christenson JC, Dean JM. Development and impact of a computerized pediatric antiinfective decision support program. Pediatrics 2001; 108 (04) E75.
    CrossrefPubMedGoogle Scholar
  • 45 Teich JM, Merchia PR, Schmiz JL, Kuperman GJ, Spurr CD, Bates DW. Effects of computerized physician order entry on prescribing practices. Arch Intern Med 2000; 160 (18) 2741-2747.
    CrossrefPubMedGoogle Scholar
  • 46 Ammenwerth E, Talmon J, Ash JS, Bates DW, Beuscart-Zephir MC, Duhamel A. et al. Impact of CPOE on mortality rates – contradictory findings, important messages. Methods Inf Med 2006; 45 (06) 586-593.
    Article in Thieme ConnectPubMedGoogle Scholar
  • 47 Ash JS, Stavri PZ, Dykstra R, Fournier L. Implementing computerized physician order entry: the importance of special people. Int J Med Inform 2003; 69 2–3 235-250.
    CrossrefPubMedGoogle Scholar
  • 48 Ash JS, Sittig DF, Poon EG, Guappone K, Campbell E, Dykstra RH. The extent and importance of unintended consequences related to computerized provider order entry. J Am Med Inform Assoc 2007; 14 (04) 415-423.
    CrossrefPubMedGoogle Scholar
  • 49 Campbell EM, Sittig DF, Ash JS, Guappone KP, Dykstra RH. Types of unintended consequences related to computerized provider order entry. J Am Med Inform Assoc 2006; 13 (05) 547-556.
    CrossrefPubMedGoogle Scholar
  • 50 Georgiou A, Lang S, Alvaro F, Whittaker G, Westbrook JI, Callen J. Pathology‘s front line – a comparison of the experiences of electronic ordering in the clinical chemistry and haematology departments. Stud Health Technol Inform 2007; 130: 121-132.
    PubMedGoogle Scholar
  • 51 Saathoff A. Human factors considerations relevant to CPOE implementations. J Healthc Inf Manag 2005; 19 (03) 71-78.
    PubMedGoogle Scholar
  • 52 Snyder R, Weston MJ, Fields W, Rizos A, Tedeschi C. Computerized provider order entry system field research: the impact of contextual factors on study implementation. Int J Med Inform 2006; 75 10–11 730-740.
    CrossrefPubMedGoogle Scholar
  • 53 Wentzer HS, Bottger U, Boye N. Unintended transformations of clinical relations with a computerized physician order entry system. Int J Med Inform 2007; 76 (03) S456-S461.
    CrossrefPubMedGoogle Scholar
  • 54 Aarts J, Berg M. Same systems, different outcomes – comparing the implementation of computerized physician order entry in two Dutch hospitals. Methods Inf Med 2006; 45 (01) 53-61.
    Article in Thieme ConnectPubMedGoogle Scholar