The Changing Nature of Clinical Decision Support Systems: a Focus on Consumers, Genomics, Public Health and Decision Safety

Summary

Objectives To review the recent research literature in clinical decision support systems (CDSS).

Methods A review of recent literature was undertaken, focussing on CDSS evaluation, consumers and public health, the impact of translational bioinformatics on CDSS design, and CDSS safety.

Results In recent years, researchers have concentrated much less on the development of decision technologies, and have focussed more on the impact of CDSS in the clinical world. Recent work highlights that traditional process measures of CDSS effectiveness, such as document relevance are poor proxy measures for decision outcomes. Measuring the dynamics of decision making, for example via decision velocity, may produce a more accurate picture of effectiveness. Another trend is the broadening of user base for CDSS beyond front line clinicians. Consumers are now a major focus for biomedical informatics, as are public health officials, tasked with detecting and managing disease outbreaks at a health system, rather than individual patient level. Bioinformatics is also changing the nature of CDSS. Apart from personalisation of therapy recommendations, translational bioinformatics is creating new challenges in the interpretation of the meaning of genetic data. Finally, there is much recent interest in the safety and effectiveness of computerised physicianorderentry (CPOE) systems, given that prescribing and administration errors are a significant cause of morbidity and mortality. Of note, there is still much controversy surrounding the contention that poorly designed, implemented or used CDSS may actually lead to harm.

Conclusions CDSS research remains an active and evolving area of research, as CDSS penetrate more widely beyond their traditional domain into consumer decision support, and as decisions become more complex, for example by involving sequence level genetic data.

Keywords

Decision support systems - consumer informatics - translational bioinformatics - biosurveillance - safety

• References

• 1 Coiera E, Hovenga EJ. Building a sustainable health system. Yearb Med Inform 2007; 11-8.
• 2 Coiera E, Westbrook J, Wyatt J. The safety and quality of decision support systems. Yearb Med Inform 2006; 20-5.
• 3 Coiera E. Guide to Health Informatics. Hodder; 2003
• 4 Mizzaro S. Relevance: The whole history. Journal of the American Society for Information Science 1997; 48 (09) 810-32.
• 5 Lu Z, Kim W, Wilbur WJ. Evaluating Relevance Ranking Strategies for MEDLINE Retrieval. J Am Med Inform Assoc 2009; Jan-Feb; 16 (01) 32-6.
• 6 Coiera EW, Vickland V. Is Relevance Relevant? User Relevance Ratings May Not Predict the Impact of Internet Search on Decision Outcomes. J Am Med Inform Assoc 2008; July 1, 2008; 15 (04) 542-5.
• 7 Ely JW, Osheroff JA, Ebell MH, Bergus GR, Levy BT, Chambliss ML. et al. Analysis of questions asked by family doctors regarding patient care. BMJ 1999; August 7, 1999; 319 (7206): 358-61.
• 8 Ely JW, Osheroff JA, Ebell MH, Chambliss ML, Vinson DC, Stevermer JJ. et al. Obstacles to answering doctors’ questions about patient care with evidence: qualitative study. BMJ 2002; March 23, 2002; 324 (7339): 710.
• 9 Coiera E, Westbrook JI, Rogers K. Clinical decision velocity is increased when meta-search filters enhance an evidence retrieval system. J Am Med Inform Assoc 2008; June 25, 2008: M2765.
• 10 O’Connor AM, Stacey D, Rovner D, Holmes-Rovner M, Tetroe J, Llewellyn-Thomas H. et al. Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev 2001; (03) CD001431.
• 11 Lau AYS, Coiera EW. Impact of Web Searching and Social Feedback on Consumer Decision Making: A Prospective Online Experiment. J Med Internet Res 2008; 10 (01) e2.
• 12 Arkes HR. The Psychology of Patient Decision Making. 2008 [12 Nov 2008]; Available from: http://symptomresearch.nih.gov/chapter_4/index.htm
• 13 O’Connor A. Using patient decision aids to promote evidence-based decision making. ACP J Club 2001; Jul-Aug; 135 (01) A11-2.
• 14 O’Connor AM, Fiset V, DeGrasse C, Graham ID, Evans W, Stacey D. et al. Decision aids for patients considering options affecting cancer outcomes: evidence of efficacy and policy implications. J Natl Cancer Inst Monogr 1999; (25) 67-80.
• 15 Jimison HB, Sher PP. Decision Support for Patients. In: Berner ES. editor. Clinical Decision Support Systems Theory and Practice. New York: Springer-Verlag; 1999: 139-66.
• 16 Comprehensive Health Enhancement Support System (CHESS). 2008 [cited 2008 Nov 12]; Available from: https://chess.wisc.edu/chess/home/home.aspx
• 17 Database of Individual Patient Experiences (DIPEx). 2008 [cited 2008 Nov 12]; Available from: http://www.dipex.org/
• 18 Foundation for Informed Medical Decision Making. 2008 [cited 2008 Nov 12]; Available from: http://www.informedmedicaldecisions.org/
• 19 Mayo Clinic. 2008 [cited 2008 Nov 12]; Available from: http://mayoclinic.com/
• 20 NexCura. 2008 [cited 2008 Nov 12]; Available from: http://www.nexcura.com/
• 21 Schwitzer G. A Review of Features in Internet Consumer Health Decision-support Tools. J Med Internet Res 2002; 04 (02) e11.
• 22 Christensen H, Griffiths KM, Jorm AF. Delivering interventions for depression by using the internet: randomised controlled trial. BMJ 2004 January 31, 2004; 328 (7434): 265.
• 23 Fung V, Ortiz E, Huang J, Fireman B, Miller R, Selby JV. et al. Early experiences with e-health services (1999-2002): promise, reality, and implications. Med Care 2006; May; 44 (05) 491-6.
• 24 Ralston JD, Carrell D, Reid R, Anderson M, Moran M, Hereford J. Patient web services integrated with a shared medical record: patient use and satisfaction. J Am Med Inform Assoc 2007; Nov-Dec; 14 (06) 798-806.
• 25 Frost HJ, Massagli PM. Social Uses of Personal Health Information Within PatientsLikeMe, an Online Patient Community: What Can Happen When Patients Have Access to One Another’s Data. J Med Internet Res 2008; 10 (03) e15.
• 26 Weingart SN, Rind D, Tofias Z, Sands DZ. Who Uses the Patient Internet Portal? The PatientSite Experience. J Am Med Inform Assoc 2006; January 1, 2006; 13 (01) 91-5.
• 27 Tang PC, Black W, Buchanan J, Young CY, Hooper D, Lane SR. et al. PAMFOnline: integrating EHealth with an electronic medical record system. AMIA Annu Symp Proc 2003; 644-8.
• 28 The International Medical Informatics Association (IMIA) Web 2.0 Taskforce Portal. 2008 [cited 2008 Nov 12]; Available from: http://www.differanceengine.net/imia20/
• 29 The International Society for Research on Internet Interventions. 2008 [cited 2008 Nov 12]; Available from: http://www.isrii.org/
• 30 Murray PJ, Cabrer M, Hansen M, Paton C, Elkin PL, Erdley WS. Towards addressing the opportunities and challenges of Web 2.0 for health and informatics. Yearb Med Inform 2008; 44-51.
• 31 Ottawa Health Research Institute. 2008 [cited 2008 Nov 12]; Available from: http://decisionaid.ohri.ca/
• 32 International Patient Decision Aid Standards (IPDAS) Collaboration. 2008 [cited 2008 Nov 12]; Available from: http://ipdas.ohri.ca/
• 33 Elwyn G, O’Connor A, Stacey D, Volk R, Edwards A, Coulter A. et al. Developing a quality criteria framework for patient decision aids: online international Delphi consensus process. BMJ 2006; Aug 26; 333 (7565): 417.
• 34 Cochrane Decision Aid Registry. 2008 [cited 2008 Nov 12]; Available from: http://decisionaid.ohri.ca/cochinvent.php
• 35 O’Connor AM, Rostom A, Fiset V, Tetroe J, Entwistle V, Llewellyn-Thomas H. et al. Decision aids for patients facing health treatment or screening decisions: systematic review. BMJ 1999; Sep 18; 319 (7212): 731-4.
• 36 Frosch DL, Bhatnagar V, Tally S, Hamori CJ, Kaplan RM. Internet Patient Decision Support: A Randomized Controlled Trial Comparing Alternative Approaches for Men Considering Prostate Cancer Screening. Arch Intern Med 2008; February 25, 2008; 168 (04) 363-9.
• 37 O’Connor AM. Validation of a decisional conflict scale. Med Decis Making 1995; Jan-Mar; 15 (01) 25-30.
• 38 Janis IL, Mann L. Decision making. New York: The Free Press; 1977
• 39 O’Connor AM, Drake ER, Wells GA, Tugwell P, Laupacis A, Elmslie T. A survey of the decisionmaking needs of Canadians faced with complex health decisions. Health Expect 2003; Jun; 06 (02) 97-109.
• 40 Lau AYS, Coiera EW. Do People Experience Cognitive Biases while Searching for Information?. J Am Med Inform Assoc 2007; September 1, 2007; 14 (05) 599-608.
• 41 Lau AYS, Coiera EW. Can Cognitive Biases during Consumer Health Information Searches Be Reduced to Improve Decision Making?. J Am Med Inform Assoc 2009; January 1, 2009; 16 (01) 54-65.
• 42 Coiera E. The Internet’s challenge to health care provision. BMJ 1996; January 6, 1996; 312 (7022): 3-4.
• 43 Butte AJ. Translational Bioinformatics: Coming of Age. J Am Med Inform Assoc 2008; Nov-Dec; 15 (06) 709-14.
• 44 Emery J, Hayflick S. The challenge of integrating genetic medicine into primary care. BMJ 2001; 322 (7293): 1027-30.
• 45 Benson DA, Karsch-Mizrachi I, Lipman DJ, Ostell J, Wheeler DL. GenBank. Nucleic Acids Res 2007; Jan;35(Database issue): D21-D5.
• 46 Wheeler DL, Barrett T, Benson DA, Bryant SH, Canese K, Chetvernin V. et al. Database resources of the National Center for Biotechnology Information. Nucleic Acids Res 2008; Jan;36(Database issue): D13-D21.
• 47 Baars MJH, Henneman L, Leo P. Deficiency of knowledge of genetics and genetic tests among general practitioners, gynecologists, and pediatricians: A global problem. Genetics in Medicine 2005; 07 (09) 605.
• 48 Burke W, Emery J. Genetics education for primarycare providers. Nat Rev Genet 2002; 03 (07) 561-6.
• 49 Metcalfe S, Hurworth R, Newstead J, Robins R. Needs assessment study of genetics education for general practitioners in Australia. Genetics in Medicine 2002; 04 (02) 71.
• 50 Scheuner MT, Sieverding P, Shekelle PG. Delivery of genomic medicine for common chronic adult diseases: a systematic review. JAMA 2008; Mar 19; 299 (11) 1320-34.
• 51 Alizadeh AA, Eisen MB, Davis RE, Ma C, Lossos IS, Rosenwald A. et al. Distinct types of diffuse large B-cell lymphoma identified by gene expression profiling. Nature 2000; 403 (6769): 503-11.
• 52 Straus SE. Individualizing treatment decisions. The likelihood of being helped or harmed. Eval Health Prof 2002; Jun; 25 (02) 210-24.
• 53 Taube J, Halsall D, Baglin T. Influence of cytochrome P-450 CYP2C9 polymorphisms on warfarin sensitivity and risk of over-anticoagulation in patients on long-term treatment. Blood 2000; 96 (05) 1816.
• 54 Hylek EM, Heiman H, Skates SJ, Sheehan MA, Singer DE. Acetaminophen and other risk factors for excessive warfarin anticoagulation. JAMA 1998; Mar; 279 (09) 657-62.
• 55 Kearon C, Ginsberg JS, Kovacs MJ, Anderson DR, Wells P, Julian JA. et al. Comparison of low-intensity warfarin therapy with conventional-intensity warfarin therapy for long-term prevention of recurrent venous thromboembolism. N Engl J Med 2003; Aug; 349 (07) 631-9.
• 56 Reynolds KK, Valdes Jr R, Hartung BR, Linder MW. Individualizing warfarin therapy. Personalized Medicine 2007; 04 (01) 11-31.
• 57 Schwarz UI, Ritchie MD, Bradford Y, Li C, Dudek SM, Frye-Anderson A. et al. Genetic determinants of response to warfarin during initial anticoagulation. N Engl J Med 2008; Mar 6; 358 (10) 999-1008.
• 58 Anderson JL, Horne BD, Stevens SM, Grove AS, Barton S, Nicholas ZP. et al. Randomized trial of genotype-guided versus standard warfarin dosing in patients initiating oral anticoagulation. Circulation 2007; Nov 27; 116 (22) 2563-70.
• 59 FDA Approves Updated Warfarin (Coumadin) Prescribing Information. Available from: http://www.fda.gov/bbs/topics/news/2007/new01684.html
• 60 McWilliam A, Lutter RW, Nardinelli C. for Regulatory Studies AEIBJC. Health Care Savings from Personalizing Medicine Using Genetic Testing: The Case of Warfarin: AEI-Brookings Joint Center for Regulatory Studies. 2006
• 61 Weinstein RA. Nosocomial infection update. Emerg Infect Dis 1998; 04 (03) 416-20.
• 62 Wenzel RP, Pfaller MA. Feasible and desirable future targets for reducing the costs of hospital infections. J Hosp Infect 1991; Jun;18 Suppl A: 94-8.
• 63 Ibrahim EH, Sherman G, Ward S, Fraser VJ, Kollef MH. The influence of inadequate antimicrobial treatment of bloodstream infections on patient outcomes in the ICU setting. Chest 2000; Jul; 118 (01) 146-55.
• 64 Playford EG, Craig JC, Iredell JR. Carbapenemresistant Acinetobacter baumannii in intensive care unit patients: risk factors for acquisition, infection and their consequences. J Hosp Infect 2007; Mar; 65 (03) 204-11.
• 65 Evans RS, Pestotnik SL, Classen DC, Clemmer TP, Weaver LK, Orme JF. et al. A computer-assisted management program for antibiotics and other antiinfective agents. N Engl J Med 1998; Jan; 338 (04) 232-8.
• 66 Paul M, Andreassen S, Tacconelli E, Nielsen AD, Almanasreh N, Frank U. et al. Improving empirical antibiotic treatment using TREAT, a computerized decision support system: cluster randomized trial. J Antimicrob Chemother 2006; Dec; 58 (06) 1238-45.
• 67 Thursky KA, Buising KL, Bak N, MacGregor L, Street AC, MacIntyre CR. et al. Reduction of broadspectrum antibiotic use with computerized decision support in an intensive care unit. Int J Qual Health Care 2006; Jun; 18 (03) 224-31.
• 68 Yu VL, Fagan LM, Wraith SM, Clancey WJ, Scott AC, Hannigan J. et al. Antimicrobial selection by a computer. A blinded evaluation by infectious diseases experts. JAMA 1979; Sep; 242 (12) 1279-82.
• 69 Thursky K. Use of computerized decision support systems to improve antibiotic prescribing. Expert Rev Anti Infect Ther 2006; Jun; 04 (03) 491-507.
• 70 Partridge SR, Tsafnat G, Coiera E, Iredell JR. Gene cassettes and cassette arrays in mobile resistance integrons. FEMS Microbiol Rev. 2009 under review, accepted in principle.
• 71 Young J, Stevenson KB. Real-time surveillance and decision support: Optimizing infection control and antimicrobial choices at the point of care. Am J Infect Control 2008; 36: S67-74.
• 72 Moore KM, Edgar BL, McGuinness D. Implementation of an automated, real-time public health surveillance system linking emergency departments and health units: rationale and methodology. CJEM 2008; Mar; 10 (02) 114-9.
• 73 Williams CJ, Schenkel K, Eckmanns T, Altmann D, Krause G. FIFA World Cup 2006 in Germany: enhanced surveillance improved timeliness and detection. Epidemiol Infect 2008; Jul 31: 1-9.
• 74 Wu TS, Shih FY, Yen MY, Wu JS, Lu SW, Chang KC. et al. Establishing a nationwide emergency department-based syndromic surveillance system for better public health responses in Taiwan. BMC Public Health 2008; 08: 18.
• 75 Zheng W, Aitken R, Muscatello DJ, Churches T. Potential for early warning of viral influenza activity in the community by monitoring clinical diagnoses of influenza in hospital emergency departments. BMC Public Health 2007; 07: 250.
• 76 Davis XM, MacDonald S, Borwein S, Freedman DO, Kozarsky PE, von Sonnenburg F. et al. Health risks in travelers to China: the GeoSentinel experience and implications for the 2008 Beijing Olympics. Am J Trop Med Hyg 2008; Jul; 79 (01) 4-8.
• 77 Gundlapalli AV, Olson J, Smith SP, Baza M, Hausam RR, Eutropius LJ. et al. Hospital electronic medical record-based public health surveillance system deployed during the 2002 Winter Olympic Games. Am J Infect Control 2007; Apr; 35 (03) 163-71.
• 78 Meynard JB, Chaudet H, Texier G, Ardillon V, Ravachol F, Deparis X. et al. Value of syndromic surveillance within the Armed Forces for early warning during a dengue fever outbreak in French Guiana in 2006. BMC Med Inform Decis Mak 2008; 08: 29.
• 79 Buckeridge DL, Okhmatovskaia A, Tu S, O’Connor M, Nyulas C, Musen MA. Understanding detection performance in public health surveillance: modeling aberrancy-detection algorithms. J Am Med Inform Assoc 2008; Nov-Dec; 15 (06) 760-9.
• 80 Mellmann A, Friedrich AW, Rosenkotter N, Rothganger J, Karch H, Reintjes R. et al. Automated DNA sequence-based early warning system for the detection of methicillin-resistant Staphylococcus aureus outbreaks. PLoS Med 2006; Mar; 03 (03) e33.
• 81 Shen Y, Adamou C, Dowling JN, Cooper GF. Estimating the joint disease outbreak-detection time when an automated biosurveillance system is augmenting traditional clinical case finding. J Biomed Inform 2008; Apr; 41 (02) 224-31.
• 82 Brownstein JS, Freifeld CC, Reis BY, Mandl KD. Surveillance Sans Frontieres: Internet-based emerging infectious disease intelligence and the HealthMap project. PLoS Med 2008; Jul 8; 05 (07) e151.
• 83 Freifeld CC, Mandl KD, Reis BY, Brownstein JS. HealthMap: global infectious disease monitoring through automated classification and visualization of Internet media reports. J Am Med Inform Assoc 2008; Mar-Apr; 15 (02) 150-7.
• 84 Scotch M, Yip KY, Cheung KH. Development of grid-like applications for public health using Web 2.0 mashup techniques. J Am Med Inform Assoc 2008; Nov-Dec; 15 (06) 783-6.
• 85 Cooper DL, Smith GE, Regan M, Large S, Groenewegen PP. Tracking the spatial diffusion of influenza and norovirus using telehealth data: a spatiotemporal analysis of syndromic data. BMC Med 2008; 06: 16.
• 86 Kukafka R, Ancker JS, Chan C, Chelico J, Khan S, Mortoti S. et al. Redesigning electronic health record systems to support public health. J Biomed Inform 2007; Aug; 40 (04) 398-409.
• 87 Rosen-Zvi M, Altmann A, Prosperi M, Aharoni E, Neuvirth H, Sonnerborg A. et al. Selecting anti-HIV therapies based on a variety of genomic and clinical factors. Bioinformatics 2008; Jul 1; 24 (13) i399-406.
• 88 Tang J, Tao J, Urakawa H, Corander J. T-BAPS: a Bayesian statistical tool for comparison of microbial communities using terminal-restriction fragment length polymorphism (T-RFLP) data. Stat Appl Genet Mol Biol 2007; 6 Article30.
• 89 Sintchenko V, Gallego B, Chung G, Coiera E. Towards bioinformatics assisted infectious disease control. BMC Bioinformatics. 2008 Dec;10(S10).
• 90 Liu TF, Shafer RW. Web resources for HIV type 1 genotypic-resistance test interpretation. Clin Infect Dis 2006; Jun 1; 42 (11) 1608-18.
• 91 Moore M, Chan E, Lurie N, Schaefer AG, Varda DM, Zambrano JA. Strategies to improve global influenza surveillance: a decision tool for policymakers. BMC Public Health 2008; 08: 186.
• 92 Reis BY, Kirby C, Hadden LE, Olson K, McMurry AJ, Daniel JB. et al. AEGIS: a robust and scalable real-time public health surveillance system. J Am Med Inform Assoc 2007; Sep-Oct; 14 (05) 581-8.
• 93 Gallego B, Sintchenko V, Wang Q, Hiley L, Gilbert GL, Coiera E. Biosurveillance of emerging biothreats using scalable genotype clustering. Journal of Biomedical Informatics 2009; 42 (01) 66-73.
• 94 Eslami S, de Keizer NF, Abu-Hanna A. The impact of computerized physician medication order entry in hospitalized patients—a systematic review. Int J Med Inform 2008; Jun; 77 (06) 365-76.
• 95 Ash JS, Berg M, Coiera E. Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information Systemrelated Errors. J Am Med Inform Assoc 2004; March 1, 2004; 11 (02) 104-12.
• 96 Ammenwerth E, Schnell-Inderst P, Machan C, Siebert U. The Effect of Electronic Prescribing on Medication Errors and Adverse Drug Events: A Systematic Review. J Am Med Inform Assoc 2008; September-October; 15 (05) 585-600.
• 97 The Joint Commission. 2008 [cited 2008 Dec 15]; Available from: www.jointcommission.org/SentinelEvents/SentinelEventAlert/sea_42.htm
• 98 Wang CJ, Marken RS, Meili RC, Straus JB, Landman AB, Bell DS. Functional Characteristics of Commercial Ambulatory Electronic Prescribing Systems: A Field Study. J Am Med Inform Assoc 2005; May 1, 2005; 12 (03) 346-56.
• 99 Gaikwad R, Sketris I, Shepherd M, Duffy J. Evaluation of accuracy of drug interaction alerts triggered by two electronic medical record systems in primary healthcare. Health Informatics J 2007; Sep; 13 (03) 163-77.
• 100 Mille F, Schwartz C, Brion F, Fontan JE, Bourdon O, Degoulet P. et al. Analysis of overridden alerts in a drug-drug interaction detection system. Int J Qual Health Care 2008; Dec; 20 (06) 400-5.
• 101 Weingart SN, Toth M, Sands DZ, Aronson MD, Davis RB, Phillips RS. Physicians’ decisions to override computerized drug alerts in primary care. Arch Intern Med 2003; Nov 24; 163 (21) 2625-31.
• 102 Ko Y, Abarca J, Malone DC, Dare DC, Geraets D, Houranieh A. et al. Practitioners’ views on computerized drug-drug interaction alerts in the VA system. J Am Med Inform Assoc 2007; Jan-Feb; 14 (01) 56-64.
• 103 Spina JR, Glassman PA, Belperio P, Cader R, Asch S. Clinical relevance of automated drug alerts from the perspective of medical providers. Am J Med Qual 2005; Jan-Feb; 20 (01) 7-14.
• 104 van der Sijs H, Aarts J, Vulto A, Berg M. Overriding of drug safety alerts in computerized physician order entry. J Am Med Inform Assoc 2006; Mar-Apr; 13 (02) 138-47.
• 105 Grizzle AJ, Mahmood MH, Ko Y, Murphy JE, Armstrong EP, Skrepnek GH. et al. Reasons provided by prescribers when overriding drug-drug interaction alerts. Am J Manag Care 2007; Oct; 13 (10) 573-8.
• 106 Lin CP, Payne TH, Nichol WP, Hoey PJ, Anderson CL, Gennari JH. Evaluating Clinical Decision Support Systems: Monitoring CPOE Order Check Override Rates in the Department of Veterans Affairs’ Computerized Patient Record System. J Am Med Inform Assoc 2008; Sep-Oct; 15 (05) 620-6.
• 107 Walker JM, Carayon P, Leveson N, Paulus RA, Tooker J, Chin H. et al. EHR safety: the way forward to safe and effective systems. J Am Med Inform Assoc 2008; May-Jun; 15 (03) 272-7.
• 108 Ash JS, Sittig DF, Campbell EM, Guappone KP, Dykstra RH. Some unintended consequences of clinical decision support systems. AMIA Annu Symp Proc 2007; 26-30.
• 109 Coiera EW, Westbrook JI. Should clinical software be regulated?. Med J Aust 2006; Jun 19; 184 (12) 600-1.
• 110 US Certification Commission for Healthcare IT. 2008 [cited 2008 Dec 15]; Available from: www.cchit.org
• 111 Leapfrog issues caution that quality assurance is necessary during implementation of computerized medication systems. 2008 [cited 2008 Dec 15]; Available from: www.leapfroggroup.org
• 112 UK NHS Connecting for Health Initiative. 2008 [cited 2008 Dec 15]; Available from: www.connectingforhealth.nhs.uk/systemsandservices/eprescribing/news/hazard
• 113 Kilbridge PM, Classen DC. The informatics opportunities at the intersection of patient safety and clinical informatics. J Am Med Inform Assoc 2008; Jul-Aug; 15 (04) 397-407.
• 114 Cacciabue PC, Vella G. Human factors engineering in healthcare systems: The problem of human error and accident management. Int J Med Inform. 2008 Dec 18.
• 115 Paterno MD, Maviglia SM, Gorman PN, Seger DL, Yoshida E, Seger AC. et al. Tiering drugdrug interaction alerts by severity increases compliance rates. J Am Med Inform Assoc 2009; Jan-Feb; 16 (01) 40-6.
• 116 Tamblyn R, Huang A, Taylor L, Kawasumi Y, Bartlett G, Grad R. et al. A randomized trial of the effectiveness of on-demand versus computer-triggered drug decision support in primary care. J Am Med Inform Assoc 2008; Jul-Aug; 15 (04) 430-8.
• 117 Lo HG, Matheny ME, Seger DL, Bates DW, Gandhi TK. Impact of non-interruptive medication laboratory monitoring alerts in ambulatory care. J Am Med Inform Assoc 2009; Jan-Feb; 16 (01) 66-71.
• 118 van der Sijs H, Aarts J, van Gelder T, Berg M, Vulto A. Turning off frequently overridden drug alerts: limited opportunities for doing it safely. J Am Med Inform Assoc 2008; 15 (04) 439-48.
• 119 Graham TA, Kushniruk AW, Bullard MJ, Holroyd BR, Meurer DP, Rowe BH. How usability of a web-based clinical decision support system has the potential to contribute to adverse medical events. AMIA Annu Symp Proc 2008; 257-61.
• 120 Magrabi F. Using cognitive models to evaluate safety-critical interfaces in healthcare. CHI ‘08 extended abstracts on Human factors in computing systems. Florence, Italy: ACM; 2008
• 121 Lamy JB, Duclos C, Bar-Hen A, Ouvrard P, Venot A. An iconic language for the graphical representation of medical concepts. BMC Med Inform Decis Mak 2008; 08: 16.
• 122 Zheng K, Padman R, Johnson MP, Diamond HS. An Interface-Driven Analysis of User Interactions with an Electronic Health Records System. J Am Med Inform Assoc. 2008 Dec 11.
• 123 Bonnabry P, Despont-Gros C, Grauser D, Casez P, Despond M, Pugin D. et al. A risk analysis method to evaluate the impact of a computerized provider order entry system on patient safety. J Am Med Inform Assoc 2008; Jul-Aug; 15 (04) 453-60.
• 124 Magrabi F, McDonnell G, Westbrook JI, Coiera E. Using an accident model to design safe electronic medication management systems. Medinfo 2007; 12 (Pt 2): 948-52.