Clinical Information Systems – From Yesterday to Tomorrow

Summary

Objectives: To review the history of clinical information systems over the past twenty-five years and project anticipated changes to those systems over the next twenty-five years.

Methods: Over 250 Medline references about clinical information systems, quality of patient care, and patient safety were reviewed. Books, Web resources, and the author’s personal experience with developing the HELP system were also used. Results: There have been dramatic improvements in the use and acceptance of clinical computing systems and Electronic Health Records (EHRs), especially in the United States. Although there are still challenges with the implementation of such systems, the rate of progress has been remarkable. Over the next twenty-five years, there will remain many important opportunities and challenges. These opportunities include understanding complex clinical computing issues that must be studied, understood and optimized. Dramatic improvements in quality of care and patient safety must be anticipated as a result of the use of clinical information systems. These improvements will result from a closer involvement of clinical informaticians in the optimization of patient care processes.

Conclusions: Clinical information systems and computerized clinical decision support have made contributions to medicine in the past. Therefore, by using better medical knowledge, optimized clinical information systems, and computerized clinical decision, we will enable dramatic improvements in both the quality and safety of patient care in the next twenty-five years.

Keywords

Clinical informatics - patient safety - decision making - computer assisted - electronic health records

• References

• 1 Tetlock PE, Gardner D. Superforecasting The Art and Science of Prediction. New York, NY: Crown Publishers; 2015
• 2 HealthConnect Evaluation in Australia. 2009 [cited 2015 November 21]. Available from: www.health.gov.au/internet/main/publishing.nsf/Content/pacd-ehealth-Healthconnectevaluation.
• 3 France FR. eHealth in Belgium, a new “secure” federal network: role of patients, health professions and social security services. Int J Med Inform 2011; 80 (Suppl. 02) e12-6.
• 4 EHRS Blueprint: An interoperable EHR Framework - Summary Version 2 Canada 2006. [cited 2015 November 21]. Available from: www.infoway-inforoute.ca/en/component/edocman/resources/technical-documents/390-ehrs-blueprint-v2-summary.
• 5 Protti D, Johansen I. Widespread adoption of information technology in primary care physician offices in Denmark: a case study. Issue Brief (Commonw Fund) 2010; 80: 1-14.
• 6 Robertson A, Bates DW, Sheikh A. The rise and fall of England’s National Programme for IT. J R Soc Med 2011; 104 (Suppl. 11) 434-5.
• 7 Blumenthal D. Launching HITECH. N Engl J Med 2010; 362 (Suppl. 05) 382-5.
• 8 Blumenthal D, Tavenner M. The “meaningful use” regulation for electronic health records. N Engl J Med 2010; 363 (Suppl. 06) 501-4.
• 9 Classen DC, Bates DW. Finding the meaning in meaningful use. N Engl J Med 2011; 365 (Suppl. 09) 855-8.
• 10 CDC.. Meaningful Use - Introduction 2015 [cited 2015 December 20]. Available from: cdc.gov/ehrmeaningfuluse/introduction.html.
• 11 Government Printing Office (GPO).. 2010. Public Law 11-148: The Patient Protection and Affordable Care Act. Washington: U.S. Governmnet Printing Office; Washington, DC: U.S. Government Printing Office; 2010 [cited 2015 October 1]. Available from: http://www.gpo.gov/fdsys/pkg/PLAW-111publ148/pdf/PLAW-111publ148.pdf.
• 12 Aarts J, Koppel R. Implementation of computerized physician order entry in seven countries. Health Aff 2009; 28 (Suppl. 02) 404-14.
• 13 Adler-Milstein J, Ronchi E, Cohen GR, Winn LA, Jha AK. Benchmarking health IT among OECD countries: better data for better policy. J Am Med Inform Assoc 2014; 21 (Suppl. 01) 111-6.
• 14 Adler-Milstein J, Sarma N, Woskie LR, Jha AK. A comparison of how four countries use health IT to support care for people with chronic conditions. Health Affairs 2014; 33 (Suppl. 09) 1559-66.
• 15 Borycki E, Cummings E, Dexheimer JW, Gong Y, Kennebeck S, Kushniruk A. et al. Patient-Centred Coordinated Care in Times of Emerging Diseases and Epidemics. Contribution of the IMIA Working Group on Patient Safety. Yearb Med Inform 2015; 10 (Suppl. 01) 207-15.
• 16 Geissbuhler A, Kimura M, Kulikowski CA, Murray PJ, Ohno-Machado L, Park HA. et al. Confluence of disciplines in health informatics: an international perspective. Methods Inf Med 2011; 50 (Suppl. 06) 545-55.
• 17 Hasman A, Ammenwerth E, Dickhaus H, Knaup P, Lovis C, Mantas J. et al. Biomedical informatics-a confluence of disciplines?. Methods Inf Med 2011; 50 (Suppl. 06) 508-24.
• 18 Fagan LM, Perreault LE. The Future of Computer Applications in Medicine. In: Shortliffe EH, Perreault LE, Wiederhold G, Fagan LM. editors. Medical Informatics: Computer Applications in Health Care. 1st ed. Reading, MA: Addison-Wesley Publishing Company; 1990. p. 620-44
• 19 Fagan LM, Shorliffe EH. The Future of Computer Applications in Health Care. In: Shorliffe EH, Perreault LE, Wiederhold G, Fagan LM. editors. Medical Informatics: Computer Applications in Health Care and Biomedicine. Computers in Health Care. 2nd ed. New York, NY: Springer-Verlag; 2001. p. 697-712
• 20 Fagan LM, Shorliffe EH. The Future of Computer Applications in Biomedicine. In: Shortliffe EH, Cimino JJ. editors. Biomedical Informatics. Health Informatics Series. 3rd ed. New York, NY: Springer-Verlag; 2006. p. 829-47
• 21 Frisse ME, Florance V, Mandel KD, Kohane IS. The Future of Informatics in Biomedicine. In: Shorliffe EH, Cimino JJ. editors. Biomedical Informatics: Computer Applications in Health Care and Biomedicine. 4th ed. New York, NY: Springer-Verlag; 2014. p. 797-811
• 22 Rudin RS, Tang PC, Bates DW. Health Information Technology Policy. In: Shortliffe EH, Cimino JJ. editors. Biomedical Informatics: Computer Applications in Health Care and Biomedicine. 4th ed. New York, NY: Springer-Verlag; 2014. p. 781-95
• 23 Bates DW, Kuperman GJ, Wang S, Gandhi T, Kittler A, Volk L. et al. Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc 2003; 10 (Suppl. 06) 523-30.
• 24 Stafford RS, Romano MJ. Is clinical decision support the missing link in prevention? Comment on “Shared electronic vascular risk decision support in primary care”. Arch Intern Med 2011; 171 (Suppl. 19) 1745-6.
• 25 Cresswell KM, Bates DW, Sheikh A. Ten key considerations for the successful implementation and adoption of large-scale health information technology. J Am Med Inform Assoc 2013; 20 e1 e9-e13.
• 26 de Assis Moura Jr. L. Embracing Strategies for eHealth. Yearb Med Inform 2015; 10 (Suppl. 01) 1.
• 27 Dixon-Woods M, Amalberti R, Goodman S, Bergman B, Glasziou P. Problems and promises of innovation: why healthcare needs to rethink its love/hate relationship with the new. BMJ Qual Saf 2011;20 Suppl 1 i47-51.
• 28 Friedman C, Rubin J, Brown J, Buntin M, Corn M, Etheredge L. et al. Toward a science of learning systems: a research agenda for the high-functioning Learning Health System. J Am Med Inform Assoc 2015; 22 (Suppl. 01) 43-50.
• 29 Collins FS, Varmus H. A new initiative on precision medicine. N Engl J Med 2015; 372 (Suppl. 09) 793-5.
• 30 Kohane IS. Ten things we have to do to achieve precision medicine. Science 2015; 349 6243 37-8.
• 31 Greenes RA. Health Information Systems 2025 Ch 33. In: Weaver CA, Ball MJ, Kim GR, Kiel JM. editors. Healthcare Information Management Systems: Cases, Strategies, and Solutions. 4th ed. Switzerland: Springer International Publishing AG; 2016. p. 400-44
• 32 Edmonds M, Peddicord D, Frisse ME. The Reasons Why Interoperability is Difficult Ch 7. In: Weaver CA, Ball MJ, Kim GR, Kiel JM. editors. Healthcare Information Management Systems: Cases, Strategies, and Solutions. 4th ed. Switzerland: Springer International Publishing AG; 2016
• 33 Edmonds M, Peddicord D, Frisse ME. The Evolution of Health Information Technology Policy in the United States Ch 8. In: Weaver CA, Ball MJ, Kidd MR, Kiel JM. editors. Healthcare Information Management Systems: Cases, Strategies, and Solutions. 4th ed. Switzerland: Springer International Publishing AG; 2016
• 34 Koppel R. Great Promises of Healthcare Information Technology Deliver Less Ch 6. In: Weaver CA, Ball MJ, Kim GR, Kiel JM. editors. Healthcare Information Management Systems: Cases, Strategies, and Solutions. 4th ed. Switzerland: Springer International Publishing AG; 2016
• 35 Rosen MA, Tran G, Carolan H, Romig M, Dwyer C, Dietz AS. et al. Data Driven Patient Safety and Clinical Information Technology Ch 18. In: Weaver CA, Ball MJ, Kim GR, Kiel JM. editors. Healthcare Information Management Systems: Cases, Strategies, and Solutions. 4th ed. Switzerland: Springer International Publishing AG; 2016
• 36 Atkins D, Cullen T. The future of health information technology: implications for research. Med Care 2013; 51 3 Suppl 1 S1-3.
• 37 Bates DW. Health Information Technology and Care Coordination: The Next Big Opportunity for Informatics?. Yearb Med Inform 2015 10(1)
• 38 Bates DW, Evans RS, Murff H, Stetson PD, Pizziferri L, Hripcsak G. Policy and the future of adverse event detection using information technology. J Am Med Inform Assoc 2003; 10 (Suppl. 02) 226-8.
• 39 Bates DW, Saria S, Ohno-Machado L, Shah A, Escobar G. Big data in health care: using analytics to identify and manage high-risk and high-cost patients. Health Aff 2014; 33 (Suppl. 07) 1123-31.
• 40 Bates DW, Zimlichman E. Finding patients before they crash: the next major opportunity to improve patient safety. BMJ Qual Saf 2015; 24 (Suppl. 01) 1-3.
• 41 Collen MF. A history of medical informatics in the United States, 1950 to 1990. Indianapolis, IN: American Medical Informatics Association; 1995
• 42 Collen MF, Ball MJ. The History of Medical Informatics in the United States. 2nd ed. New York: Springer; 2015
• 43 McCray AT, Gefeller O, Aronsky D, Leong TY, Sarkar IN, Bergemann D. et al. The birth and evolution of a discipline devoted to information in biomedicine and health care. As reflected in its longest running journal. Methods Inf Med 2011; 50 (Suppl. 06) 491-507.
• 44 Mitchell JA, Gerdin U, Lindberg DA, Lovis C, Martin-Sanchez FJ, Miller RA. et al. 50 years of informatics research on decision support: what’s next. Methods Inf Med 2011; 50 (Suppl. 06) 525-35.
• 45 RWJF.. Health Information Technology in the United States, 2015: Transition to a Post-HITECH World. 2015 Sept 2015. Report No.: 2015 Annual.
• 46 Winter A. The future of medical informatics. Some perspectives of intra- and inter-institutional information systems. Methods Inf Med 2009; 48 (Suppl. 01) 62-5.
• 47 Jones SS, Rudin RS, Perry T, Shekelle PG. Health information technology: an updated systematic review with a focus on meaningful use. Ann Intern Med 2014; 160 (Suppl. 01) 48-54.
• 48 Detmer DE. Information technology for quality health care: a summary of United Kingdom and United States experiences. Qual Health Care 2000; 9 (Suppl. 03) 181-9.
• 49 Warner HR, Pryor TA, Clark JS, Morgan JD. Integration of Computer Support for Institutional Practice: The HELP System. In: Charles Weller MD. editor. Proc of SAMS Meeting 1975; Houston, TX. Miami, FL: Symposia Specialists; 1976. p. 121-33
• 50 Warner HR, Gardner RM, Pryor TA, Day WC, Stauffer WM. A system for on-line computer analysis of data during heart catheterization. In: Adams FH, Swan HJC, Hall VE. editors. UCLA Forum in Medical Scinecesm Pathophysiology of Congenital Heart Disease. UCLA Forum in Medical Sciences. 1970/01/01 ed. Los Angeles, CA: University of California Press; 1970. p. 409-18
• 51 Kuperman GJ, Gardner RM, Pryor TA. HELP : a dynamic hospital information system. New York, NY: Springer-Verlag; 1991: xxiii-334 p. p.
• 52 Gardner RM, Lundsgaarde HP. Evaluation of user acceptance of a clinical expert system. J Am Med Inform Assoc 1994; 1 (Suppl. 06) 428-38.
• 53 Classen DC, Evans RS, Pestotnik SL, Horn SD, Menlove RL, Burke JP. The timing of prophylactic administration of antibiotics and the risk of surgical-wound infection. N Engl J Med 1992; 326 (Suppl. 05) 281-6.
• 54 Evans RS, Pestotnik SL, Classen DC, Clemmer TP, Weaver LK, Orme Jr. JF. et al. A computer-assisted management program for antibiotics and other antiinfective agents. N Engl J Med 1998; 338 (Suppl. 04) 232-8.
• 55 Classen DC, Pestotnik SL, Evans RS, Lloyd JF, Burke JP. Adverse drug events in hospitalized patients. Excess length of stay, extra costs, and attributable mortality. JAMA 1997; 277 (Suppl. 04) 301-6.
• 56 Classen DC, Pestotnik SL, Evans RS, Burke JP. Computerized surveillance of adverse drug events in hospital patients. JAMA 1991; 266 (Suppl. 20) 2847-51.
• 57 Henderson S, Crapo RO, Wallace CJ, East TD, Morris AH, Gardner RM. Performance of computerized protocols for the management of arterial oxygenation in an intensive care unit. Int J Clin Monit Comput 1991; 8 (Suppl. 04) 271-80.
• 58 Sittig DF, Pace NL, Gardner RM, Beck E, Morris AH. Implementation of a computerized patient advice system using the HELP clinical information system. Comput Biomed Res 1989; 22 (Suppl. 05) 474-87.
• 59 Gardner RM, Pryor TA, Warner HR. The HELP hospital information system: update 1998. Int J Med Inform 1999; 54 (Suppl. 03) 169-82.
• 60 Warner HR. History of Medical Informatics at Utah. In: Blum BI, Duncan K. editors. A History of Medical Informatics - ACM Press History Series. Reading MA: Addison-Wesley; 1990. p. 357-69
• 61 Clayton PD, Narus SP, Huff SM, Pryor TA, Haug PJ, Larkin T. et al. Building a comprehensive clinical information system from components. The approach at Intermountain Health Care. Methods Inf Med 2003; 42 (Suppl. 01) 1-7.
• 62 Mamykina L, Vawdrey DK, Stetson PD, Zheng K, Hripcsak G. Clinical documentation: composition or synthesis?. J Am Med Inform Assoc 2012; 19 (Suppl. 06) 1025-31.
• 63 Vawdrey DK, Chang N, Compton A, Tiase V, Hripcsak G. Impact of electronic medication reconciliation at hospital admission on clinician workflow. AMIA Annu Symp Proc 2010; 2010: 822-6.
• 64 HealthIT.gov.. Hospital EHR Vendors 2015 [cited 2016 January 27]. Available from: http://dash-board.healthit.gov/quickstats.
• 65 Koppel R, Lehmann CU. Implications of an emerging EHR monoculture for hospitals and healthcare systems. J Am Med Inform Assoc 2015; 22 (Suppl. 02) 465-71.
• 66 Evans RS. Electronic Health Records: Then, Now and the Future. Yearbook Med Inform 2016; XX-YY.
• 67 Koppel R, Metlay JP, Cohen A, Abaluck B, Localio AR, Kimmel SE. et al. Role of computerized physician order entry systems in facilitating medication errors. JAMA 2005; 293 (Suppl. 10) 1197-203.
• 68 Ash JS, Sittig DF, Dykstra R, Campbell E, Guappone K. The unintended consequences of computerized provider order entry: findings from a mixed methods exploration. Int J Med Inform 2009;78 Suppl 1 S69-76.
• 69 Cimino JJ. Improving the electronic health record--are clinicians getting what they wished for?. JAMA 2013; 309 (Suppl. 10) 991-2.
• 70 Byyny RL. Editorial: The Tragedy of the electronic health record. Pharos Alpha Omega Alpha Honor Med Soc 2015; 78 (Suppl. 03) 2-5.
• 71 Ober KP, Applegate WB. The electronic health record. Are we the tools of our tools? Pharos Alpha Omega Alpha Honor Med Soc 2015; 78 (Suppl. 01) 8-14.
• 72 Hersh W, Williamson J. Educating 10,000 informaticians by 2010: the AMIA 10x10 program. Int J Med Inform 2007; 76 5-6 377-82.
• 73 Gardner RM, Overhage JM, Steen EB, Munger BS, Holmes JH, Williamson JJ. et al. Core content for the subspecialty of clinical informatics. J Am Med Inform Assoc 2009; 16 (Suppl. 02) 153-7.
• 74 Safran C, Shabot MM, Munger BS, Holmes JH, Steen EB, Lumpkin JR. et al. Program requirements for fellowship education in the subspecialty of clinical informatics. J Am Med Inform Assoc 2009; 16 (Suppl. 02) 158-66.
• 75 Detmer DE, Munger BS, Lehmann CU. Clinical informatics board certification: history, current status, and predicted impact on the clinical informatics workforce. Appl Clin Inform 2010; 1 (Suppl. 01) 11-8.
• 76 Payne TH. Electronic health records and patient safety: should we be discouraged?. BMJ Qual Saf 2015; 24 (Suppl. 04) 239-40.
• 77 Riskin L, Koppel R, Riskin D. Re-examining health IT policy: what will it take to derive value from our investment?. J Am Med Inform Assoc 2015; 22 (Suppl. 02) 459-64.
• 78 Wachter RM. The Digital Doctor: Hope, Hype and Harm at the Dawn of Medicine’s Computer Age. New York, NY: Mc Graw Hill Education; 2015
• 79 Rosenbaum L. Transitional Chaos or Enduring Harm? The EHR and the Disruption of Medicine. N Engl J Med 2015; 373 (Suppl. 17) 1585-8.
• 80 Berwick DM, Nolan TW, Whittington J. The triple aim: care, health, and cost. Health Aff 2008; 27 (Suppl. 03) 759-69.
• 81 Sheikh A, Sood HS, Bates DW. Leveraging health information technology to achieve the “triple aim” of healthcare reform. J Am Med Inform Assoc 2015; 22 (Suppl. 04) 849-56.
• 82 Payne TH, Corley S, Cullen TA, Gandhi TK, Harrington L, Kuperman GJ. et al. Report of the AMIA EHR-2020 Task Force on the status and future direction of EHRs. J Am Med Inform Assoc 2015; 22 (Suppl. 05) 1102-10.
• 83 ONC.. Connecting health and care for the nation: a 10-year vision to achieve an interoperable health IT infrastructure 2014 [cited 2015 October 27]. Available from: http://healthit.gov/ sites/default/files/ONC10yearInteroperabilityConceptPaper.pdf.
• 84 Kohn LT, Corrigan JM, Donaldson MS. To Err is Human: Building a Safer Health System. Washington, DC: The National Academies Press; 2000
• 85 Richardson WC. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: The National Academies Press; 2001
• 86 McDonald CJ, Weiner M, Hui SL. Deaths due to medical errors are exaggerated in Institute of Medicine report. JAMA 2000; 284 (Suppl. 01) 93-5.
• 87 Leape LL. Institute of Medicine medical error figures are not exaggerated. JAMA 2000; 284 (Suppl. 01) 95-7.
• 88 James JT. A new, evidence-based estimate of patient harms associated with hospital care. J Patient Saf 2013; 9 (Suppl. 03) 122-8.
• 89 Shabot MM. New tools for high reliability health-care. BMJ Qual Saf 2015; 24 (Suppl. 07) 423-4.
• 90 Warden GL. Health IT and Patient Safety: Building a Safer System for Better Care. Washington, DC: The National Academies Press; 2012. 2012.
• 91 Medicine NAo.. Protecting Patients: Advances and Future Direction of Patient Safety: Washington, DC; 2015 [cited 2016 January 18]. Available from: http://nam.edu/event/2015-rosenthal-symposium.
• 92 Classen DC, Resar R, Griffin F, Federico F, Frankel T, Kimmel N. et al. ‘Global trigger tool’ shows that adverse events in hospitals may be ten times greater than previously measured. Health Affairs 2011; 30 (Suppl. 04) 581-9.
• 93 Graber ML, Siegal D, Riah H, Johnston D, Kenyon K. Electronic Health Record-Related Events in Medical Malpractice Claims. J Patient Saf 2015
• 94 Sittig DF, Classen DC, Singh H. Patient safety goals for the proposed Federal Health Information Technology Safety Center. J Am Med Inform Assoc 2015; 22 (Suppl. 02) 472-8. doi: 10.1136/amiajnl-2014-002988. PubMed PMID: 25332353.
• 95 Banger A, Graber ML. Recent Evidence that Health IT Improves Patient Safety: Office of National Center (ONC); 2015 [cited 2016 January 16]. Available from: https://healthit.gov/sites/default/files/brief_1_final_feb11t.pdf.
• 96 Buntin MB, Burke MF, Hoaglin MC, Blumenthal D. The benefits of health information technology: a review of the recent literature shows predominantly positive results. Health Aff 2011; 30 (Suppl. 03) 464-71.
• 97 Chaudhry B, Wang J, Wu S, Maglione M, Mojica W, Roth E. et al. Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med 2006; 144 (Suppl. 10) 742-52.
• 98 Goldzweig CL, Towfigh A, Maglione M, Shekelle PG. Costs and benefits of health information technology: new trends from the literature. Health Aff 2009; 28 (Suppl. 02) w282-93.
• 99 Amalberti R. The paradoxes of almost totally safe transportation systems. Saf Sci 2001; 37: 109-26.
• 100 Amalberti R. Navigating Safety: Necessary Compromises and Trade-Off-Theory and Practice. New York, NY: Springer; 2013
• 101 Amalberti R, Benhamou D, Auroy Y, Degos L. Adverse events in medicine: easy to count, complicated to understand, and complex to prevent. J Biomed Inform 2011; 44 (Suppl. 03) 390-4.
• 102 Vincent C, Amalberti R. Safety in health-care is a moving target. BMJ Qual Saf 2015; 24 (Suppl. 09) 539-40.
• 103 Baines R, Langelaan M, de Bruijne M, Spreeuwenberg P, Wagner C. How effective are patient safety initiatives? A retrospective patient record review study of changes to patient safety over time. BMJ Qual Saf 2015; 24 (Suppl. 09) 561-71.
• 104 Baines RJ, Langelaan M, de Bruijne MC, Asscheman H, Spreeuwenberg P, van de Steeg L. et al. Changes in adverse event rates in hospitals over time: a longitudinal retrospective patient record review study. BMJ Qual Saf 2013; 22 (Suppl. 04) 290-8.
• 105 Vincent C, Amalberti R. Safer Healthcare: Strategies for the Real World. New York, NY: Springer; 2016
• 106 Balogh EP, Miller BT, Ball JR. Improving Diagnosis in Health Care. Washington, DC: The National Academy of Sciences; 2015
• 107 Black AD, Car J, Pagliari C, Anandan C, Cress-well K, Bokun T. et al. The impact of eHealth on the quality and safety of health care: a systematic overview. PLoS Med 2011; 8 (Suppl. 01) e1000387.
• 108 Denham CR, Classen DC, Swenson SJ, Henderson MJ, Zeltner T, Bates DW. Safe use of electronic health records and health information technology systems: trust but verify. J Patient Saf 2013; 9 (Suppl. 04) 177-89.
• 109 Ferranti JM, Langman MK, Tanaka D, McCall J, Ahmad A. Bridging the gap: leveraging business intelligence tools in support of patient safety and financial effectiveness. J Am Med Inform Assoc 2010; 17 (Suppl. 02) 136-43.
• 110 Gallego B, Magrabi F, Concha OP, Wang Y, Coiera E. Insights into temporal patterns of hospital patient safety from routinely collected electronic data. Health Inf Sci Syst 2015; 3 Suppl 1 HISA Big Data in Biomedicine and Healthcare 2013 Con S2.
• 111 Marcilly R, Ammenwerth E, Roehrer E, Pelayo S, Vasseur F, Beuscart-Zephir MC. Usability Flaws in Medication Alerting Systems: Impact on Usage and Work System. Yearb Med Inform 2015 10(1)
• 112 Meeks DW, Smith MW, Taylor L, Sittig DF, Scott JM, Singh H. An analysis of electronic health record-related patient safety concerns. J Am Med Inform Assoc 2014; 21 (Suppl. 06) 1053-9.
• 113 Phansalkar S, Edworthy J, Hellier E, Seger DL, Schedlbauer A, Avery AJ. et al. A review of human factors principles for the design and implementation of medication safety alerts in clinical information systems. J Am Med Inform Assoc 2010; 17 (Suppl. 05) 493-501.
• 114 Schiff GD, Amato MG, Eguale T, Boehne JJ, Wright A, Koppel R. et al. Computerised physician order entry-related medication errors: analysis of reported errors and vulnerability testing of current systems. BMJ Qual Saf 2015; 24 (Suppl. 04) 264-71.
• 115 Wang Y, Eldridge N, Metersky ML, Verzier NR, Meehan TP, Pandolfi MM. et al. National trends in patient safety for four common conditions, 2005-2011. N Engl J Med 2014; 370 (Suppl. 04) 341-51.
• 116 Leape LL, Berwick DM, Bates DW. What practices will most improve safety? Evidence-based medicine meets patient safety. JAMA 2002; 288 (Suppl. 04) 501-7.
• 117 Bates DW, Gawande AA. Improving safety with information technology. N Engl J Med 2003; 348 (Suppl. 25) 2526-34.
• 118 Evans RS, Larsen RA, Burke JP, Gardner RM, Meier FA, Jacobson JA. et al. Computer surveillance of hospital-acquired infections and antibiotic use. JAMA 1986; 256 (Suppl. 08) 1007-11.
• 119 Clancy CM, Berwick DM. The science of safety improvement: learning while doing. Ann Intern Med 2011; 154 (Suppl. 10) 699-701.
• 120 Shekelle PG, Pronovost PJ, Wachter RM, Taylor SL, Dy SM, Foy R. et al. Advancing the science of patient safety. Ann Intern Med 2011; 154 (Suppl. 10) 693-6.
• 121 Panzer RJ, Gitomer RS, Greene WH, Webster PR, Landry KR, Riccobono CA. Increasing demands for quality measurement. JAMA 2013; 310 (Suppl. 18) 1971-80.
• 122 Thomas EJ, Classen DC. Patient safety: let’s measure what matters. Ann Intern Med 2014; 160 (Suppl. 09) 642-3.
• 123 Blumenthal D, Malphrus E, McGinnis JM. Vital Signs: Core Metrics for Health and Health Care Progress. Blumenthal D, Malphrus E, McGinnis JM. editors. Washington (DC): The National Academies Press; 2015. Apr 2015
• 124 Liyanage H, Correa A, Liaw ST, Kuziemsky C, Terry AL, de Lusignan S. Does Informatics Enable or Inhibit the Delivery of Patient-centred, Coordinated, and Quality-assured Care: a Delphi Study. A Contribution of the IMIA Primary Health Care Informatics Working Group. Yearb Med Inform 2015 10(1).
• 125 Foundation NPS. Free from Harm: Accelerating Patient Safety Improvement Fifteen Years after To Err is Human 2015 [cited 2016 January 16]. Available from: http://www.npsf.org/free-from-harm.
• 126 Gardner RM. University of Utah Medical Informatics Research and Training program. Yearb Med Inform 2001; 103-11.
• 127 Patel VL, Kaufman DR, Cohen T. Cognitive Informatics in Health and Biomedicine: Case studies on Critical Care, Complexity and Errors. New York, NY: Springer; 2014
• 128 Patel VL, Kannampallil TG, Shortliffe EH. Role of cognition in generating and mitigating clinical errors. BMJ Qual Saf 2015; 24 (Suppl. 07) 468-74.
• 129 Wong BM, Dyal S, Etchells EE, Knowles S, Gerard L, Diamantouros A. et al. Application of a trigger tool in near real time to inform quality improvement activities: a prospective study in a general medicine ward. BMJ Qual Saf 2015; 24 (Suppl. 04) 272-81.
• 130 Thomas EJ. The future of measuring patient safety: prospective clinical surveillance. BMJ Qual Saf 2015; 24 (Suppl. 04) 244-5.
• 131 Nanji KC, Patel A, Shaikh S, Seger DL, Bates DW. Evaluation of Perioperative Medication Errors and Adverse Drug Events. Anesthesiology 2015
• 132 Hillestad R, Bigelow J, Bower A, Girosi F, Meili R, Scoville R. et al. Can electronic medical record systems transform health care? Potential health benefits, savings, and costs. Health Aff 2005; 24 (Suppl. 05) 1103-17.
• 133 Kellermann AL, Jones SS. What it will take to achieve the as-yet-unfulfilled promises of health information technology. Health Aff 2013; 32 (Suppl. 01) 63-8.
• 134 Bassi J, Lau F. Measuring value for money: a scoping review on economic evaluation of health information systems. J Am Med Inform Assoc 2013; 20 (Suppl. 04) 792-801.
• 135 Rudin RS, Jones SS, Shekelle P, Hillestad RJ, Keeler EB. The value of health information technology: filling the knowledge gap. Am J Manag Care 2014; 20 11 Spec No. 17 eSP1-8.
• 136 Seroussi B, Jaulent MC, Lehmann CU. Health Information Technology Challenges to Support Patient-Centered Care Coordination. Yearb Med Inform 2015; 10 (Suppl. 01) 8-10.
• 137 Adler-Milstein J, Everson J, Lee SD. EHR Adoption and Hospital Performance: Time-Related Effects. Health Serv Res 2015; 50 (Suppl. 06) 1751-71.
• 138 Purkayastha S, Price A, Biswas R, Jai Ganesh AU, Otero P. From Dyadic Ties to Information Infrastructures: Care-Coordination between Patients, Providers, Students and Researchers. Contribution of the Health Informatics Education Working Group. Yearb Med Inform 2015 10(1)
• 139 Yusof MM, Papazafeiropoulou A, Paul RJ, Stergioulas LK. Investigating evaluation frameworks for health information systems. Int J Med Inform 2008; 77 (Suppl. 06) 377-85.
• 140 Yusof MM, Kuljis J, Papazafeiropoulou A, Stergioulas LK. An evaluation framework for Health Information Systems: human, organization and technology-fit factors (HOT-fit). Int J Med Inform 2008; 77 (Suppl. 06) 386-98.
• 141 Saparova D, Belden J, Williams J, Richardson B, Schuster K. Evaluating a federated medical search engine: tailoring the methodology and reporting the evaluation outcomes. Appl Clin Inform 2014; 5 (Suppl. 03) 731-45.
• 142 Yusof MM. A case study evaluation of a Critical Care Information System adoption using the socio-technical and fit approach. Int J Med Inform 2015; 84 (Suppl. 07) 486-99.
• 143 Ammenwerth E. Evidence-based Health Informatics: How Do We Know What We Know?. Methods Inf Med 2015; 54 (Suppl. 04) 298-307.
• 144 Al-Shorbaji N, Hanmer L, Hussein R, Magrabi F, Moen A, Moura LA. et al. Discussion of “Evidence-based Health Informatics: How Do We Know What We Know?”. Methods Inf Med 2015; 54 (Suppl. 04) 308-18.
• 145 Shojania KG, Sampson M, Ansari MT, Ji J, Doucette S, Moher D. How quickly do systematic reviews go out of date? A survival analysis. Ann Intern Med 2007; 147 (Suppl. 04) 224-33.
• 146 Gartner’s 2015 Hype Cycle for Emerging Technologies Identifies the Computing Innovations that Organizations Should Monitor [Internet].. Stamford, Connecticut: Gartner, Inc.; 2015; August 18, 2015 [cited 20 Nov 15]. Available from: http://www.gartner.com/newsroom/id/3114217
• 147 Harris Y, Schneider CD. Big Data: A Realisitc Assessment of its Application to Health Care Ch 4. Health Information Technology in the United States 2015 Transition to a Post-HITECH World 2015. p. 53-79
• 148 Pickering BW, Dong Y, Ahmed A, Giri J, Kilickaya O, Gupta A. et al. The implementation of clinician designed, human-centered electronic medical record viewer in the intensive care unit: a pilot step-wedge cluster randomized trial. Int J Med Inform 2015; 84 (Suppl. 05) 299-307.
• 149 Vawdrey DK, Gardner RM, Evans RS, Orme Jr. JF, Clemmer TP, Greenway L. et al. Assessing data quality in manual entry of ventilator settings. J Am Med Inform Assoc 2007; 14 (Suppl. 03) 295-303.