Subscribe to RSS
![](/products/assets/desktop/img/oa-logo.png)
DOI: 10.15265/IY-2016-030
The Virtuous Circles of Clinical Information Systems: a Modern Utopia
Publication History
10 November 2016
Publication Date:
06 March 2018 (online)
![](https://www.thieme-connect.de/media/10.1055-s-00034612/201601/lookinside/thumbnails/10-15265-iy-2016-030-1.jpg)
Summary
Context: Clinical information systems (CIS) are developed with the aim of improving both the efficiency and the quality of care.
Objective: This position paper is based on the hypothesis that such vision is partly a utopian view of the emerging eSociety.
Methods: Examples are drawn from 15 years of experience with the fully integrated Georges Pompidou University Hospital (HEGP) CIS and temporal data series extracted from the data warehouses of Assistance Publique - Hôpitaux de Paris (AP-HP) acute care hospitals which share the same administrative organization as HEGP. Three main virtuous circles are considered: user satisfaction vs. system use, system use vs. cost efficiency, and system use vs quality of care.
Results: In structural equation models (SEM), the positive bidirectional relationship between user satisfaction and use was only observed in the early HEGP CIS deployment phase (first four years) but disappeared in late post-adoption (≥8 years). From 2009 to 2013, financial efficiency of 20 AP-HP hospitals evaluated with stochastic frontier analysis (SFA) models diminished by 0.5% per year. The lower decrease of efficiency observed between the three hospitals equipped with a more mature CIS and the 17 other hospitals was of the same order of magnitude than the difference observed between pediatric and non-pediatric hospitals. Outcome quality benefits that would bring evidence to the system use vs. quality loop are unlikely to be obtained in a near future since they require integration with population-based outcome measures including mortality, morbidity, and quality of life that may not be easily available.
Conclusion: Barriers to making the transformation of the utopian part of the CIS virtuous circles happen should be overcome to actually benefit the emerging eSociety.
-
References
- 1 Degoulet P. Success criteria for a clinical information system.. In: TIC Saude 2013/ ICT in Health 2013. Brazilian Internet Steering Committee; Sao Paulo: 2014. p. 235-42.
- 2 Degoulet P. Hospital Information Systems.. In: Venot A, Burgun A, Quantin C. (eds). Medical Informatics, e-Health.. Paris: Springer-Verlag; 2014. p. 289-313.
- 3 HIMSS Analytics 2015. http://www.himssanalytics.org/home/index.aspx.
- 4 ONC 2013 http://www.healthit.gov/providers-professionals/how-attain-meaningful-use.
- 5 Hillestad R, Bigelow J, Bower A, Girosi F, Meili R, Scoville R. et al. Can electronic medical record systems transform health care? Potential health benefits, savings, and costs.. Health Aff (Millwood) 2005; 24 (Suppl. 05) 1103-17.
- 6 Walker J, Pan E, Johnston D, Adler-Mistein J, Bates D, Middleton B. The value of health care information exchange and interoperability.. Health Aff (Millwood) 2005 Jan-Jun;Suppl Web Exclusives:W5-10-W5-18.
- 7 Chaudry B, Wang J, Wu S, Maglione M, Mojica W, Roth E. et al. Systematic review: Impact of health information technology on quality, efficiency, and costs of medical care.. Ann Intern Med 2006; 144 (Suppl. 10) 742-52.
- 8 Meyer R, Degoulet P. Assessing the Capital Efficiency of Healthcare Information Technologies Investments: An Econometric Perspective: Yearb Med Inform. 2008: 114-27.
- 9 Payne T, Bates DW, Berner ES, Bernstam EV, Covvey HD, Frisse ME. et al. Healthcare information technology and economics.. J Am Med Inform Assoc 2013; 20: 212-217.
- 10 Bassi J, Lau F. Measuring value for money: a scoping review on economic evaluation of health information systems.. J Am Med Inform Assoc 2013; 20 (Suppl. 02) 792-801.
- 11 More T. De optimo rei publicae statu, deque nova insula Utopia “Of a republic’s best state and of the new island Utopia”.. Louvain: Thierry Martens; 1516
- 12 Degoulet P, Marin L, Lavril Le, Bozec C, Delbecke E, Meaux JJ. et al. The HEGP component-based clinical information system.. Int J Med Inform 2003; 69: 115-26.
- 13 Ammenwerth E, Mansmann U, Iller C, Eichstadter R. Factors affecting and affected by user acceptance of computer-based nursing documentation: results of a two-year study.. J Am Med Inform Assoc 2003; 10: 69-84.
- 14 Palm JM, Dart T, Dupuis I, Leneveut L, Degoulet P. Clinical information system post-adoption evaluation at the Georges Pompidou university hospital.. AMIA Annu Symp Proc 2010; 582-6.
- 15 Hadji B, Martin G, Dupuis I, Campoy E, Degoulet P. 14 Years longitudinal evaluation of clinical information systems acceptance.. Int J Med Inform 2016; 86: 20-9.
- 16 Hadji B, Degoulet P. Information sytem end-user satisfaction and continuance intention: A unified modeling approach.. J Biomed Inform 2016; 61: 185-93.
- 17 DeLone WH, McLean ER. The DeLone and McLean Model of Information Systems Success: A Ten-Year Update.. Journal of Management Information Systems 2003; 19c (Suppl. 04) 9-30.
- 18 Petter S, McLean ER. A meta-analytic assessment of the DeLone and McLean IS success model: An examination of IS success at the individual level.. Information & Management 2009; 46 (Suppl. 03) 159-66.
- 19 Davis F. Perceived usefulness, perceived ease of use, and user acceptance of information technology.. MIS Quarterly. 1989; 13: 319-40.
- 20 Lee YA, Kozar KA, Larsen KRT. The Technology Acceptance Model: Past, Present and Future.. Comm Assoc Inf Syst 2003; 12 (Suppl. 50) 752-80.
- 21 Venkatesh V, Morris M, Davis G. et al. User Acceptance of Information Technology: Toward a Unified View.. Manag Inf Syst Q 2003; 27: 425-78.
- 22 Bhattacherjee A. Understanding information systems continuance: an expectation-confirmation model.. MIS Quarterly 2001; 25 (Suppl. 03) 351-70.
- 23 Kline RB. Principles and practice of structural equation modeling.. Guilford Press; 2011
- 24 Sidorov J. It ain’t necessarily so: the electronic health record and the unlikely prospect of reducing health care costs.. Health Aff (Millwood) 2006; 25 (Suppl. 04) 1079-85.
- 25 Riskin L, Koppel R, Riskin D. Re-examining health IT policy: what will it take to derive value from our investments?. J Am Med Inform Assoc 2015; 22: 459-64.
- 26 CMS 2016.. National expenditures 2014 highlights.. Available at https://www.cms.gov/Research-Statistics-Data-and-Systems/Statistics-Trends-and-Reports/NationalHealthExpendData/Downloads/highlights.pdf [accessed January 5, 2016].
- 27 Koppel R, Lehmann CU. Implications of an emerging EHR monoculture for hospitals and healthcare systems.. J Am Med Inform Assoc 2015; 22 (Suppl. 02) 465-71.
- 28 Beard N, Elo K, Hitt LM, Housman MG, Mansfield G. Information technology and hospital performance: An econometric analysis of costs and quality.. PricewaterhouseCoopers; 2007 http://assets.wharton.upenn.edu/~housman/files/PwCWhitePaper.pdf.
- 29 Furukawa MF, Raghu TS, Shao BB. Electronic medical record and cost efficiency in hospital medical-surgical units.. Inquiry 2010; 20: 110-23.
- 30 Weiner JP, Kfuri T, Chan KC, Fowles JB. e-Iatro-genesis: the most critical unintended consequence of CPOE and other HIT.. J Am Med Inform Assoc 2007; 14: 387-88.
- 31 Koppel R, Metlay JP, Cohen A, Abaluck B, Localio AR, Kimmel SE. et al. Role of Computerized Physician Order Entry Systems in Facilitating Medication Errors.. JAMA 2005; 293 (Suppl. 10) 1197-203.
- 32 Ash JS, Sittig DF, Poon EG, Guappone K, Campbell E, Dykstra RH. The extent and importance of unintended consequence elated to computerized provider order entry.. J Am Med Inform Assoc 2007; 14 (Suppl. 04) 415-23.
- 33 Poissant L, Pereira J, Tamblyn R, Kawasumi Y. The impact of electronic health records on time efficiency of physicians and nurses: a systematic review.. J Am Med Inform Assoc 2005; 12 (Suppl. 05) 505-16.
- 34 Meyer R, Degoulet P, Omnes L. Impact of Health Care Information Technology on Hospital Productivity Growth: a Survey in 17 Acute University Hospitals.. Stud Health Technol Inform 2007; 129 (Suppl. 01) 203-7.
- 35 Hadji B, Meyer R, Mellikeche S, Escalon S, Degoulet P. Assessing the relationships between hospital resources and activities: a systematic review.. J Med Syst 2014; 38-127.
- 36 Farrell MJ. The Measurement of Productive Efficiency.. J R Stat Soc Ser Gen 1957; 120: 253-90.
- 37 Aigner D, Lovell CAK, Schmidt P. Formulation and estimation of stochastic frontier production function models.. J Econom 1977; 6: 21-37.
- 38 Rosko MD, Mutter RL. Stochastic frontier analysis of hospital inefficiency. A review of empirical issues and an assessment of robustness.. Med Care Res Rev 2008; 65 (Suppl. 02) 131-66.
- 39 Meyer R, Degoulet P. Choosing the right amount of healthcare information technologies investments.. Int J Med Inform 2010; 79: 235-31.
- 40 Kauskal R, Shojania KG, Bates DW. Effects of computerized physician order entry and clinical decision support systems on medication safety. A systematic review.. Arch Intern Med 2003; 163: 1409-16.
- 41 Garg AX, Adhikari NKJ, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J. et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcome. A systematic review.. JAMA 2005; 293 (Suppl. 10) 1223-38.
- 42 Murphy SN, Weber G, Mendis M, Chueh HC, Churchill S, Glaser JP. et al. Serving the Enterprise and beyond with Informatics for Integrating Biology and the Bedside (i2b2).. J Am Med Inform Assoc 2010; 17 (Suppl. 02) 124-30.
- 43 Zapletal E, Rodon E, Grabar N, Degoulet P. Methodology of integration of a clinical data warehouse with a clinical information system.. Stud Health Technol Inform 2010; 160 (Suppl. 01) 193-7.
- 44 Kho AN, Rasmussen LV, Connolly JJ, Peissig PL, Starren J, Hakonarson H. et al. Pratical challenges in integrating genomic data into the electronic health record.. Genet Med 2013; 15 (Suppl. 10) 772-8.
- 45 Canuel V, Rance B, Avillach P, Degoulet P, Burgun A. Translational Research Platforms Integrating Clinical and Omics Data: a Review of Publicly Available Solutions.. Brief Bioinform 2015; 16 (Suppl. 02) 280-90.
- 46 Rance B, Canuel V, Countouris H, Laurent-Puig P, Burgun A. Integrating Heterogeneous Biomedical Data for Cancer Research: the CARPEM infrastructure.. Appl Clin Inform 2016; 7 (Suppl. 02) 260-74.
- 47 Caruba T, Colombet I, Gillaizeau F, Bruni V, Korb V, Prognon P. et al. Chronology of prescribing error during the hospital stay and prediction of pharmacist’s alerts overriding: a prospective analysis.. BMC Health Serv Res 2010; Jan 12 10: 13.
- 48 Berdot S, Sabatier B, Gillaizeau F, Caruba T, Durieux P. Evaluation of drug administration errors in a teaching hospital.. BMC Health Serv Res 2012; 12: 60.
- 49 Sellier E, Colombet I, Sabatier B, Breton G, Nies J, Zapletal E. et al. Effect of alerts for drug dosage adjustments in inpatients with renal insufficiency.. J Am Med Inform Assoc 2009; 16: 203-10.
- 50 Estellat C, Colombet I, Vautier S, Huault-Quentel Durieux P, Sabatier B. Impact of pharmacy validation in a computerized physician order entry context.. Int J Qual Health Care 2007; 9 (Suppl. 05) 317-25.
- 51 Girardeau Y, Trivin C, Durieux P, Le Beller C, Louet Agnes LL. et al. Detection of Drug-Drug Interactions Inducing Acute Kidney Injury by Electronic Health Records Mining.. Drug Saf 2015; 38 (Suppl. 09) 799-809.
- 52 Boussadi A, Caruba T, Zapletal E, Sabatier B, Durieux P, Degoulet P. A clinical data warehouse-based process for refining medication orders alerts.. J Am Med Inform Assoc 2012; 19 (Suppl. 05) 782-5.
- 53 McDowell I. Measuring Health.. 3rd Edition. New York: Oxford University Press; 2006
- 54 Welch WP, Bazarko D, Ritten K, Burgess Y, Harmon R, Sandy LG. Electronic health records in four community physician practice: impact on quality and cost of care.. J Am Med Inform Assoc 2007; 14: 320-8.
- 55 Zhou L, Soran C, Jenter CA, Volk LA, Orav EJ, Bates DW. et al. The relationship between electronic record use and quality of care over time.. J Am Med Inform Assoc 2009; 16 (Suppl. 04) 457-64.
- 56 Ancker JA, Kern LM, Edwards A. et al. Association between healthcare quality and use of electronic health record functions in ambulatory care.. J Am Med Inform Assoc 2015; 22: 864-71.
- 57 Mekhjian Kumar RR, Kuehn L, Bentley TD, Teater P, Thomas A. et al. Immediate benefits realized following implementation of physician order entry at an academic medical center.. J Am Med Inform Assoc 2002; 9: 529-39.
- 58 Kuperman GJ, Gibson RF. Computer physician order entry: benefits, costs, and issues.. Ann Intern Med 2003; 139: 31-9.
- 59 Wright A, Feblowitz J, Samal L, McCoy B, Sittig DF. The Medicare electronic health record incentive program: provider performance on core and menu measures.. Health Serv Res 2014; 49 (Suppl. 02) 325-46.
- 60 Roski J, McClellan M. Measuring health care performance now, not tomorrow; essential steps to support effective health reform.. Health Aff (Millwood) 2011; 30: 682-9.
- 61 Garrido T, Kumar S, Lekas J, Lindberg M, Kadiyala D, Whippy A. et al. e-Measures: insight into the challenges and opportunities of automating publicly reported quality measures.. J Am Med Inform Assoc 2014; 21: 181-4.