Sustained Effect of Clinical Decision Support for Heart Failure: A Natural Experiment Using Implementation Science

Abstract

Objectives In a randomized controlled trial, we found that applying implementation science (IS) methods and best practices in clinical decision support (CDS) design to create a locally customized, “enhanced” CDS significantly improved evidence-based prescribing of β blockers (BB) for heart failure compared with an unmodified commercially available CDS. At trial conclusion, the enhanced CDS was expanded to all sites. The purpose of this study was to evaluate the real-world sustained effect of the enhanced CDS compared with the commercial CDS.

Methods In this natural experiment of 28 primary care clinics, we compared clinics exposed to the commercial CDS (preperiod) to clinics exposed to the enhanced CDS (both periods). The primary effectiveness outcome was the proportion of alerts resulting in a BB prescription. Secondary outcomes included patient reach and clinician adoption (dismissals).

Results There were 367 alerts for 183 unique patients and 171 unique clinicians (pre: March 2019–August 2019; post: October 2019–March 2020). The enhanced CDS increased prescribing by 26.1% compared with the commercial (95% confidence interval [CI]: 17.0–35.1%), which is consistent with the 24% increase in the previous study. The odds of adopting the enhanced CDS was 81% compared with 29% with the commercial (odds ratio: 4.17, 95% CI: 1.96–8.85). The enhanced CDS adoption and effectiveness rates were 62 and 14% in the preperiod and 92 and 10% in the postperiod.

Conclusion Applying IS methods with CDS best practices was associated with improved and sustained clinician adoption and effectiveness compared with a commercially available CDS tool.

Keywords

clinical decision support systems - heart failure - prescribing - PRISM - RE-AIM - implementation science

Protection of Human and Animal Subjects

The study was reviewed by the Institutional Review Board and deemed exempt and a full waiver of Health Insurance Portability and Accountability Act authorization was approved.

Publikationsverlauf

Eingereicht: 05. Mai 2023

Angenommen: 02. August 2023

Artikel online veröffentlicht:
18. Oktober 2023

• References

• 1 Poole-Wilson PA, Swedberg K, Cleland JGF. et al; Carvedilol Or Metoprolol European Trial Investigators. Comparison of carvedilol and metoprolol on clinical outcomes in patients with chronic heart failure in the Carvedilol Or Metoprolol European Trial (COMET): randomised controlled trial. Lancet 2003; 362 (9377): 7-13
• 2 Lechat P. The Cardiac Insufficiency Bisoprolol Study (CIBIS). CIBIS Investigators and Committees. A randomized trial of beta-blockade in heart failure. Circulation 1994; 90 (04) 1765-1773
• 3 Goldstein S, Fagerberg B, Hjalmarson A. et al; MERIT-HF Study Group. Metoprolol controlled release/extended release in patients with severe heart failure: analysis of the experience in the MERIT-HF study. J Am Coll Cardiol 2001; 38 (04) 932-938
• 4 Packer M, Bristow MR, Cohn JN. et al; U.S. Carvedilol Heart Failure Study Group. The effect of carvedilol on morbidity and mortality in patients with chronic heart failure. N Engl J Med 1996; 334 (21) 1349-1355
• 5 Packer M, Coats AJ, Fowler MB. et al; Carvedilol Prospective Randomized Cumulative Survival Study Group. Effect of carvedilol on survival in severe chronic heart failure. N Engl J Med 2001; 344 (22) 1651-1658
• 6 Ponikowski P, Voors AA, Anker SD. et al; ESC Scientific Document Group. 2016 ESC Guidelines for the diagnosis and treatment of acute and chronic heart failure: the Task Force for the diagnosis and treatment of acute and chronic heart failure of the European Society of Cardiology (ESC) Developed with the special contribution of the Heart Failure Association (HFA) of the ESC. Eur Heart J 2016; 37 (27) 2129-2200
• 7 McDonagh TA, Metra M, Adamo M. et al; ESC Scientific Document Group. 2021 ESC guidelines for the diagnosis and treatment of acute and chronic heart failure. Eur Heart J 2021; 42 (36) 3599-3726
• 8 Yancy CW, Jessup M, Bozkurt B. et al. 2017 ACC/AHA/HFSA focused update of the 2013 ACCF/AHA guideline for the management of heart failure: a report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines and the Heart Failure Society of America. Circulation 2017; 136 (06) e137-e161
• 9 Heidenreich PA, Bozkurt B, Aguilar D. et al. 2022 AHA/ACC/HFSA guideline for the management of heart failure: a report of the American College of Cardiology/American Heart Association Joint Committee on Clinical Practice Guidelines. Circulation 2022; 145 (18) e895-e1032
• 10 Greene SJ, Butler J, Albert NM. et al. Medical therapy for heart failure with reduced ejection fraction: the CHAMP-HF registry. J Am Coll Cardiol 2018; 72 (04) 351-366
• 11 Allen LA, Venechuk G, McIlvennan CK. et al. An electronically delivered patient-activation tool for intensification of medications for chronic heart failure with reduced ejection fraction: the EPIC-HF trial. Circulation 2021; 143 (05) 427-437
• 12 Bhatt AS, Varshney AS, Nekoui M. et al. Virtual optimization of guideline-directed medical therapy in hospitalized patients with heart failure with reduced ejection fraction: the IMPLEMENT-HF pilot study. Eur J Heart Fail 2021; 23 (07) 1191-1201
• 13 Get With The Guidelines - Heart Failure | American Heart Association. Accessed April 22, 2022 at: https://www.heart.org/en/professional/quality-improvement/get-with-the-guidelines/get-with-the-guidelines-heart-failure
• 14 Kao DP, Trinkley KE, Lin CT. Heart failure management innovation enabled by electronic health records. JACC Heart Fail 2020; 8 (03) 223-233
• 15 Mukhopadhyay A, Reynolds HR, Phillips LM. et al. Cluster-randomized trial comparing ambulatory decision support tools to improve heart failure care. J Am Coll Cardiol 2023; 81 (14) 1303-1316
• 16 Ghazi L, Yamamoto Y, Riello RJ. et al. Electronic alerts to improve heart failure therapy in outpatient practice: a cluster randomized trial. J Am Coll Cardiol 2022; 79 (22) 2203-2213
• 17 Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ 2005; 330 (7494): 765
• 18 Tierney WM, Overhage JM, Murray MD. et al. Effects of computerized guidelines for managing heart disease in primary care. J Gen Intern Med 2003; 18 (12) 967-976
• 19 Blecker S, Austrian JS, Horwitz LI. et al. Interrupting providers with clinical decision support to improve care for heart failure. Int J Med Inform 2019; 131: 103956
• 20 Bates DW, Kuperman GJ, Wang S. et al. Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc 2003; 10 (06) 523-530
• 21 Osheroff J, Teich J, Levick D, Saldana L, Velasco F, Sittig D. Improving Outcomes with Clinical Decision Support: An Implementers Guide. 2nd ed.. Healthcare Information Management Systems Society (HIMSS); 2012
• 22 Horsky J, Schiff GD, Johnston D, Mercincavage L, Bell D, Middleton B. Interface design principles for usable decision support: a targeted review of best practices for clinical prescribing interventions. J Biomed Inform 2012; 45 (06) 1202-1216
• 23 Sittig DF, Wright A, Osheroff JA. et al. Grand challenges in clinical decision support. J Biomed Inform 2008; 41 (02) 387-392
• 24 Trinkley KE, Kahn MG, Bennett TD. et al. An implementation science approach to clinical decision support within electronic health records: integrating PRISM with CDS design best practices (preprint). J Med Internet Res 2020; 22 (10) e19676
• 25 Brownson R, Colditz G, Proctor E. Dissemination and Implementation Research in Health: Translating Science to Practice. 2nd ed.. Oxford University Press; 2018
• 26 Kwan BM, Brownson RC, Glasgow RE, Morrato EH, Luke DA. Designing for dissemination and sustainability to promote equitable impacts on health. Annu Rev Public Health 2022; 43 (01) 331-353
• 27 Shelton RC, Lee M. Sustaining evidence-based interventions and policies: recent innovations and future directions in implementation science. Am J Public Health 2019; 109 (S2): S132-S134
• 28 Shelton RC, Chambers DA, Glasgow RE. An extension of RE-AIM to enhance sustainability: addressing dynamic context and promoting health equity over time. Front Public Health 2020; 8: 134
• 29 Tabak RG, Khoong EC, Chambers D, Brownson RC. Models in dissemination and implementation research: useful tools in public health services and systems research. 2013. Accessed March 18, 2015 at: http://uknowledge.uky.edu/cgi/viewcontent.cgi?article=1012&context=frontiersinphssr&sei-redir=1&referer=http://www.bing.com/search?q=Models+in+dissemination+and+implementationresearch%3A+useful+tools+in+public+health+services+andsystems+research&form=DLRD
• 30 Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med 2012; 43 (03) 337-350
• 31 Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci 2015; 10: 53
• 32 Feldstein AC, Glasgow RE. A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Jt Comm J Qual Patient Saf 2008; 34 (04) 228-243
• 33 Rabin BA, Cakici J, Golden CA, Estabrooks PA, Glasgow RE, Gaglio B. A citation analysis and scoping systematic review of the operationalization of the Practical, Robust Implementation and Sustainability Model (PRISM). Implement Sci 2022; 17 (01) 62
• 34 Trinkley KE, Kahn MG, Bennett TD. et al. Integrating the practical robust implementation and sustainability model with best practices in clinical decision support design: implementation science approach. J Med Internet Res 2020; 22 (10) e19676
• 35 Trinkley KE, Kroehl ME, Kahn MG. et al. Applying clinical decision support design best practices with the practical robust implementation and sustainability model versus reliance on commercially available clinical decision support tools: randomized controlled trial. JMIR Med Inform 2021; 9 (03) e24359
• 36 Glasgow RE, Harden SM, Gaglio B. et al. RE-AIM planning and evaluation framework: adapting to new science and practice with a 20-year review. Front Public Health 2019; 7 (MAR): 64
• 37 Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health 1999; 89 (09) 1322-1327
• 38 Lewinski AA, Crowley MJ, Miller C. et al. Applied rapid qualitative analysis to develop a contextually appropriate intervention and increase the likelihood of uptake. Med Care 2021; 59 (Suppl. 03) S242-S251
• 39 Desai S, Roberts E. Leveraging natural experiments to evaluate interventions in learning health systems. BMJ Qual Saf 2021; 30 (03) 183-185
• 40 Nanji KC, Slight SP, Seger DL. et al. Overrides of medication-related clinical decision support alerts in outpatients. J Am Med Inform Assoc 2014; 21 (03) 487-491
• 41 Poly TN, Islam MM, Yang HC, Li YJ. Appropriateness of overridden alerts in computerized physician order entry: systematic review. JMIR Med Inform 2020; 8 (07) e15653
• 42 Stettner S, Adie S, Hanigan S, Thomas M, Pogue K, Zimmerman C. Effect of replacing vendor QTc alerts with a custom QTc risk alert in inpatients. Appl Clin Inform 2022; 13 (01) 19-29
• 43 Green LA, Nease Jr D, Klinkman MS. Clinical reminders designed and implemented using cognitive and organizational science principles decrease reminder fatigue. J Am Board Fam Med 2015; 28 (03) 351-359
• 44 Shakowski C, Page Ii RL, Wright G. et al. Comparative effectiveness of generic commercial versus locally customized clinical decision support tools to reduce prescription of nonsteroidal anti-inflammatory drugs for patients with heart failure. J Am Med Inform Assoc 2023; ocad109
• 45 Rabin B, Brownson R. Developing terminology for dissemination and implementation research. In: Brownson R, Colditz G, Proctor EK. eds. Dissemination and Implementation Research in Health. 2nd ed.. Oxford University Press; 2018: 19-45
• 46 Craig P, Cooper C, Gunnell D. et al. Using natural experiments to evaluate population health interventions: new Medical Research Council guidance. J Epidemiol Community Health 2012; 66 (12) 1182-1186
• 47 Nadkarni PM. Drug safety surveillance using de-identified EMR and claims data: issues and challenges. J Am Med Inform Assoc 2010; 17 (06) 671-674
• 48 Carrell DS, Schoen RE, Leffler DA. et al. Challenges in adapting existing clinical natural language processing systems to multiple, diverse health care settings. J Am Med Inform Assoc 2017; 24 (05) 986-991
• 49 Huebschmann AG, Trinkley KE, Gritz M, Glasgow RE. Pragmatic considerations and approaches for measuring staff time as an implementation cost in health systems and clinics: key issues and applied examples. Implement Sci Commun 2022; 3 (01) 44
• 50 Sanyal J, Rubin D, Banerjee I. A weakly supervised model for the automated detection of adverse events using clinical notes. J Biomed Inform 2022; 126: 103969
• 51 Dev S, Hoffman TK, Kavalieratos D. et al. Barriers to adoption of mineralocorticoid receptor antagonists in patients with heart failure: a mixed-methods study. J Am Heart Assoc 2016; 5 (03) e002493