Longitudinal Evaluation of Clinical Decision Support to Improve Influenza Vaccine Uptake in an Integrated Pediatric Health Care Delivery System, Houston, Texas

Abstract

Objective Our study retrospectively evaluated the implementation of an influenza vaccine best practice alert (BPA) in an electronic medical record within an integrated pediatric health care delivery system.

Methods An influenza BPA was implemented throughout a large pediatric health care delivery system in Houston, TX, to improve vaccine uptake. Outcomes were measured retrospectively over 3 years of BPA implementation and compared with a control year prior to BPA implementation. Primary outcomes were influenza vaccine uptake, distribution of influenza vaccines ordered by week, proportion of BPA displays ignored, and missed vaccination opportunities.

Results Influenza vaccine uptake declined from the pre-BPA year (47.2%; 95% confidence interval [CI]: 47.0, 47.4) to the last study year (45.1%; 95% CI: 44.9, 45.2). BPA displays were increasingly ignored by clinical staff throughout the study years from 59.6% in 2014–2015 to 72.5% in 2016–2017. For providers, BPA displays were ignored less frequently each year from 53.4% in 2014–2015 to 51.4% in 2017–2017. Within the primary care outpatient group, the proportion of missed vaccination opportunities in sick visits decreased from 86.8% during the pre-BPA year to 81.0, 79.8, and 82.7% during the subsequent study years 2014–2015, 2015–2016, and 2016–2017, respectively.

Conclusion Implementation of a widespread influenza BPA in an integrated pediatric health care delivery system did not produce meaningful increases in influenza vaccine uptake. Differences between clinical staff and providers on BPA use warrant further investigation.

Keywords

best practice alert - influenza vaccine - clinical decision support - vaccine uptake

Protection of Human and Animal Subjects

This study was performed in compliance with the World Medical Association Declaration of Helsinki on Ethical Principles for Medical Research Involving Human Subjects, and was reviewed by the Baylor College of Medicine Institutional Review Board.

• References

• 1 Rolfes MA, Foppa IM, Garg S. , et al. Estimated Influenza Illnesses, Medical Visits, Hospitalizations, and Deaths Averted by Vaccination in the United States. December 9, 2016. Available at: https://www.cdc.gov/flu/about/disease/2015-16.htm . Accessed December 18, 2018
• 2 Summary of the 2017–2018 Influenza Season. The Centers for Disease Control and Prevention. November 2018. Available at: https://www.cdc.gov/flu/about/season/flu-season-2017-2018.htm . Accessed January 25, 2019
• 3 Grohskopf LA, Sokolow LZ, Broder KR, Walter EB, Fry AM, Jernigan DB. Prevention and control of seasonal influenza with vaccines: recommendations of the Advisory Committee on Immunization Practices-United States, 2018-19 Influenza Season. MMWR Recomm Rep 2018; 67 (3, No. RR-3): 1-20
• 4 Committee on Infectious Diseases. Recommendations for prevention and control of influenza in children, 2018-2019. Pediatrics 2018; 142 (04) e20182367
• 5 Estimates of Flu Vaccination Coverage Among Children – United States. 2017–2018 Flu Season. FluView. The Centers for Disease Control and Prevention. October 2018. Available at: https://www.cdc.gov/flu/fluvaxview/coverage-1718estimates-children.htm . Accessed January 25, 2019
• 6 Immunization and Infectious Diseases. Healthy People 2020. June 2017. Available at: https://www.healthypeople.gov/2020/topics-objectives/topic/immunization-and-infectious-diseases . Accessed June 19, 2017
• 7 Charles D, Gabriel M, Searcy T. Adoption of electronic health record systems among U.S. non-federal acute care hospitals: 2008–2014. The Office of the National Coordinator for Health Information Technology. ONC Data Brief 2015; 23: 1-10
• 8 Sisk B, Kirkendall E, Krams L, Schneider JH, Lehmann CU. Trends in EHR adoption and attitudes among pediatricians, 2009–2016. Paper presented at: 2017 Pediatric Academic Societies Annual Meeting; May 6, 2017. Available at: https://www.aap.org/en-us/professional-resources/Research/research-findings/Pages/Trends-in-EHR-Adoption-and-Attitudes-among-Pediatricians-2009-2016.aspx . Accessed July 2017
• 9 Birmingham E, Catallozzi M, Findley SE, Vawdrey DK, Kukafka R, Stockwell MS. FluAlert: a qualitative evaluation of providers' desired characteristics and concerns regarding computerized influenza vaccination alerts. Prev Med 2011; 52 (3-4): 274-277
• 10 Bundy DG, Persing NM, Solomon BS. , et al. Improving immunization delivery using an electronic health record: the ImmProve project. Acad Pediatr 2013; 13 (05) 458-465
• 11 Szilagyi PG, Serwint JR, Humiston SG. , et al. Effect of provider prompts on adolescent immunization rates: a randomized trial. Acad Pediatr 2015; 15 (02) 149-157
• 12 Stockwell MS, Catallozzi M, Camargo S. , et al. Registry-linked electronic influenza vaccine provider reminders: a cluster-crossover trial. Pediatrics 2015; 135 (01) e75-e82
• 13 Ruffin IV MT, Plegue MA, Rockwell PG, Young AP, Patel DA, Yeazel MW. Impact of an electronic health record (EHR) reminder on human papillomavirus (HPV) vaccine initiation and timely completion. J Am Board Fam Med 2015; 28 (03) 324-333
• 14 Fiks AG, Grundmeier RW, Biggs LM, Localio AR, Alessandrini EA. Impact of clinical alerts within an electronic health record on routine childhood immunization in an urban pediatric population. Pediatrics 2007; 120 (04) 707-714
• 15 Fiks AG, Grundmeier RW, Mayne S. , et al. Effectiveness of decision support for families, clinicians, or both on HPV vaccine receipt. Pediatrics 2013; 131 (06) 1114-1124
• 16 Fiks AG, Hunter KF, Localio AR. , et al. Impact of electronic health record-based alerts on influenza vaccination for children with asthma. Pediatrics 2009; 124 (01) 159-169
• 17 Olmstead MG, Geisen E, Murphy J, Bell D, Morley M, Stanley M. Methodology: U.S. News and World Report Best Children's Hospitals 2015–2016. Research Triangle Institute. June 17, 2015. ES-1- D-2. Available at: https://www.usnews.com/pubfiles/BH2015-16MethodologyReport.pdf . Accessed July 2017
• 18 10 Steps to Implementing Standing Orders for Immunization in Your Practice Setting. July 2019. Immunization Action Coalition. Available at: http://www.immunize.org/catg.d/p3067.pdf . Accessed August 18, 2019
• 19 Immunization Strategies for Healthcare Practices and Providers. Centers for Disease Control and Prevention. May 2018. Available at: https://www.cdc.gov/vaccines/pubs/pinkbook/strat.html . Accessed August 18, 2019
• 20 Ledwich LJ, Harrington TM, Ayoub WT, Sartorius JA, Newman ED. Improved influenza and pneumococcal vaccination in rheumatology patients taking immunosuppressants using an electronic health record best practice alert. Arthritis Rheum 2009; 61 (11) 1505-1510
• 21 Steitz BD, Weinberg ST, Danciu I, Unertl KM. Managing and communicating operational workflow: designing and implementing an electronic outpatient whiteboard. Appl Clin Inform 2016; 7 (01) 59-68
• 22 Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ 2005; 330 (7494): 765
• 23 Wright A, Sittig DF, Ash JS. , et al. Governance for clinical decision support: case studies and recommended practices from leading institutions. J Am Med Inform Assoc 2011; 18 (02) 187-194
• 24 Bates DW, Kuperman GJ, Wang S. , et al. Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc 2003; 10 (06) 523-530
• 25 2017–2018 National Immunization Survey Seasonal Influenza. Texas Department of State Health Services. January 16, 2019. Available at: https://www.dshs.texas.gov/immunize/coverage/NIS/National-Immunization-Survey-Flu-(NIS-Flu)/#Vaccination-Levels . Accessed July 23, 2019