Heart Failure Dashboard Design and Validation to Improve Care of Veterans

Abstract

Background Early electronic identification of patients at the highest risk for heart failure (HF) readmission presents a challenge. Data needed to identify HF patients are in a variety of areas in the electronic medical record (EMR) and in different formats.

Objective The purpose of this paper is to describe the development and data validation of a HF dashboard that monitors the overall metrics of outcomes and treatments of the veteran patient population with HF and enhancing the use of guideline-directed pharmacologic therapies.

Methods We constructed a dashboard that included several data points: care assessment need score; ejection fraction (EF); medication concordance; laboratory tests; history of HF; and specified comorbidities based on International Classification of Disease (ICD), ninth and tenth codes. Data validation testing with user test scripts was utilized to ensure output accuracy of the dashboard. Nine providers and key senior management participated in data validation.

Results A total of 43 medical records were reviewed and 66 HF dashboard data discrepancies were identified during development. Discrepancies identified included: generation of multiple EF values on a few patients, missing or incorrect ICD codes, laboratory omission, incorrect medication issue dates, patients incorrectly noted as nonconcordant for medications, and incorrect dates of last cardiology appointments. Continuous integration and builds identified defects—an important process of the verification and validation of biomedical software. Data validation and technical limitations are some challenges that were encountered during dashboard development. Evaluations by testers and their focused feedback contributed to the lessons learned from the challenges.

Conclusion Continuous refinement with input from multiple levels of stakeholders is crucial to development of clinically useful dashboards. Extraction of all relevant information from EMRs, including the use of natural language processing, is crucial to development of dashboards that will help improve care of individual patients and populations.

Keywords

predictive analytics - decision support - dashboard - heart failure - population metrics

Authors' Contributions

All authors meet the requirements for authorship and manuscript submission.

Protection of Human and Animal Subjects

This project was approved and given nonresearch designation by the VISN 1 Research and Development committee.

• References

• 1 Yancy CW, Jessup M, Bozkurt B. , et al. 2013 ACCF/AHA guideline for the management of heart failure: executive summary: a report of the American College of Cardiology Foundation/American Heart Association Task Force on practice guidelines. Circulation 2013; 128 (16) 1810-1852
• 2 Mozaffarian D, Benjamin EJ, Go AS. , et al; American Heart Association Statistics Committee and Stroke Statistics Subcommittee. Heart disease and stroke statistics--2015 update: a report from the American Heart Association. Circulation 2015; 131 (04) e29-e322
• 3 CMS. National summary of inpatient charge data by Medicare severity diagnosis related group (MS-DRG), FY2016. 7500 Security Boulevard, Baltimore, MD 21244: Centers for Medicare & Medicaid Services. Available at: https://data.cms.gov/Medicare-Inpatient/National-Summary-of-Inpatient-Charge-Data-by-Medic/sfua-yggc . Accessed August 14, 2018
• 4 Nuti SV, Qin L, Rumsfeld JS. , et al. Association of admission to veterans affairs hospitals vs non-veterans affairs hospitals with mortality and readmission rates among older men hospitalized with acute myocardial infarction, heart failure, or pneumonia. JAMA 2016; 315 (06) 582-592
• 5 Zulman DM, Pal Chee C, Wagner TH. , et al. Multimorbidity and healthcare utilisation among high-cost patients in the US veterans affairs health care system. BMJ Open 2015; 5 (04) e007771
• 6 Chapko MK, Liu CF, Perkins M, Li YF, Fortney JC, Maciejewski ML. Equivalence of two healthcare costing methods: bottom-up and top-down. Health Econ 2009; 18 (10) 1188-1201
• 7 Krishnamurthi N, Francis J, Fihn SD, Meyer CS, Whooley MA. Leading causes of cardiovascular hospitalization in 8.45 million US veterans. PLoS ONE 2018; 13 (03) e0193996
• 8 Jones LG, Sin M-K, Hage FG. , et al. Characteristics and outcomes of patients with advanced chronic systolic heart failure receiving care at the Veterans Affairs versus other hospitals: insights from the Beta-blocker Evaluation of Survival Trial (BEST). Circ Heart Fail 2015; 8 (01) 17-24
• 9 Silanskas G, Bergman CL, Kaplan BJ. Factors affecting heart failure readmission rates in VA patients. Fed Pract 2014; 31 (11) 14-20
• 10 Assari S. Veterans and risk of heart disease in the United States: a cohort with 20 years of follow up. Int J Prev Med 2014; 5 (06) 703-709
• 11 Brown AD, Antonius D, Kramer M, Root JC, Hirst W. Trauma centrality and PTSD in veterans returning from Iraq and Afghanistan. J Trauma Stress 2010; 23 (04) 496-499
• 12 Findley P, Shen C, Sambamoorthi U. Multimorbidity and persistent depression among veterans with diabetes, heart disease, and hypertension. Health Soc Work 2011; 36 (02) 109-119
• 13 Yoon J, Zulman D, Scott JY, Maciejewski ML. Costs associated with multimorbidity among VA patients. Med Care 2014; 52 (03) (Suppl. 03) S31-S36
• 14 Reese RL, Clement SA, Syeda S. , et al. Coordinated-transitional care for veterans with heart failure and chronic lung disease. J Am Geriatr Soc 2019; 67 (07) 1502-1507
• 15 Paquin AM, Salow M, Rudolph JL. Pharmacist calls to older adults with cognitive difficulties after discharge in a Tertiary Veterans Administration Medical Center: a quality improvement program. J Am Geriatr Soc 2015; 63 (03) 571-577
• 16 Rebello KE, Gosian J, Salow M, Sweeney P, Rudolph JL, Driver JA. The Rural PILL Program: a postdischarge telepharmacy intervention for rural veterans. J Rural Health 2017; 33 (03) 332-339
• 17 Cox ZL, Lewis CM, Lai P, Lenihan DJ. Validation of an automated electronic algorithm and “dashboard” to identify and characterize decompensated heart failure admissions across a medical center. Am Heart J 2017; 183: 40-48
• 18 Carmichael JM, Meier J, Robinson A, Taylor J, Higgins DT, Patel S. Leveraging electronic medical record data for population health management in the Veterans Health Administration: successes and lessons learned. Am J Health Syst Pharm 2017; 74 (18) 1447-1459
• 19 Nelson O, Sturgis B, Gilbert K. , et al. A visual analytics dashboard to summarize serial anesthesia records in pediatric radiation treatment. Appl Clin Inform 2019; 10 (04) 563-569
• 20 Adams SL. IT dashboard reduces high-dose opioid prescriptions among Veterans. O & P News; . Available at: https://www.healio.com/psychiatry/addiction/news/online/%7B7bcb7dcd-e538-4da8-8685-2429bf93c852%7D/it-dashboard-reduces-high-dose-opioid-prescriptions-among-veterans . Accessed July 2015
• 21 Lau MK, Bounthavong M, Kay CL, Harvey MA, Christopher MLD. Clinical dashboard development and use for academic detailing in the U.S. Department of Veterans Affairs. J Am Pharm Assoc (2003) 2019; 59 (2s): S96-S103
• 22 Garg AX, Adhikari NK, McDonald H. , et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA 2005; 293 (10) 1223-1238
• 23 Osheroff JA, Teich JM, Middleton B, Steen EB, Wright A, Detmer DE. A roadmap for national action on clinical decision support. J Am Med Inform Assoc 2007; 14 (02) 141-145
• 24 Smith MW, Brown C, Virani SS. , et al. Incorporating guideline adherence and practice implementation issues into the design of decision support for beta-blocker titration for heart failure. Appl Clin Inform 2018; 9 (02) 478-489
• 25 Byrd RJ, Steinhubl SR, Sun J, Ebadollahi S, Stewart WF. Automatic identification of heart failure diagnostic criteria, using text analysis of clinical notes from electronic health records. Int J Med Inform 2014; 83 (12) 983-992
• 26 Pakhomov S, Weston SA, Jacobsen SJ, Chute CG, Meverden R, Roger VL. Electronic medical records for clinical research: application to the identification of heart failure. Am J Manag Care 2007; 13 (6 Part 1): 281-288
• 27 Shivade C, Raghavan P, Fosler-Lussier E. , et al. A review of approaches to identifying patient phenotype cohorts using electronic health records. J Am Med Inform Assoc 2014; 21 (02) 221-230
• 28 Son CS, Kim YN, Kim HS, Park HS, Kim MS. Decision-making model for early diagnosis of congestive heart failure using rough set and decision tree approaches. J Biomed Inform 2012; 45 (05) 999-1008
• 29 VHA OoRaD. VA Quality Enhancement Research Initiative (QUERI) Strategic Plan 2016–2020. Available at: https://www.queri.research.va.gov/about/strategic_plans/QUERIStrategicPlan.pdf . Accessed January 9, 2020
• 30 Schmidt J, Weyrauch K. Getting ‘agile’ with medical device development. Biomed Instrum Technol 2013; 47 (03) 221-223
• 31 Department of Veterans A. Patient Aligned Care Team (PACT) Handbook. Washington, DC 20420: Department of Veterans Affairs, Veterans Health Administration; 1101.10(1). Available at: http://docplayer.net/15987660-Department-of-veterans-affairs-vha-handbook-1101-10-washington-dc-20420-february-5-2014-patient-aligned-care-team-pact-handbook.html . Accessed February 5, 2014
• 32 Bonow RO, Ganiats TG, Beam CT. , et al; American Academy of Family Physicians; American Academy of Hospice and Palliative Medicine; American Nurses Association; American Society of Health-System Pharmacists; Heart Rhythm Society; Society of Hospital Medicine; ACCF/AHA Task Force on Performance Measures. ACCF/AHA/AMA-PCPI 2011 performance measures for adults with heart failure: a report of the American College of Cardiology Foundation/American Heart Association Task Force on Performance Measures and the American Medical Association-Physician Consortium for Performance Improvement. J Am Coll Cardiol 2012; 59 (20) 1812-1832
• 33 Update on the Care Assessment Need Score – CAN 2.0 and the Patient Care Assessment System (PCAS) [Webinar]. Virtual2016. Available at: https://www.hsrd.research.va.gov/for_researchers/cyber_seminars/archives/video_archive.cfm?SessionID=1088 . Accessed January 9, 2020
• 34 Wang L, Porter B, Maynard C. , et al. Predicting risk of hospitalization or death among patients receiving primary care in the Veterans Health Administration. Med Care 2013; 51 (04) 368-373
• 35 Yancy CW, Jessup M, Bozkurt B. , et al. 2017 ACC/AHA/HFSA focused update of the 2013 ACCF/AHA Guideline for the management of heart failure: a report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines and the Heart Failure Society of America. J Am Coll Cardiol 2017; 70 (06) 776-803
• 36 Dowding D, Merrill JA. The development of heuristics for evaluation of dashboard visualizations. Appl Clin Inform 2018; 9 (03) 511-518
• 37 Ahmed R, Toscos T, Rohani Ghahari R. , et al. Visualization of cardiac implantable electronic device data for older adults using participatory design. Appl Clin Inform 2019; 10 (04) 707-718
• 38 Dowding D, Randell R, Gardner P. , et al. Dashboards for improving patient care: review of the literature. Int J Med Inform 2015; 84 (02) 87-100
• 39 Patel J, Sandhu A, Parizo J, Moayedi Y, Fonarow GC, Heidenreich PA. Validity of performance and outcome measures for heart failure. Circ Heart Fail 2018; 11 (09) e005035
• 40 Schleyer TKL, Rahurkar S, Baublet AM. , et al; FHIR Development Team. Preliminary evaluation of the Chest Pain Dashboard, a FHIR-based approach for integrating health information exchange information directly into the clinical workflow. AMIA Jt Summits Transl Sci Proc 2019; 2019: 656-664