Visual Evidence: Increasing Usability of Systematic Reviews in Health Systems Guidelines Development

Abstract

Background Integration of evidence from systematic reviews is an essential step in the development of clinical guidelines. The current practice for reporting uses a static structure that does not allow for dynamic investigation. A need exists for an alternate reporting modality to facilitate dynamic visualization of results to match different end-users' queries.

Objectives We developed a dynamic visualization of data from a systematic review using the commercial product Tableau and assessed its potential to permit customized inquiries.

Methods Data were selected and extracted from a previously completed systematic review. The resulting dataset was then used to develop an interactive, web-based report designed for use by a guidelines development committee.

Results A novel example of combining existing reporting standards for systematic review data and modern reporting tools was developed to investigate potential benefits of a dynamic report. Demonstrations of the report to clinicians sitting on previous and future guideline committees received positive feedback for its potential benefit in guidelines development. The report received a runner-up award during the design challenge at the 2018 Workshop on Visual Analytics in Health Care.

Conclusion The use of interactive, accessible data may increase the use of systematic reviews and aid decision makers in developing evidence-based practice changes.

Keywords

data visualization - clinical informatics - clinical practice guidelines - systematic reviews - data access - integration and analysis - evidence-based medicine and nursing - guidelines and protocols - evaluation

• References

• 1 Chan KS, Morton SC, Shekelle PG. Systematic reviews for evidence-based management: how to find them and what to do with them. Am J Manag Care 2004; 10 (11 Pt 1): 806-812
• 2 Langendam MW, Akl EA, Dahm P, Glasziou P, Guyatt G, Schünemann HJ. Assessing and presenting summaries of evidence in Cochrane Reviews. Syst Rev 2013; 2: 81
• 3 McCormack L, Sheridan S, Lewis M. , et al. Communication and dissemination strategies to facilitate the use of health-related evidence. Evid Rep Technol Assess (Full Rep) 2013; (213) 1-520
• 4 Perrier L, Kealey MR, Straus SE. A usability study of two formats of a shortened systematic review for clinicians. BMJ Open 2014; 4 (12) e005919
• 5 Perrier L, Kealey MR, Straus SE. An iterative evaluation of two shortened systematic review formats for clinicians: a focus group study. J Am Med Inform Assoc 2014; 21 (e2): e341-e346
• 6 Marquez C, Johnson AM, Jassemi S. , et al. Enhancing the uptake of systematic reviews of effects: what is the best format for health care managers and policy-makers? A mixed-methods study. Implement Sci 2018; 13 (01) 84
• 7 Tableau Software. Available at: https://www.tableau.com/ . Accessed April 17, 2019
• 8 Totten AM, Smith C, Dunham K, Jungbauer RM, Graham E. Improving Access to and Usability of Systematic Review Data for Health Systems Guidelines Development. Available at: https://effectivehealthcare.ahrq.gov/sites/default/files/pdf/methods-health-systems-guidelines-development.pdf . Accessed June 7, 2019
• 9 Skelly AC, Chou R, Dettori JR. , et al. Noninvasive Nonpharmacological Treatment for Chronic Pain: A Systematic Review. Rockville, MD: Agency for Healthcare Research and Quality (U.S.); 2018
• 10 Visualizing Systematic Review Data. Pacific Northwest Evidence-Based Practice Center. Available at: https://public.tableau.com/profile/pnw.epc#!/vizhome/VisualizingSystematicReviewData/Dashboard . Accessed June 7, 2019
• 11 Nelson HD. Systematic Reviews to Answer Health Care Questions. Philadelphia, PA: Wolters Kluwer Health; 2014