Visual Evidence: Increasing Usability of Systematic Reviews in Health Systems Guidelines DevelopmentFunding This project was funded under contract no. HHSA 290–2015–00009-I Task Order 1 from the Agency for Healthcare Research and Quality (AHRQ), U.S. Department of Health and Human Services (HHS). The authors of this abstract are responsible for its content. Statements in the abstract do not necessarily represent the official views of or imply endorsement by AHRQ or HHS. This manuscript is based on the authors' oral presentation at the 9th Annual Workshop on Visual Analytics in Healthcare design challenge in San Francisco on November 3, 2018. The work is derived from a prior project funded by AHRQ as noted above, which was published February 28, 2019 on the AHRQ EHCP web site, available at: https://effectivehealthcare.ahrq.gov/sites/default/files/pdf/methods-health-systems-guidelines-development.pdf.
24 April 2019
02 August 2019
02 October 2019 (online)
Background Integration of evidence from systematic reviews is an essential step in the development of clinical guidelines. The current practice for reporting uses a static structure that does not allow for dynamic investigation. A need exists for an alternate reporting modality to facilitate dynamic visualization of results to match different end-users' queries.
Objectives We developed a dynamic visualization of data from a systematic review using the commercial product Tableau and assessed its potential to permit customized inquiries.
Methods Data were selected and extracted from a previously completed systematic review. The resulting dataset was then used to develop an interactive, web-based report designed for use by a guidelines development committee.
Results A novel example of combining existing reporting standards for systematic review data and modern reporting tools was developed to investigate potential benefits of a dynamic report. Demonstrations of the report to clinicians sitting on previous and future guideline committees received positive feedback for its potential benefit in guidelines development. The report received a runner-up award during the design challenge at the 2018 Workshop on Visual Analytics in Health Care.
Conclusion The use of interactive, accessible data may increase the use of systematic reviews and aid decision makers in developing evidence-based practice changes.
Keywordsdata visualization - clinical informatics - clinical practice guidelines - systematic reviews - data access - integration and analysis - evidence-based medicine and nursing - guidelines and protocols - evaluation
Protection of Human and Animal Subjects
Human and/or animal subjects were not included in the project.
- 1 Chan KS, Morton SC, Shekelle PG. Systematic reviews for evidence-based management: how to find them and what to do with them. Am J Manag Care 2004; 10 (11 Pt 1): 806-812
- 2 Langendam MW, Akl EA, Dahm P, Glasziou P, Guyatt G, Schünemann HJ. Assessing and presenting summaries of evidence in Cochrane Reviews. Syst Rev 2013; 2: 81
- 3 McCormack L, Sheridan S, Lewis M. , et al. Communication and dissemination strategies to facilitate the use of health-related evidence. Evid Rep Technol Assess (Full Rep) 2013; (213) 1-520
- 4 Perrier L, Kealey MR, Straus SE. A usability study of two formats of a shortened systematic review for clinicians. BMJ Open 2014; 4 (12) e005919
- 5 Perrier L, Kealey MR, Straus SE. An iterative evaluation of two shortened systematic review formats for clinicians: a focus group study. J Am Med Inform Assoc 2014; 21 (e2): e341-e346
- 6 Marquez C, Johnson AM, Jassemi S. , et al. Enhancing the uptake of systematic reviews of effects: what is the best format for health care managers and policy-makers? A mixed-methods study. Implement Sci 2018; 13 (01) 84
- 7 Tableau Software. Available at: https://www.tableau.com/ . Accessed April 17, 2019
- 8 Totten AM, Smith C, Dunham K, Jungbauer RM, Graham E. Improving Access to and Usability of Systematic Review Data for Health Systems Guidelines Development. Available at: https://effectivehealthcare.ahrq.gov/sites/default/files/pdf/methods-health-systems-guidelines-development.pdf . Accessed June 7, 2019
- 9 Skelly AC, Chou R, Dettori JR. , et al. Noninvasive Nonpharmacological Treatment for Chronic Pain: A Systematic Review. Rockville, MD: Agency for Healthcare Research and Quality (U.S.); 2018
- 10 Visualizing Systematic Review Data. Pacific Northwest Evidence-Based Practice Center. Available at: https://public.tableau.com/profile/pnw.epc#!/vizhome/VisualizingSystematicReviewData/Dashboard . Accessed June 7, 2019
- 11 Nelson HD. Systematic Reviews to Answer Health Care Questions. Philadelphia, PA: Wolters Kluwer Health; 2014