Human-Centered Design of a Clinical Decision Support for Anemia Screening in Children with Inflammatory Bowel Disease

Abstract

Background Inflammatory bowel disease (IBD) commonly leads to iron deficiency anemia (IDA). Rates of screening and treatment of IDA are often low. A clinical decision support system (CDSS) embedded in an electronic health record could improve adherence to evidence-based care. Rates of CDSS adoption are often low due to poor usability and fit with work processes. One solution is to use human-centered design (HCD), which designs CDSS based on identified user needs and context of use and evaluates prototypes for usefulness and usability.

Objectives this study aimed to use HCD to design a CDSS tool called the IBD Anemia Diagnosis Tool, IADx.

Methods Interviews with IBD practitioners informed creation of a process map of anemia care that was used by an interdisciplinary team that used HCD principles to create a prototype CDSS. The prototype was iteratively tested with “Think Aloud” usability evaluation with clinicians as well as semi-structured interviews, a survey, and observations. Feedback was coded and informed redesign.

Results Process mapping showed that IADx should function at in-person encounters and asynchronous laboratory review. Clinicians desired full automation of clinical information acquisition such as laboratory trends and analysis such as calculation of iron deficit, less automation of clinical decision selection such as laboratory ordering, and no automation of action implementation such as signing medication orders. Providers preferred an interruptive alert over a noninterruptive reminder.

Conclusion Providers preferred an interruptive alert, perhaps due to the low likelihood of noticing a noninterruptive advisory. High levels of desire for automation of information acquisition and analysis with less automation of decision selection and action may be generalizable to other CDSSs designed for chronic disease management. This underlines the ways in which CDSSs have the potential to augment rather than replace provider cognitive work.

Keywords

clinical decision support systems - usability testing - human-centered decision - clinical workflows

Protection of Human and Animal Subjects

The study was performed in compliance with the World Medical Association Declaration of Helsinki on Ethical Principles for Medical Research Involving Human Subjects, and was reviewed by Johns Hopkins University Institutional Review Board.

Publikationsverlauf

Eingereicht: 15. November 2022

Angenommen: 17. Februar 2023

Accepted Manuscript online:
21. Februar 2023

Artikel online veröffentlicht:
10. Mai 2023

• References

• 1 Kappelman MD, Moore KR, Allen JK, Cook SF. Recent trends in the prevalence of Crohn's disease and ulcerative colitis in a commercially insured US population. Dig Dis Sci 2013; 58 (02) 519-525
• 2 Pigneur B, Seksik P, Viola S. et al. Natural history of Crohn's disease: comparison between childhood- and adult-onset disease. Inflamm Bowel Dis 2010; 16 (06) 953-961
• 3 Goodhand JR, Kamperidis N, Rao A. et al. Prevalence and management of anemia in children, adolescents, and adults with inflammatory bowel disease. Inflamm Bowel Dis 2012; 18 (03) 513-519
• 4 Danese S, Hoffman C, Vel S. et al. Anaemia from a patient perspective in inflammatory bowel disease: results from the European Federation of Crohn's and Ulcerative Colitis Association's online survey. Eur J Gastroenterol Hepatol 2014; 26 (12) 1385-1391
• 5 McCann JC, Ames BN. An overview of evidence for a causal relation between iron deficiency during development and deficits in cognitive or behavioral function. Am J Clin Nutr 2007; 85 (04) 931-945
• 6 Miller SD, Cuffari C, Akhuemonkhan E, Guerrerio AL, Lehmann H, Hutfless S. Anemia screening, prevalence, and treatment in pediatric inflammatory bowel disease in the United States, 2010–2014. Pediatr Gastroenterol Hepatol Nutr 2019; 22 (02) 152-161
• 7 Miller SD, Lehmann H, Murphy Z. et al. User centered digital development of a decision support tool to improve anemia care in pediatric inflammatory bowel disease. J Pediatr Gastroenterol Nutr 2019; 69: S331
• 8 Richardson S, Mishuris R, O'Connell A. et al. “Think aloud” and “Near live” usability testing of two complex clinical decision support tools. Int J Med Inform 2017; 106: 1-8
• 9 Bright TJ, Wong A, Dhurjati R. et al. Effect of clinical decision-support systems: a systematic review. Ann Intern Med 2012; 157 (01) 29-43
• 10 Osheroff JA, Teich JM, Levick D. et al. Improving Outcomes with Clinical Decision Support: An Implementer's Guide. 2nd ed. Chicago, IL: HIMSS Publishing; 2012
• 11 Sutton RT, Pincock D, Baumgart DC, Sadowski DC, Fedorak RN, Kroeker KI. An overview of clinical decision support systems: benefits, risks, and strategies for success. NPJ Digit Med 2020; 3 (01) 17
• 12 Carayon P, Hoonakker P, Hundt AS. et al. Application of human factors to improve usability of clinical decision support for diagnostic decision-making: a scenario-based simulation study. BMJ Qual Saf 2019; 29 (04) 329-340
• 13 Hoonakker PLT, Carayon P, Salwei ME. et al. The design of PE dx, a CDS to support pulmonary embolism diagnosis in the ED. Stud Health Technol Inform 2019; 265: 134-140
• 14 Beuscart-Zéphir MC, Borycki E, Carayon P, Jaspers MWM, Pelayo S. Evolution of human factors research and studies of health information technologies: the role of patient safety. Yearb Med Inform 2013; 8: 67-77
• 15 Brunner J, Chuang E, Goldzweig C, Cain CL, Sugar C, Yano EM. User-centered design to improve clinical decision support in primary care. Int J Med Inform 2017; 104: 56-64
• 16 Savoy A, Militello LG, Patel H. et al. A cognitive systems engineering design approach to improve the usability of electronic order forms for medical consultation. J Biomed Inform 2018; 85: 138-148
• 17 Savoy A, Patel H, Flanagan ME, Daggy JK, Russ AL, Weiner M. Comparative usability evaluation of consultation order templates in a simulated primary care environment. Appl Ergon 2018; 73: 22-32
• 18 Thursky KA, Mahemoff M. User-centered design techniques for a computerised antibiotic decision support system in an intensive care unit. Int J Med Inform 2007; 76 (10) 760-768
• 19 Chokshi SK, Mann DM. Innovating from within: a process model for user-centered digital development in academic medical centers. JMIR Human Factors 2018; 5 (04) e11048
• 20 Kilsdonk E, Peute LWP, Riezebos RJ, Kremer LC, Jaspers MWM. Uncovering healthcare practitioners' information processing using the think-aloud method: From paper-based guideline to clinical decision support system. Int J Med Inform 2016; 86: 10-19
• 21 Campbell R. The five “rights” of clinical decision support. J AHIMA 2013; 84 (10) 42-47 , quiz 48
• 22 Carayon P, Hoonakker P. Human factors and usability for health information technology: old and new challenges. Yearb Med Inform 2019; 28 (01) 71-77
• 23 About us | Johns Hopkins Children's Center. Johns Hopkins Medicine Web site. Accessed Jan 30, 2020 at: https://www.hopkinsmedicine.org/johns-hopkins-childrens-center/about-us/index.html
• 24 Draw.io. . Draw.io Web site. Accessed August 21, 2020 at: https://app.diagrams.net/
• 25 Zoom. Zoom.us Web site. Updated 2020. Accessed August 21, 2020 at: https://zoom.us/
• 26 EpicCare. . Epic.com Web site. Accessed August 21, 2020 at: https://www.epic.com/software
• 27 Dignass AU, Gasche C, Bettenworth D. et al; European Crohn's and Colitis Organisation [ECCO]. European consensus on the diagnosis and management of iron deficiency and anaemia in inflammatory bowel diseases. J Crohn's Colitis 2015; 9 (03) 211-222
• 28 Rose AF, Schnipper JL, Park ER, Poon EG, Li Q, Middleton B. Using qualitative studies to improve the usability of an EMR. J Biomed Inform 2005; 38 (01) 51-60
• 29 Kilsdonk E, Peute LW, Jaspers MWM. Factors influencing implementation success of guideline-based clinical decision support systems: a systematic review and gaps analysis. Int J Med Inform 2017; 98: 56-64
• 30 Rojas B, White RF. The modified latin square. J R Stat Soc B 1957; 19 (02) 305-317
• 31 B-line medical sim capture. Accessed January 30, 2020 at: https://www.blinemedical.com/simcapture.html
• 32 REDCap. . Accessed January 30, 2020 at: https://www.project-redcap.org/
• 33 Galaxy - UX2100 usability badge. Accessed January 30, 2020 at: https://galaxy.epic.com/?#Browse/page=8400!68!240!3542166
• 34 Brooke J. SUS-A quick and dirty usability scale. Usability evaluation in industry. CRC Press 1996; 189: 4-7
• 35 Corbin J, Strauss A. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. 3rd ed. Thousand Oaks, CA: SAGE Publications; 2008
• 36 Kwan JL, Lo L, Ferguson J. et al. Computerised clinical decision support systems and absolute improvements in care: meta-analysis of controlled clinical trials. BMJ 2020; 370: m3216
• 37 Backman R, Bayliss S, Moore D, Litchfield I. Clinical reminder alert fatigue in healthcare: a systematic literature review protocol using qualitative evidence. Syst Rev 2017; 6 (01) 255
• 38 Ancker JS, Edwards A, Nosal S, Hauser D, Mauer E, Kaushal R. with the HITEC Investigators. Effects of workload, work complexity, and repeated alerts on alert fatigue in a clinical decision support system. BMC Med Inform Decis Mak 2017; 17 (01) 36
• 39 Olakotan O, Mohd Yusof M, Ezat Wan Puteh S. A systematic review on CDSS alert appropriateness. Stud Health Technol Inform 2020; 270: 906-910
• 40 Ash JS, Berg M, Coiera E. Some unintended consequences of information technology in health care: the nature of patient care information system-related errors. J Am Med Inform Assoc 2004; 11 (02) 104-112
• 41 Chaparro JD, Beus JM, Dziorny AC. et al. Clinical decision support stewardship: Best practices and techniques to monitor and improve interruptive alerts. Appl Clin Inform 2022; 13 (03) 560-568
• 42 Ikoma S, Furukawa M, Busuttil A. et al. Optimizing inpatient blood utilization using real-time clinical decision support. Appl Clin Inform 2021; 12 (01) 49-56
• 43 Hendrickson CD, McLemore MF, Dahir KM. et al. Is the climb worth the view? the savings/alert ratio for reducing vitamin D testing. Appl Clin Inform 2020; 11 (01) 160-165
• 44 Baysari M. Finding fault with the default alert. AHRQ PSNet Patient Safety Network Web site. Updated 2013. Accessed May 27, 2021 at: https://psnet.ahrq.gov/web-mm/finding-fault-default-alert
• 45 Gao E, Radparvar I, Dieu H, Ross MK. User experience design for adoption of asthma clinical decision support tools. Appl Clin Inform 2022; 13 (04) 971-982
• 46 Parasuraman R, Sheridan TB, Wickens CD. A model for types and levels of human interaction with automation. IEEE Trans Syst Man Cybern A Syst Hum 2000; 30 (03) 286-297
• 47 CDS hooks. CDSHooks.org Web site. Accessed November 6, 2022 at: https://cds-hooks.org/
• 48 HL7 smart on FHIR. HL7 Smart on FHIR Web site. Accessed November 6, 2022 at: https://www.hl7.org/fhir/smart-app-launch/
• 49 Holden RJ, Carayon P, Gurses AP. et al. SEIPS 2.0: a human factors framework for studying and improving the work of healthcare professionals and patients. Ergonomics 2013; 56 (11) 1669-1686
• 50 Rice H, Garabedian PM, Shear K. et al. Clinical decision support for fall prevention: defining end-user needs. Appl Clin Inform 2022; 13 (03) 647-655
• 51 Wiklund ME, Kendler J, Hochberg L, Weinger MB. Technical Basis for User Interface Design of Health IT. Grant/Contract Reports (NISTGCR). 2015. Gaithersburg, MD National Institute of Standards and Technology [online]. Accessed March 9, 2023 at: https://doi.org/10.6028/NIST.GCR.15-996
• 52 Zhang J, Johnson TR, Patel VL, Paige DL, Kubose T. Using usability heuristics to evaluate patient safety of medical devices. J Biomed Inform 2003; 36 (1–2): 23-30
• 53 Scapin DL, Bastien JMC. Ergonomic criteria for evaluating the ergonomic quality of interactive systems. Behav Inf Technol 1997; 16 (05) 220-231