Download PDF
Appl Clin Inform 2023; 14(02): 345-353
DOI: 10.1055/a-2040-0578
Case Report

Human-Centered Design of a Clinical Decision Support for Anemia Screening in Children with Inflammatory Bowel Disease

Steven D. Miller
1   Division of Pediatric Gastroenterology, Hepatology, and Nutrition, Johns Hopkins University School of Medicine, Baltimore, Maryland, United States
,
Zachary Murphy
1   Division of Pediatric Gastroenterology, Hepatology, and Nutrition, Johns Hopkins University School of Medicine, Baltimore, Maryland, United States
,
Joshua H. Gray
1   Division of Pediatric Gastroenterology, Hepatology, and Nutrition, Johns Hopkins University School of Medicine, Baltimore, Maryland, United States
,
Jill Marsteller
2   Department of Health Policy and Management, Johns Hopkins University School of Medicine Armstrong Institute for Patient Safety and Quality, Baltimore, Maryland, United States
,
Maria Oliva-Hemker
1   Division of Pediatric Gastroenterology, Hepatology, and Nutrition, Johns Hopkins University School of Medicine, Baltimore, Maryland, United States
,
Andrew Maslen
3   Information Technology at Johns Hopkins Health System, Epic Project Leadership, Johns Hopkins Health System, Baltimore, Maryland, United States
,
Harold P. Lehmann
4   Division of Health Science Informatics, Johns Hopkins University, Baltimore, Maryland, United States
,
Paul Nagy
5   Department of Radiology, Johns Hopkins University School of Medicine, Johns Hopkins Technology Ventures, Baltimore, Maryland, United States
,
Susan Hutfless
6   Division of Gastroenterology and Hepatology, Johns Hopkins University, Baltimore, Maryland, United States
,
Ayse P. Gurses
3   Information Technology at Johns Hopkins Health System, Epic Project Leadership, Johns Hopkins Health System, Baltimore, Maryland, United States
› Author Affiliations
› Further Information
    Permissions and Reprints

Abstract

Background Inflammatory bowel disease (IBD) commonly leads to iron deficiency anemia (IDA). Rates of screening and treatment of IDA are often low. A clinical decision support system (CDSS) embedded in an electronic health record could improve adherence to evidence-based care. Rates of CDSS adoption are often low due to poor usability and fit with work processes. One solution is to use human-centered design (HCD), which designs CDSS based on identified user needs and context of use and evaluates prototypes for usefulness and usability.

Objectives this study aimed to use HCD to design a CDSS tool called the IBD Anemia Diagnosis Tool, IADx.

Methods Interviews with IBD practitioners informed creation of a process map of anemia care that was used by an interdisciplinary team that used HCD principles to create a prototype CDSS. The prototype was iteratively tested with “Think Aloud” usability evaluation with clinicians as well as semi-structured interviews, a survey, and observations. Feedback was coded and informed redesign.

Results Process mapping showed that IADx should function at in-person encounters and asynchronous laboratory review. Clinicians desired full automation of clinical information acquisition such as laboratory trends and analysis such as calculation of iron deficit, less automation of clinical decision selection such as laboratory ordering, and no automation of action implementation such as signing medication orders. Providers preferred an interruptive alert over a noninterruptive reminder.

Conclusion Providers preferred an interruptive alert, perhaps due to the low likelihood of noticing a noninterruptive advisory. High levels of desire for automation of information acquisition and analysis with less automation of decision selection and action may be generalizable to other CDSSs designed for chronic disease management. This underlines the ways in which CDSSs have the potential to augment rather than replace provider cognitive work.

Keywords

clinical decision support systems - usability testing - human-centered decision - clinical workflows

Protection of Human and Animal Subjects

The study was performed in compliance with the World Medical Association Declaration of Helsinki on Ethical Principles for Medical Research Involving Human Subjects, and was reviewed by Johns Hopkins University Institutional Review Board.


Supplementary Material



Publication History

Received: 15 November 2022

Accepted: 17 February 2023

Accepted Manuscript online:
21 February 2023

Article published online:
10 May 2023

© 2023. Thieme. All rights reserved.

Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany

 

  • References

  • 1 Kappelman MD, Moore KR, Allen JK, Cook SF. Recent trends in the prevalence of Crohn's disease and ulcerative colitis in a commercially insured US population. Dig Dis Sci 2013; 58 (02) 519-525
    CrossrefPubMedGoogle Scholar
  • 2 Pigneur B, Seksik P, Viola S. et al. Natural history of Crohn's disease: comparison between childhood- and adult-onset disease. Inflamm Bowel Dis 2010; 16 (06) 953-961
    CrossrefPubMedGoogle Scholar
  • 3 Goodhand JR, Kamperidis N, Rao A. et al. Prevalence and management of anemia in children, adolescents, and adults with inflammatory bowel disease. Inflamm Bowel Dis 2012; 18 (03) 513-519
    CrossrefPubMedGoogle Scholar
  • 4 Danese S, Hoffman C, Vel S. et al. Anaemia from a patient perspective in inflammatory bowel disease: results from the European Federation of Crohn's and Ulcerative Colitis Association's online survey. Eur J Gastroenterol Hepatol 2014; 26 (12) 1385-1391
    CrossrefPubMedGoogle Scholar
  • 5 McCann JC, Ames BN. An overview of evidence for a causal relation between iron deficiency during development and deficits in cognitive or behavioral function. Am J Clin Nutr 2007; 85 (04) 931-945
    CrossrefPubMedGoogle Scholar
  • 6 Miller SD, Cuffari C, Akhuemonkhan E, Guerrerio AL, Lehmann H, Hutfless S. Anemia screening, prevalence, and treatment in pediatric inflammatory bowel disease in the United States, 2010–2014. Pediatr Gastroenterol Hepatol Nutr 2019; 22 (02) 152-161
    CrossrefPubMedGoogle Scholar
  • 7 Miller SD, Lehmann H, Murphy Z. et al. User centered digital development of a decision support tool to improve anemia care in pediatric inflammatory bowel disease. J Pediatr Gastroenterol Nutr 2019; 69: S331
    PubMedGoogle Scholar
  • 8 Richardson S, Mishuris R, O'Connell A. et al. “Think aloud” and “Near live” usability testing of two complex clinical decision support tools. Int J Med Inform 2017; 106: 1-8
    CrossrefPubMedGoogle Scholar
  • 9 Bright TJ, Wong A, Dhurjati R. et al. Effect of clinical decision-support systems: a systematic review. Ann Intern Med 2012; 157 (01) 29-43
    CrossrefPubMedGoogle Scholar
  • 10 Osheroff JA, Teich JM, Levick D. et al. Improving Outcomes with Clinical Decision Support: An Implementer's Guide. 2nd ed. Chicago, IL: HIMSS Publishing; 2012
    CrossrefGoogle Scholar
  • 11 Sutton RT, Pincock D, Baumgart DC, Sadowski DC, Fedorak RN, Kroeker KI. An overview of clinical decision support systems: benefits, risks, and strategies for success. NPJ Digit Med 2020; 3 (01) 17
    CrossrefPubMedGoogle Scholar
  • 12 Carayon P, Hoonakker P, Hundt AS. et al. Application of human factors to improve usability of clinical decision support for diagnostic decision-making: a scenario-based simulation study. BMJ Qual Saf 2019; 29 (04) 329-340
    CrossrefPubMedGoogle Scholar
  • 13 Hoonakker PLT, Carayon P, Salwei ME. et al. The design of PE dx, a CDS to support pulmonary embolism diagnosis in the ED. Stud Health Technol Inform 2019; 265: 134-140
    PubMedGoogle Scholar
  • 14 Beuscart-Zéphir MC, Borycki E, Carayon P, Jaspers MWM, Pelayo S. Evolution of human factors research and studies of health information technologies: the role of patient safety. Yearb Med Inform 2013; 8: 67-77
    PubMedGoogle Scholar
  • 15 Brunner J, Chuang E, Goldzweig C, Cain CL, Sugar C, Yano EM. User-centered design to improve clinical decision support in primary care. Int J Med Inform 2017; 104: 56-64
    CrossrefPubMedGoogle Scholar
  • 16 Savoy A, Militello LG, Patel H. et al. A cognitive systems engineering design approach to improve the usability of electronic order forms for medical consultation. J Biomed Inform 2018; 85: 138-148
    CrossrefPubMedGoogle Scholar
  • 17 Savoy A, Patel H, Flanagan ME, Daggy JK, Russ AL, Weiner M. Comparative usability evaluation of consultation order templates in a simulated primary care environment. Appl Ergon 2018; 73: 22-32
    CrossrefPubMedGoogle Scholar
  • 18 Thursky KA, Mahemoff M. User-centered design techniques for a computerised antibiotic decision support system in an intensive care unit. Int J Med Inform 2007; 76 (10) 760-768
    CrossrefPubMedGoogle Scholar
  • 19 Chokshi SK, Mann DM. Innovating from within: a process model for user-centered digital development in academic medical centers. JMIR Human Factors 2018; 5 (04) e11048
    CrossrefPubMedGoogle Scholar
  • 20 Kilsdonk E, Peute LWP, Riezebos RJ, Kremer LC, Jaspers MWM. Uncovering healthcare practitioners' information processing using the think-aloud method: From paper-based guideline to clinical decision support system. Int J Med Inform 2016; 86: 10-19
    CrossrefPubMedGoogle Scholar
  • 21 Campbell R. The five “rights” of clinical decision support. J AHIMA 2013; 84 (10) 42-47 , quiz 48
    PubMedGoogle Scholar
  • 22 Carayon P, Hoonakker P. Human factors and usability for health information technology: old and new challenges. Yearb Med Inform 2019; 28 (01) 71-77
    Article in Thieme ConnectPubMedGoogle Scholar
  • 23 About us | Johns Hopkins Children's Center. Johns Hopkins Medicine Web site. Accessed Jan 30, 2020 at: https://www.hopkinsmedicine.org/johns-hopkins-childrens-center/about-us/index.html
    PubMed
  • 24 Draw.io. . Draw.io Web site. Accessed August 21, 2020 at: https://app.diagrams.net/
    PubMed
  • 25 Zoom. Zoom.us Web site. Updated 2020. Accessed August 21, 2020 at: https://zoom.us/
    PubMed
  • 26 EpicCare. . Epic.com Web site. Accessed August 21, 2020 at: https://www.epic.com/software
    PubMed
  • 27 Dignass AU, Gasche C, Bettenworth D. et al; European Crohn's and Colitis Organisation [ECCO]. European consensus on the diagnosis and management of iron deficiency and anaemia in inflammatory bowel diseases. J Crohn's Colitis 2015; 9 (03) 211-222
    CrossrefPubMedGoogle Scholar
  • 28 Rose AF, Schnipper JL, Park ER, Poon EG, Li Q, Middleton B. Using qualitative studies to improve the usability of an EMR. J Biomed Inform 2005; 38 (01) 51-60
    CrossrefPubMedGoogle Scholar
  • 29 Kilsdonk E, Peute LW, Jaspers MWM. Factors influencing implementation success of guideline-based clinical decision support systems: a systematic review and gaps analysis. Int J Med Inform 2017; 98: 56-64
    CrossrefPubMedGoogle Scholar
  • 30 Rojas B, White RF. The modified latin square. J R Stat Soc B 1957; 19 (02) 305-317
    PubMedGoogle Scholar
  • 31 B-line medical sim capture. Accessed January 30, 2020 at: https://www.blinemedical.com/simcapture.html
    PubMed
  • 32 REDCap. . Accessed January 30, 2020 at: https://www.project-redcap.org/
    PubMed
  • 33 Galaxy - UX2100 usability badge. Accessed January 30, 2020 at: https://galaxy.epic.com/?#Browse/page=8400!68!240!3542166
    PubMed
  • 34 Brooke J. SUS-A quick and dirty usability scale. Usability evaluation in industry. CRC Press 1996; 189: 4-7
    PubMedGoogle Scholar
  • 35 Corbin J, Strauss A. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. 3rd ed. Thousand Oaks, CA: SAGE Publications; 2008
    CrossrefGoogle Scholar
  • 36 Kwan JL, Lo L, Ferguson J. et al. Computerised clinical decision support systems and absolute improvements in care: meta-analysis of controlled clinical trials. BMJ 2020; 370: m3216
    CrossrefPubMedGoogle Scholar
  • 37 Backman R, Bayliss S, Moore D, Litchfield I. Clinical reminder alert fatigue in healthcare: a systematic literature review protocol using qualitative evidence. Syst Rev 2017; 6 (01) 255
    CrossrefPubMedGoogle Scholar
  • 38 Ancker JS, Edwards A, Nosal S, Hauser D, Mauer E, Kaushal R. with the HITEC Investigators. Effects of workload, work complexity, and repeated alerts on alert fatigue in a clinical decision support system. BMC Med Inform Decis Mak 2017; 17 (01) 36
    CrossrefPubMedGoogle Scholar
  • 39 Olakotan O, Mohd Yusof M, Ezat Wan Puteh S. A systematic review on CDSS alert appropriateness. Stud Health Technol Inform 2020; 270: 906-910
    PubMedGoogle Scholar
  • 40 Ash JS, Berg M, Coiera E. Some unintended consequences of information technology in health care: the nature of patient care information system-related errors. J Am Med Inform Assoc 2004; 11 (02) 104-112
    CrossrefPubMedGoogle Scholar
  • 41 Chaparro JD, Beus JM, Dziorny AC. et al. Clinical decision support stewardship: Best practices and techniques to monitor and improve interruptive alerts. Appl Clin Inform 2022; 13 (03) 560-568
    Article in Thieme ConnectPubMedGoogle Scholar
  • 42 Ikoma S, Furukawa M, Busuttil A. et al. Optimizing inpatient blood utilization using real-time clinical decision support. Appl Clin Inform 2021; 12 (01) 49-56
    Article in Thieme ConnectPubMedGoogle Scholar
  • 43 Hendrickson CD, McLemore MF, Dahir KM. et al. Is the climb worth the view? the savings/alert ratio for reducing vitamin D testing. Appl Clin Inform 2020; 11 (01) 160-165
    Article in Thieme ConnectPubMedGoogle Scholar
  • 44 Baysari M. Finding fault with the default alert. AHRQ PSNet Patient Safety Network Web site. Updated 2013. Accessed May 27, 2021 at: https://psnet.ahrq.gov/web-mm/finding-fault-default-alert
    PubMedGoogle Scholar
  • 45 Gao E, Radparvar I, Dieu H, Ross MK. User experience design for adoption of asthma clinical decision support tools. Appl Clin Inform 2022; 13 (04) 971-982
    Article in Thieme ConnectPubMedGoogle Scholar
  • 46 Parasuraman R, Sheridan TB, Wickens CD. A model for types and levels of human interaction with automation. IEEE Trans Syst Man Cybern A Syst Hum 2000; 30 (03) 286-297
    CrossrefPubMedGoogle Scholar
  • 47 CDS hooks. CDSHooks.org Web site. Accessed November 6, 2022 at: https://cds-hooks.org/
    PubMed
  • 48 HL7 smart on FHIR. HL7 Smart on FHIR Web site. Accessed November 6, 2022 at: https://www.hl7.org/fhir/smart-app-launch/
    PubMed
  • 49 Holden RJ, Carayon P, Gurses AP. et al. SEIPS 2.0: a human factors framework for studying and improving the work of healthcare professionals and patients. Ergonomics 2013; 56 (11) 1669-1686
    CrossrefPubMedGoogle Scholar
  • 50 Rice H, Garabedian PM, Shear K. et al. Clinical decision support for fall prevention: defining end-user needs. Appl Clin Inform 2022; 13 (03) 647-655
    Article in Thieme ConnectPubMedGoogle Scholar
  • 51 Wiklund ME, Kendler J, Hochberg L, Weinger MB. Technical Basis for User Interface Design of Health IT. Grant/Contract Reports (NISTGCR). 2015. Gaithersburg, MD National Institute of Standards and Technology [online]. Accessed March 9, 2023 at: https://doi.org/10.6028/NIST.GCR.15-996
    CrossrefPubMedGoogle Scholar
  • 52 Zhang J, Johnson TR, Patel VL, Paige DL, Kubose T. Using usability heuristics to evaluate patient safety of medical devices. J Biomed Inform 2003; 36 (1–2): 23-30
    CrossrefPubMedGoogle Scholar
  • 53 Scapin DL, Bastien JMC. Ergonomic criteria for evaluating the ergonomic quality of interactive systems. Behav Inf Technol 1997; 16 (05) 220-231
    CrossrefPubMedGoogle Scholar