Challenges to Reduce Alert Burden Using Current Decision Support Infrastructure in Two Commercial EHR Systems: Lessons Learned and Path Forward

Abstract

Background

Despite the proven usefulness of appropriate clinical decision support (CDS) alerts, many CDS systems fire excessive, clinically irrelevant alerts that are often ignored by clinicians. We have developed a method to suppress false-positive alerts based on prior drug tolerance but encountered substantial barriers to integrating the method into widely adopted commercial electronic health record (EHR) systems.

Objectives

This study aimed to describe the challenges faced while attempting to integrate our method into the CDS infrastructure of two commercial EHR systems and provide recommendations for future research and CDS design.

Methods

Using a multifaceted approach, we investigated (1) the use of emergent CDS standards (e.g., CDS Hooks) to create a scalable solution to augment off-the-shelf EHR-based alerts with patient-specific custom alerts, (2) customize CDS rules of commercial medication knowledge bases (MKBs) to reduce false-positive alerts, and (3) manually inactivate allergy documentation in patients with prior drug tolerance.

Results

We were unable to implement the standards-based approach because support for CDS Hooks was found to be tailored to specific scenarios that involve the creation of new drug allergy alerts (DAAs) but not the suppression of vendor-supplied DAAs. Likewise, we were unable to suppress alerts imported from MKBs into the EHR systems investigated because these systems do not support discrete clinical documentation changes that drive DAAs. Lastly, we determined that although manually inactivating allergy documentation in patients with prior drug tolerance is possible, doing so requires the impractical solution of creating and maintaining individual rules for each drug at the ingredient level.

Conclusion

We describe the barriers that precluded implementation of a novel method to suppress clinically irrelevant CDS alerts in two commercial EHR systems. Overcoming these barriers will require a more flexible CDS infrastructure, as well as collaboration and shared responsibility across diverse stakeholders.

Keywords

clinical decision support - alert fatigue - alert burden - electronic health records - interoperability

Protection of Human and Animal Subjects

No human subjects' data were obtained or included in this case report. Therefore, IRB approval was not obtained.

Publikationsverlauf

Eingereicht: 16. Dezember 2024

Angenommen: 25. Februar 2025

Accepted Manuscript online:
28. Februar 2025

Artikel online veröffentlicht:
25. Juni 2025

• References

• 1 Cerqueira O, Gill M, Swar B, Prentice KA, Gwin S, Beasley BW. The effectiveness of interruptive prescribing alerts in ambulatory CPOE to change prescriber behaviour & improve safety. BMJ Qual Saf 2021; 30 (12) 1038-1046
• 2 Page N, Baysari MT, Westbrook JI. A systematic review of the effectiveness of interruptive medication prescribing alerts in hospital CPOE systems to change prescriber behavior and improve patient safety. Int J Med Inform 2017; 105: 22-30
• 3 Duke JDD, Bolchini D. A successful model and visual design for creating context-aware drug-drug interaction alerts. AMIA Annu Symp Proc 2011; 2011: 339-348
• 4 Duke JD, Li X, Dexter P. Adherence to drug-drug interaction alerts in high-risk patients: a trial of context-enhanced alerting. J Am Med Inform Assoc 2013; 20 (03) 494-498
• 5 Zapata LV, Subbian V, Boyce RD, Hansten PD, Horn JR. Overriding drug-drug interaction alerts in clinical decision support systems: A scoping review. Stud Health Technol Inform 2022; 290: 380-384
• 6 Luri M, Leache L, Gastaminza G, Idoate A, Ortega A. A systematic review of drug allergy alert systems. Int J Med Inform 2022; 159: 104673
• 7 Topaz M, Seger DL, Slight SP. et al. Rising drug allergy alert overrides in electronic health records: an observational retrospective study of a decade of experience. J Am Med Inform Assoc 2016; 23 (03) 601-608
• 8 Baysari MT, Tariq A, Day RO, Westbrook JI. Alert override as a habitual behavior - a new perspective on a persistent problem. J Am Med Inform Assoc 2017; 24 (02) 409-412
• 9 Reese TJ, Kawamoto K, Fiol GD. et al. When an alert is not an alert: A pilot study to characterize behavior and cognition associated with medication alerts. AMIA Annu Symp Proc 2018; 2018: 1488-1497
• 10 Edrees H, Amato MG, Wong A, Seger DL, Bates DW. High-priority drug-drug interaction clinical decision support overrides in a newly implemented commercial computerized provider order-entry system: Override appropriateness and adverse drug events. J Am Med Inform Assoc 2020; 27 (06) 893-900
• 11 Wong A, Amato MG, Seger DL. et al. Prospective evaluation of medication-related clinical decision support over-rides in the intensive care unit. BMJ Qual Saf 2018; 27 (09) 718-724
• 12 Wong A, Rehr C, Seger DL. et al. Evaluation of harm associated with high dose-range clinical decision support overrides in the intensive care unit. Drug Saf 2019; 42 (04) 573-579
• 13 Chaparro JD, Beus JM, Dziorny AC. et al. Clinical decision support stewardship: best practices and techniques to monitor and improve interruptive alerts. Appl Clin Inform 2022; 13 (03) 560-568
• 14 McGreevey III JD, Mallozzi CP, Perkins RM, Shelov E, Schreiber R. Reducing alert burden in electronic health records: State of the Art Recommendations from Four Health Systems. Appl Clin Inform 2020; 11 (01) 1-12
• 15 Horn JR, Hansten PD, Osborn JD, Wareham P, Somani S. Customizing clinical decision support to prevent excessive drug-drug interaction alerts. Am J Health Syst Pharm 2011; 68 (08) 662-664
• 16 Van Dort BA, Zheng WY, Sundar V, Baysari MT. Optimizing clinical decision support alerts in electronic medical records: a systematic review of reported strategies adopted by hospitals. J Am Med Inform Assoc 2021; 28 (01) 177-183
• 17 Staicu ML, Vyles D, Shenoy ES. et al. Penicillin allergy delabeling: A multidisciplinary opportunity. J Allergy Clin Immunol Pract 2020; 8 (09) 2858-2868.e16
• 18 Anoz-Jiménez L, Ferrer-Ferrer C, Becerril-Moreno F, Navarro-de-Lara S, Estaún-Díaz-de-Villegas E. Nursing interventions as part of an integral pharmaceutical care team. Farm Hosp 2011; 35 (01) 1-7 (English Edition)
• 19 Burrell C, Tsourounis C, Quan D. et al. Impact of a pharmacist-driven protocol to improve drug allergy documentation at a university hospital. Hosp Pharm 2013; 48 (04) 302-307
• 20 Wright A, Rubins D, Shenoy ES. et al. Clinical decision support improved allergy documentation of antibiotic test dose results. J Allergy Clin Immunol Pract 2019; 7 (08) 2919-2921
• 21 Van Groningen N, Duncan R, Cook-Wiens G. et al. Incidence of interruptive penicillin allergy alerts in patients with previously documented beta-lactam exposure: Potential for leveraging the electronic health record to identify erroneous allergies. Infect Control Hosp Epidemiol 2022; 43 (09) 1108-1111
• 22 Colicchio TK, Cimino JJ. Beyond the override: Using evidence of previous drug tolerance to suppress drug allergy alerts; a retrospective study of opioid alerts. J Biomed Inform 2023; 147: 104508
• 23 Bryant AD, Fletcher GS, Payne TH. Drug interaction alert override rates in the Meaningful Use era: no evidence of progress. Appl Clin Inform 2014; 5 (03) 802-813
• 24 Kawamanto K, Flynn MC, Kukhareva P. et al. A pragmatic guide to establishing clinical decision support governance and addressing decision support fatigue: a case study. AMIA Annu Symp proc 2018; 2018: 624-633
• 25 Nanji KC, Seger DL, Slight SP. et al. Medication-related clinical decision support alert overrides in inpatients. J Am Med Inform Assoc 2018; 25 (05) 476-481
• 26 DeDea L. Prescribing opioids safely in patients with an opiate allergy. JAAPA 2012; 25 (01) 17
• 27 Hsieh TC, Kuperman GJ, Jaggi T. et al. Characteristics and consequences of drug allergy alert overrides in a computerized physician order entry system. J Am Med Inform Assoc 2004; 11 (06) 482-491
• 28 Swerts S, Van Gasse A, Leysen J. et al. Allergy to illicit drugs and narcotics. Clin Exp Allergy 2014; 44 (03) 307-318
• 29 Topaz M, Seger DL, Lai K. et al. High override rate for opioid drug-allergy interaction alerts: Current trends and recommendations for future. Stud Health Technol Inform 2015; 216: 242-246
• 30 Inglis JM, Caughey GE, Smith W, Shakib S. Documentation of adverse drug reactions to opioids in an electronic health record. Intern Med J 2021; 51 (09) 1490-1496
• 31 Reinecke I, Zoch M, Reich C, Sedlmayr M, Bathelt F. The usage of OHDSI OMOP - A scoping review. Stud Health Technol Inform 2021; 283: 95-103
• 32 Colicchio TK, Osborne JD, Do Rosario CV. et al. Semantically oriented EHR navigation with a patient specific knowledge base and a clinical context ontology. AMIA Annu Symp Proc 2024; 2023: 309-318
• 33 CDS Hooks. Health Level 7 CDS Hooks. Accessed March 10, 2025 at: https://cds-hooks.hl7.org/
• 34 Strasberg HR, Rhodes B, Del Fiol G, Jenders RA, Haug PJ, Kawamoto K. Contemporary clinical decision support standards using Health Level Seven International Fast Healthcare Interoperability Resources. J Am Med Inform Assoc 2021; 28 (08) 1796-1806
• 35 Thiess H, Del Fiol G, Malone DC. et al. Coordinated use of Health Level 7 standards to support clinical decision support: Case study with shared decision making and drug-drug interactions. Int J Med Inform 2022; 162: 104749
• 36 Jankovic I, Chen JH. Clinical decision support and implications for the clinician burnout crisis. Yearb Med Inform 2020; 29 (01) 145-154
• 37 McDonald CJ, Hui SL, Smith DM. et al. Reminders to physicians from an introspective computer medical record. A two-year randomized trial. Ann Intern Med 1984; 100 (01) 130-138
• 38 Greim JA, Shek C, Jones L. et al. Enterprise-wide drug-drug interaction alerting system. AMIA Annu Symp Proc 2003; 2003: 856
• 39 Haug PJ, Rocha BH, Evans RS. Decision support in medicine: lessons from the HELP system. Int J Med Inform 2003; 69 (2-3): 273-284
• 40 Blumenthal D, Tavenner M. The “meaningful use” regulation for electronic health records. N Engl J Med 2010; 363 (06) 501-504
• 41 Colicchio TK, Cimino JJ, Del Fiol G. Unintended consequences of nationwide electronic health record adoption: challenges and opportunities in the post-Meaningful Use era. J Med Internet Res 2019; 21 (06) e13313
• 42 Anumula N, Sanelli PC. Meaningful Use. AJNR Am J Neuroradiol 2012; 33 (08) 1455-1457
• 43 Middleton B, Sittig DF, Wright A. Clinical decision support: a 25 year retrospective and a 25 year vision. Yearb Med Inform 2016; 1 (Suppl. 01) S103-S116
• 44 Evans RS, Pestotnik SL, Classen DC. et al. A computer-assisted management program for antibiotics and other antiinfective agents. N Engl J Med 1998; 338 (04) 232-238
• 45 Evans RS, Abouzelof RH, Taylor CW. et al. Computer surveillance of hospital-acquired infections: a 25 year update. AMIA Annu Symp Proc 2009; 2009: 178-182
• 46 Colicchio TK, Cimino JJ. Twilighted Homegrown Systems: The experience of six traditional electronic health record developers in the post-Meaningful Use era. Appl Clin Inform 2020; 11 (02) 356-365
• 47 Lin RY. Desensitization in the management of vancomycin hypersensitivity. Arch Intern Med 1990; 150 (10) 2197-2198
• 48 Taber P, Radloff C, Del Fiol G, Staes C, Kawamoto K. New standards for clinical decision support: A survey of the state of implementation. Yearb Med Inform 2021; 30 (01) 159-171
• 49 McCoy AB, Wright A, Sittig DF. Cross-vendor evaluation of key user-defined clinical decision support capabilities: a scenario-based assessment of certified electronic health records with guidelines for future development. J Am Med Inform Assoc 2015; 22 (05) 1081-1088
• 50 ASTP. Health Data, Technology, and Interoperability: Patient Engagement, Information Sharing, and Public Health Interoperability (HTI-2) Proposed Rule. November 21, 2024. Accessed March 10, 2025 at: https://www.healthit.gov/topic/laws-regulation-and-policy/health-data-technology-and-interoperability-patient-engagement
• 51 Wilkerson RG. Drug hypersensitivity reactions. Emerg Med Clin North Am 2022; 40 (01) 39-55
• 52 Kesselheim AS, Cresswell K, Phansalkar S, Bates DW, Sheikh A. Clinical decision support systems could be modified to reduce ‘alert fatigue’ while still minimizing the risk of litigation. Health Aff (Millwood) 2011; 30 (12) 2310-2317