Drug Alert Experience and Salience during Medical Residency at Two Healthcare InstitutionsFunding None.
Background Drug alerts are clinical decision support tools intended to prevent medication misadministration. In teaching hospitals, residents encounter the majority of the drug alerts while learning under variable workloads and responsibilities that may have an impact on drug-alert response rates.
Objectives This study was aimed to explore drug-alert experience and salience among postgraduate year 1 (PGY-1), postgraduate year 2 (PGY-2), and postgraduate year 3 (PGY-3) internal medicine resident physicians at two different institutions.
Methods Drug-alert information was queried from the electronic health record (EHR) for 47 internal medicine residents at the University of Pennsylvania Medical Center (UPMC) Pinnacle in Pennsylvania, and 79 internal medicine residents at the MetroHealth System (MHS) in Ohio from December 2018 through February 2019. Salience was defined as the percentage of drug alerts resulting in removal or modification of the triggering order. Comparisons were made across institutions, residency training year, and alert burden.
Results A total of 126 residents were exposed to 52,624 alerts over a 3-month period. UPMC Pinnacle had 15,574 alerts with 47 residents and MHS had 37,050 alerts with 79 residents. At MHS, salience was 8.6% which was lower than UPMC Pinnacle with 15%. The relatively lower salience (42% lower) at MHS corresponded to a greater number of alerts-per-resident (41% higher) compared with UPMC Pinnacle. Overall, salience was 11.6% for PGY-1, 10.5% for PGY-2, and 8.9% for PGY-3 residents.
Conclusion Our results are suggestive of long-term drug-alert desensitization during progressive residency training. A higher number of alerts-per-resident correlating with a lower salience suggests alert fatigue; however, other factors should also be considered including differences in workload and culture.
Keywordsdrug alerts - drug fatigue - desensitization - salience rate - clinical decision support system
Protection of Human and Animal Subjects
No human subjects were involved in this project. The Institutional Review Board (IRB) was consulted, per guidelines at each institution, an IRB protocol approval was obtained as required by each institution. Program director approval was obtained from each residency program.
Received: 17 August 2020
Accepted: 22 March 2021
28 April 2021 (online)
© 2021. Thieme. All rights reserved.
Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany
- 1 Slight SP, Berner ES, Galanter W. et al. Meaningful use of electronic health records: experiences from the field and future opportunities. JMIR Med Inform 2015; 3 (03) e30
- 2 Centers for Medicare and Medicaid Services. CMS Quality Measure Development Plan Supporting the Transition to the Merit-Based Incentive Payment System (MIPS) and Alternative Payment Models. (APMs) (DRAFT). Accessed April 6, 2021 at: https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/Value-Based-Programs/MACRA-MIPS-and-APMs/Draft-CMS-Quality-Measure-Development-Plan-MDP.pdf
- 3 Lyman JA, Cohn WF, Bloomrosen M, Detmer DE. Clinical decision support: progress and opportunities. J Am Med Inform Assoc 2010; 17 (05) 487-492
- 4 Dexheimer JW, Kirkendall ES, Kouril M. et al. The effects of medication alerts on prescriber response in a pediatric hospital. Appl Clin Inform 2017; 8 (02) 491-501
- 5 Jamoom E, Beatty P, Bercovitz A, Woodwell D, Palso K, Rechtsteiner E. Physician adoption of electronic health record systems: United States, 2011. NCHS Data Brief 2012; (98) 1-8
- 6 Evans RS. Electronic health records: then, now, and in the future. Yearb Med Inform 2016; (Suppl. 01) S48-S61
- 7 Shah NR, Seger AC, Seger DL. et al. Improving acceptance of computerized prescribing alerts in ambulatory care. J Am Med Inform Assoc 2006; 13 (01) 5-11
- 8 Steele AW, Eisert S, Witter J. et al. The effect of automated alerts on provider ordering behavior in an outpatient setting. PLoS Med 2005; 2 (09) e255
- 9 McCullagh LJ, Sofianou A, Kannry J, Mann DM, McGinn TG. User centered clinical decision support tools: adoption across clinician training level. Appl Clin Inform 2014; 5 (04) 1015-1025
- 10 Ibáñez-Garcia S, Rodriguez-Gonzalez C, Escudero-Vilaplana V. et al. Development and evaluation of a clinical decision support system to improve medication safety. Appl Clin Inform 2019; 10 (03) 513-520
- 11 Lyell D, Magrabi F, Coiera E. Reduced verification of medication alerts increases prescribing errors. Appl Clin Inform 2019; 10 (01) 66-76
- 12 Segal MM, Rahm AK, Hulse NC. et al. Experience with integrating diagnostic decision support software with electronic health records: benefits versus risks of information sharing. EGEMS (Wash DC) 2017; 5 (01) 23
- 13 Sutton RT, Pincock D, Baumgart DC, Sadowski DC, Fedorak RN, Kroeker KI. An overview of clinical decision support systems: benefits, risks, and strategies for success. NPJ Digit Med 2020; 3: 17
- 14 McCoy AB, Thomas EJ, Krousel-Wood M, Sittig DF. Clinical decision support alert appropriateness: a review and proposal for improvement. Ochsner J 2014; 14 (02) 195-202
- 15 Saiyed SM, Davis KR, Kaelber DC. Differences, opportunities, and strategies in drug alert optimization-experiences of two different integrated health care systems. Appl Clin Inform 2019; 10 (05) 777-782
- 16 Russ AL, Zillich AJ, McManus MS, Doebbeling BN, Saleem JJ. A human factors investigation of medication alerts: barriers to prescriber decision-making and clinical workflow. AMIA Annu Symp Proc 2009; 2009: 548-552
- 17 Kirkendall ES, Kouril M, Minich T, Spooner SA. Analysis of electronic medication orders with large overdoses: opportunities for mitigating dosing errors. Appl Clin Inform 2014; 5 (01) 25-45
- 18 Poly TN, Islam MM, Yang H-C, Li YJ. Appropriateness of overridden alerts in computerized physician order entry: systematic review. JMIR Med Inform 2020; 8 (07) e15653
- 19 Topaz M, Seger DL, Slight SP. et al. Rising drug allergy alert overrides in electronic health records: an observational retrospective study of a decade of experience. J Am Med Inform Assoc 2016; 23 (03) 601-608
- 20 van der Sijs H, Aarts J, Vulto A, Berg M. Overriding of drug safety alerts in computerized physician order entry. J Am Med Inform Assoc 2006; 13 (02) 138-147
- 21 Ancker JS, Edwards A, Nosal S, Hauser D, Mauer E, Kaushal R. et al. Effects of workload, work complexity, and repeated alerts on alert fatigue in a clinical decision support system. BMC Med Inform Decis Mak 2017; 17: 36
- 22 Rush JL, Ibrahim J, Saul K, Brodell RT. Improving patient safety by combating alert fatigue. J Grad Med Educ 2016; 8 (04) 620-621
- 23 Cash JJ. Alert fatigue. Am J Health Syst Pharm 2009; 66 (23) 2098-2101
- 24 Weingart SN, Toth M, Sands DZ, Aronson MD, Davis RB, Phillips RS. Physicians' decisions to override computerized drug alerts in primary care. Arch Intern Med 2003; 163 (21) 2625-2631
- 25 Long A-J, Chang P, Li Y-C, Chiu W-T. The use of a CPOE log for the analysis of physicians' behavior when responding to drug-duplication reminders. Int J Med Inform 2008; 77 (08) 499-506
- 26 Zenziper Straichman Y, Kurnik D, Matok I. et al. Prescriber response to computerized drug alerts for electronic prescriptions among hospitalized patients. Int J Med Inform 2017; 107: 70-75
- 27 Knight AM, Falade O, Maygers J, Sevransky JE. Factors associated with medication warning acceptance for hospitalized adults. J Hosp Med 2015; 10 (01) 19-25
- 28 Stutman HR, Fineman R, Meyer K, Jones D. Optimizing the acceptance of medication-based alerts by physicians during CPOE implementation in a community hospital environment. AMIA Annu Symp Proc 2007; 2007: 701-705