Effect of Telemedicine and the COVID-19 Pandemic on Medical Trainees' Usage of the Electronic Health Record in the Outpatient Setting

Abstract

Objectives This study aimed to (1) determine the impact of COVID-19 (coronavirus disease 2019) and the corresponding increase in use of telemedicine on volume, efficiency, and burden of electronic health record (EHR) usage by residents and fellows; and (2) to compare these metrics with those of attending physicians.

Methods We analyzed 11 metrics from Epic's Signal database of outpatient physician user logs for active residents/fellows at our institution across three 1-month time periods: August 2019 (prepandemic/pre-telehealth), May 2020 (mid-pandemic/post-telehealth implementation), and July 2020 (follow-up period) and compared these metrics between trainees and attending physicians. We also assessed how the metrics varied for medical trainees in primary care as compared with subspecialties.

Results Analysis of 141 residents/fellows and 495 attendings showed that after telehealth implementation, overall patient volume, Time in In Basket per day, Time outside of 7 a.m. to 7 p.m., and Time in notes decreased significantly compared with the pre-telehealth period. Female residents, fellows, and attendings had a lower same day note closure rate before and during the post-telehealth implementation period and spent greater time working outside of 7 a.m. to 7 p.m. compared with male residents, fellows, and attendings (p < 0.01) compared with the pre-telehealth period. Attending physicians had a greater patient volume, spent more time, and were more efficient in the EHR compared with trainees (p < 0.01) in both the post-telehealth and follow-up periods as compared with the pre-telehealth period.

Conclusion The dramatic change in clinical operations during the pandemic serves as an inflection point to study changes in physician practice patterns in the EHR. We observed that (1) female physicians closed fewer notes the same day and spent more time in the EHR outside of normal working hours compared with male physicians, and (2) attending physicians had higher patient volumes and also higher efficiency in the EHR compared with resident physicians.

Keywords

EHR usage - telemedicine - COVID-19 - residents - fellows - attendings - physician health

Protection of Human and Animal Subjects

This study complied with the World Medical Association Declaration of Helsinki on Ethical Principles for Medical Research Involving Human Subjects and was approved by the Albert Einstein Institutional Review Board. No human subjects were involved in this project.

^# These authors contributed equally to the manuscript.

Publikationsverlauf

Eingereicht: 29. Juli 2022

Angenommen: 06. Februar 2023

Accepted Manuscript online:
09. Februar 2023

Artikel online veröffentlicht:
26. April 2023

• References

• 1 Gale R, Eberlein S, Fuller G, Khalil C, Almario CV, Spiegel BMR. Public perspectives on decisions about emergency care seeking for care unrelated to COVID-19 during the COVID-19 pandemic. JAMA Netw Open 2021; 4 (08) e2120940
• 2 Patel SY, Mehrotra A, Huskamp HA, Uscher-Pines L, Ganguli I, Barnett ML. Trends in outpatient care delivery and telemedicine during the COVID-19 pandemic in the US. JAMA Intern Med 2021; 181 (03) 388-391
• 3 Chao GF, Li KY, Zhu Z. et al. Use of telehealth by surgical specialties during the COVID-19 pandemic. JAMA Surg 2021; 156 (07) 620-626
• 4 Chu C, Cram P, Pang A, Stamenova V, Tadrous M, Bhatia RS. Rural telemedicine use before and during the COVID-19 pandemic: repeated cross-sectional study. J Med Internet Res 2021; 23 (04) e26960
• 5 Grange ES, Neil EJ, Stoffel M. et al. Responding to COVID-19: the UW Medicine Information Technology Services experience. Appl Clin Inform 2020; 11 (02) 265-275
• 6 Moore C, Valenti A, Robinson E, Perkins R. Using log data to measure provider EHR activity at a cancer center during rapid telemedicine deployment. Appl Clin Inform 2021; 12 (03) 629-636
• 7 Hron JD, Parsons CR, Williams LA, Harper MB, Bourgeois FC. Rapid implementation of an inpatient telehealth program during the COVID-19 pandemic. Appl Clin Inform 2020; 11 (03) 452-459
• 8 Chiu CY, Sarwal A, Jawed M, Chemarthi VS, Shabarek N. Telemedicine experience of NYC Internal Medicine residents during COVID-19 pandemic. PLoS One 2021; 16 (02) e0246762
• 9 Gursky JM, Boro A, Escalante S. et al. Disparities in access to neurologic telemedicine during the COVID-19 pandemic: a Bronx tale. Neurol Clin Pract 2021; 11 (02) e97-e101
• 10 Watts KL, Abraham N. “Virtually Perfect” for some but perhaps not for all: launching telemedicine in the bronx during the COVID-19 pandemic. J Urol 2020; 204 (05) 903-904
• 11 Alipour J, Hayavi-Haghighi MH. Opportunities and challenges of telehealth in disease management during COVID-19 pandemic: a scoping review. Appl Clin Inform 2021; 12 (04) 864-876
• 12 deMayo R, Huang Y, Lin ED. et al. Associations of telehealth care delivery with pediatric health care provider well-being. Appl Clin Inform 2022; 13 (01) 230-241
• 13 Anderson J, Leubner J, Brown SR. EHR overtime: an analysis of time spent after hours by family physicians. Fam Med 2020; 52 (02) 135-137
• 14 Saag HS, Shah K, Jones SA, Testa PA, Horwitz LI. Pajama time: working after work in the electronic health record. J Gen Intern Med 2019; 34 (09) 1695-1696
• 15 Gardner RL, Cooper E, Haskell J. et al. Physician stress and burnout: the impact of health information technology. J Am Med Inform Assoc 2019; 26 (02) 106-114
• 16 Downing NL, Bates DW, Longhurst CA. Physician burnout in the electronic health record era: are we ignoring the real cause?. Ann Intern Med 2018; 169 (01) 50-51
• 17 Tran B, Lenhart A, Ross R, Dorr DA. Burnout and EHR use among academic primary care physicians with varied clinical workloads. AMIA Jt Summits Transl Sci Proc 2019; 2019: 136-144
• 18 Robertson SL, Robinson MD, Reid A. Electronic health record effects on work-life balance and burnout within the I³ population collaborative. J Grad Med Educ 2017; 9 (04) 479-484
• 19 Shanafelt TD, Dyrbye LN, Sinsky C. et al. Relationship between clerical burden and characteristics of the electronic environment with physician burnout and professional satisfaction. Mayo Clin Proc 2016; 91 (07) 836-848
• 20 Sinsky CA, Rule A, Cohen G. et al. Metrics for assessing physician activity using electronic health record log data. J Am Med Inform Assoc 2020; 27 (04) 639-643
• 21 Eschenroeder HC, Manzione LC, Adler-Milstein J. et al. Associations of physician burnout with organizational electronic health record support and after-hours charting. J Am Med Inform Assoc 2021; 28 (05) 960-966
• 22 Adler-Milstein J, Zhao W, Willard-Grace R, Knox M, Grumbach K. Electronic health records and burnout: time spent on the electronic health record after hours and message volume associated with exhaustion but not with cynicism among primary care clinicians. J Am Med Inform Assoc 2020; 27 (04) 531-538
• 23 Domaney NM, Torous J, Greenberg WE. Exploring the association between electronic health record use and burnout among psychiatry residents and faculty: a pilot survey study. Acad Psychiatry 2018; 42 (05) 648-652
• 24 Holzer KJ, Lou SS, Goss CW. et al. Impact of changes in EHR use during COVID-19 on physician trainee mental health. Appl Clin Inform 2021; 12 (03) 507-517
• 25 Mosquera MJ, Ward HB, Holland C, Boland R, Torous J. Using objective clinical metrics to understand the relationship between the electronic health record and physician well-being: observational pilot study. BJPsych Open 2021; 7 (05) e174
• 26 Livingston K, Bovi J. Department-focused electronic health record thrive training. JAMIA Open 2022; 5 (02) ooac025
• 27 Khairat S, Zalla L, Gartland A, Seashore C. Association between proficiency and efficiency in electronic health records among pediatricians at a major academic health system. Front Digit Health 2021; 3: 689646
• 28 Hollister-Meadows L, Richesson RL, De Gagne J, Rawlins N. Association between evidence-based training and clinician proficiency in electronic health record use. J Am Med Inform Assoc 2021; 28 (04) 824-831
• 29 Naidich JJ, Boltyenkov A, Wang JJ, Chusid J, Hughes D, Sanelli PC. Impact of the coronavirus disease 2019 (COVID-19) pandemic on imaging case volumes. J Am Coll Radiol 2020; 17 (07) 865-872
• 30 Berkenstock MK, Liberman P, McDonnell PJ, Chaon BC. Changes in patient visits and diagnoses in a large academic center during the COVID-19 pandemic. BMC Ophthalmol 2021; 21 (01) 139
• 31 Berg GM, Wyse RJ, Morse JL. et al. Decreased adult trauma admission volumes and changing injury patterns during the COVID-19 pandemic at 85 trauma centers in a multistate healthcare system. Trauma Surg Acute Care Open 2021; 6 (01) e000642
• 32 Holmgren AJ, Downing NL, Tang M, Sharp C, Longhurst C, Huckman RS. Assessing the impact of the COVID-19 pandemic on clinician ambulatory electronic health record use. J Am Med Inform Assoc 2022; 29 (03) 453-460
• 33 Beiser M, Lu V, Paul S. et al. Electronic health record usage patterns: assessing telemedicine's impact on the provider experience during the COVID-19 pandemic. Telemed J E Health 2021; 27 (08) 934-938
• 34 Phadke NA, Del Carmen MG, Goldstein SA. et al. Trends in ambulatory electronic consultations during the COVID-19 pandemic. J Gen Intern Med 2020; 35 (10) 3117-3119
• 35 Jelinek R, Pandita D, Linzer M, Engoang JBBN, Rodin H. An evidence-based roadmap for the provision of more equitable telemedicine. Appl Clin Inform 2022; 13 (03) 612-620
• 36 Lasalvia A, Amaddeo F, Porru S. et al. Levels of burn-out among healthcare workers during the COVID-19 pandemic and their associated factors: a cross-sectional study in a tertiary hospital of a highly burdened area of north-east Italy. BMJ Open 2021; 11 (01) e045127
• 37 Torrente M, Sousa PA, Sánchez-Ramos A. et al. To burn-out or not to burn-out: a cross-sectional study in healthcare professionals in Spain during COVID-19 pandemic. BMJ Open 2021; 11 (02) e044945
• 38 Amanullah S, Ramesh Shankar R. The impact of COVID-19 on physician burnout globally: a review. Healthcare (Basel) 2020; 8 (04) 421
• 39 Abdulah DM, Musa DH. Insomnia and stress of physicians during COVID-19 outbreak. Sleep Med X 2020; 2: 100017
• 40 Civantos AM, Byrnes Y, Chang C. et al. Mental health among otolaryngology resident and attending physicians during the COVID-19 pandemic: national study. Head Neck 2020; 42 (07) 1597-1609
• 41 Tajirian T, Stergiopoulos V, Strudwick G. et al. The influence of electronic health record use on physician burnout: cross-sectional survey. J Med Internet Res 2020; 22 (07) e19274
• 42 Johnson KB, Neuss MJ, Detmer DE. Electronic health records and clinician burnout: a story of three eras. J Am Med Inform Assoc 2021; 28 (05) 967-973
• 43 Baptista S, Teixeira A, Castro L. et al. Physician burnout in primary care during the COVID-19 pandemic: a cross-sectional study in Portugal. J Prim Care Community Health 2021;12:21501327211008437
• 44 McPeek-Hinz E, Boazak M, Sexton JB. et al. Clinician burnout associated with sex, clinician type, work culture, and use of electronic health records. JAMA Netw Open 2021; 4 (04) e215686
• 45 Linzer M, Stillman M, Brown R. et al; American Medical Association–Hennepin Healthcare System Coping With COVID Investigators. Preliminary report: US physician stress during the early days of the COVID-19 pandemic. Mayo Clin Proc Innov Qual Outcomes 2021; 5 (01) 127-136
• 46 Shanafelt TD, West CP, Sinsky C. et al. Changes in burnout and satisfaction with work-life integration in physicians and the general US working population between 2011 and 2020. Mayo Clin Proc 2022; 97 (03) 491-506
• 47 Ruan E, Beiser M, Lu V. et al. Physician electronic health record usage as affected by the COVID-19 pandemic. Appl Clin Inform 2022; 13 (04) 785-793
• 48 Gupta KMS, Sarkar U, Mourad M, Adler-Milstein J. Differences in ambulatory EHR use patterns for male vs. female physicians. NEJM Catal 2019
• 49 Tait SD, Oshima SM, Ren Y. et al. Electronic health record use by sex among physicians in an academic health care system. JAMA Intern Med 2021; 181 (02) 288-290
• 50 Overhage JM, McCallie Jr D. Physician time spent using the electronic health record during outpatient encounters: a descriptive study. Ann Intern Med 2020; 172 (03) 169-174
• 51 Young RA, Burge SK, Kumar KA, Wilson JM, Ortiz DF. A time-motion study of primary care physicians' work in the electronic health record era. Fam Med 2018; 50 (02) 91-99
• 52 Wang JK, Ouyang D, Hom J, Chi J, Chen JH. Characterizing electronic health record usage patterns of inpatient medicine residents using event log data. PLoS One 2019; 14 (02) e0205379