Ambient Artificial Intelligence Scribes in Pediatric Primary Care: A Mixed Methods Study

Abstract

Objective

Quantify the effect of ambient artificial intelligence (AI) scribe technology on work experience, clinical operations, and patient experience in pediatric primary care.

Methods

We conducted a 12-week study of 39 clinicians within a large pediatric primary care network. Clinician experience was measured using a custom survey instrument which included a combination of discrete and free-text responses. Qualitative analysis of free-text responses provided additional context and identified key facilitators and barriers to optimal usage. Proprietary electronic health record (EHR) efficiency measures and utilization data were used to further quantify clinician experience, adoption, and operational effects. Patient experience was measured using a vendor-supplied survey instrument.

Results

AI scribe technology was used in 32% of eligible encounters (6,249 of 19,264). Survey responses demonstrated significant heterogeneity in clinician experience. The most commonly reported benefits were reduction in self-perceived cognitive burden (21/39), ability to finish work sooner (18/39), and ability to enjoy clinical work more (18/39). No significant change in EHR efficiency measures around documentation time, afterhours EHR time, total EHR time, or visit closure rates were observed. Clinicians reported AI scribes were most helpful for urgent care visits and for summarizing the history of present illness. Areas of improvement specific to pediatric primary care include suboptimal performance in summarizing and organizing content relating to preventive and behavioral health visits. Patient survey responses showed no difference in Net Promoter Score and related patient experience questions between ambient and non-ambient encounters.

Discussion

A subset of clinicians reported self-perceived improvements in work experience despite unchanged EHR efficiency measures. Heterogeneity in clinician experience suggests that benefit from ambient technology likely depends on personal and contextual factors. Enhancements to note organization and facility with pediatric well child visit and behavioral health content could improve the utility of this tool for pediatric primary care.

Keywords

medical informatics - artificial intelligence - pediatrics - general practice - burnout - professional - patient satisfaction

Protection of Human and Animal Subjects

This project met our institution's definition of clinical operations and quality improvement and was thus exempt from additional Institutional Review Board review.

Publication History

Received: 31 January 2025

Accepted: 30 May 2025

Accepted Manuscript online:
02 June 2025

Article published online:
31 October 2025

• References

• 1 Tajirian T, Stergiopoulos V, Strudwick G. et al. The influence of electronic health record use on physician burnout: cross-sectional survey. J Med Internet Res 2020; 22 (07) e19274
• 2 Melnick ER, Dyrbye LN, Sinsky CA. et al. The association between perceived electronic health record usability and professional burnout among US physicians. Mayo Clin Proc 2020; 95 (03) 476-487
• 3 Shanafelt TD, Dyrbye LN, Sinsky C. et al. Relationship between clerical burden and characteristics of the electronic environment with physician burnout and professional satisfaction. Mayo Clin Proc 2016; 91 (07) 836-848
• 4 Li C, Parpia C, Sriharan A, Keefe DT. Electronic medical record-related burnout in healthcare providers: a scoping review of outcomes and interventions. BMJ Open 2022; 12 (08) e060865
• 5 Gardner RL, Cooper E, Haskell J. et al. Physician stress and burnout: the impact of health information technology. J Am Med Inform Assoc 2019; 26 (02) 106-114
• 6 Peccoralo LA, Kaplan CA, Pietrzak RH, Charney DS, Ripp JA. The impact of time spent on the electronic health record after work and of clerical work on burnout among clinical faculty. J Am Med Inform Assoc 2021; 28 (05) 938-947
• 7 Harry E, Sinsky C, Dyrbye LN. et al. Physician task load and the risk of burnout among US physicians in a national survey. Jt Comm J Qual Patient Saf 2021; 47 (02) 76-85
• 8 Budd J. Burnout related to electronic health record use in primary care. J Prim Care Community Health 2023; 14: 21 501319231166921
• 9 Downing NL, Bates DW, Longhurst CA. Physician burnout in the electronic health record era: are we ignoring the real cause?. Ann Intern Med 2018; 169 (01) 50-51
• 10 Bundy H, Gerhart J, Baek S. et al. Can the administrative loads of physicians be alleviated by AI-facilitated clinical documentation?. J Gen Intern Med 2024; 39 (15) 2995-3000
• 11 Tierney AA, Gayre G, Hoberman B. et al. Ambient artificial intelligence scribes to alleviate the burden of clinical documentation. NEJM Catal 2024 5. 03
• 12 Ma SP, Liang AS, Shah SJ. et al. Ambient artificial intelligence scribes: utilization and impact on documentation time. J Am Med Inform Assoc 2025; 32 (02) 381-385
• 13 Owens LM, Wilda JJ, Hahn PY, Koehler T, Fletcher JJ. The association between use of ambient voice technology documentation during primary care patient encounters, documentation burden, and provider burnout. Fam Pract 2024; 41 (02) 86-91
• 14 Shah SJ, Devon-Sand A, Ma SP. et al. Ambient artificial intelligence scribes: physician burnout and perspectives on usability and documentation burden. J Am Med Inform Assoc 2025; 32 (02) 375-380
• 15 Liu TL, Hetherington TC, Dharod A. et al. Does AI-powered clinical documentation enhance clinician efficiency? A longitudinal study. NEJM AI 2024 1. 12
• 16 Liu TL, Hetherington TC, Stephens C. et al. AI-powered clinical documentation and clinicians' electronic health record experience: a nonrandomized clinical trial. JAMA Netw Open 2024; 7 (09) e2432460
• 17 Miles MB, Michael Huberman A, Saldana J. Qualitative Data Analysis: A Methods Sourcebook. Thousand Oaks, CA: SAGE Publications; 2018: 549
• 18 Galloway JL, Munroe D, Vohra-Khullar PD. et al. Impact of an artificial intelligence-based solution on clinicians' clinical documentation experience: initial findings using ambient listening technology. J Gen Intern Med 2024; 39 (13) 2625-2627
• 19 Hudson TJ, Albrecht M, Smith TR. et al. Impact of ambient AI documentation on cognitive load. Mayo Clin Proc Digit Health 2025; 3 (01) 100193
• 20 Melnick ER, Harry E, Sinsky CA. et al. Perceived electronic health record usability as a predictor of task load and burnout among US physicians: mediation analysis. J Med Internet Res 2020; 22 (12) e23382
• 21 Tai-Seale M, Baxter S, Millen M. et al. Association of physician burnout with perceived EHR work stress and potentially actionable factors. J Am Med Inform Assoc 2023; 30 (10) 1665-1672
• 22 Adler-Milstein J, Zhao W, Willard-Grace R, Knox M, Grumbach K. Electronic health records and burnout: time spent on the electronic health record after hours and message volume associated with exhaustion but not with cynicism among primary care clinicians. J Am Med Inform Assoc 2020; 27 (04) 531-538