Download PDF
Appl Clin Inform 2025; 16(05): 1578-1587
DOI: 10.1055/a-2625-0750
Special Topic on Reducing Technology-Related Stress and Burnout

Ambient Artificial Intelligence Scribes in Pediatric Primary Care: A Mixed Methods Study

Authors

  • Naveed Rabbani

    1   Pediatric Physicians' Organization at Children's, Wellesley, Massachusetts, United States
    2   Boston Children's Hospital, Boston, Massachusetts, United States
    3   Harvard Medical School, Boston, Massachusetts, United States

  • Mondira Ray

    2   Boston Children's Hospital, Boston, Massachusetts, United States
    3   Harvard Medical School, Boston, Massachusetts, United States

  • Eleanor Verhagen

    1   Pediatric Physicians' Organization at Children's, Wellesley, Massachusetts, United States

  • Jonathan Hatoun

    1   Pediatric Physicians' Organization at Children's, Wellesley, Massachusetts, United States
    2   Boston Children's Hospital, Boston, Massachusetts, United States
    3   Harvard Medical School, Boston, Massachusetts, United States

  • Laura Burckett Patane

    1   Pediatric Physicians' Organization at Children's, Wellesley, Massachusetts, United States

  • Louis Vernacchio

    1   Pediatric Physicians' Organization at Children's, Wellesley, Massachusetts, United States
    2   Boston Children's Hospital, Boston, Massachusetts, United States
    3   Harvard Medical School, Boston, Massachusetts, United States

Funding M.R. is supported by the Biomedical Informatics and Data Science Research Training Program grant (grant no.: T15LM007092).
Further Information
Also available at
   Permissions and Reprints

Abstract

Objective

Quantify the effect of ambient artificial intelligence (AI) scribe technology on work experience, clinical operations, and patient experience in pediatric primary care.

Methods

We conducted a 12-week study of 39 clinicians within a large pediatric primary care network. Clinician experience was measured using a custom survey instrument which included a combination of discrete and free-text responses. Qualitative analysis of free-text responses provided additional context and identified key facilitators and barriers to optimal usage. Proprietary electronic health record (EHR) efficiency measures and utilization data were used to further quantify clinician experience, adoption, and operational effects. Patient experience was measured using a vendor-supplied survey instrument.

Results

AI scribe technology was used in 32% of eligible encounters (6,249 of 19,264). Survey responses demonstrated significant heterogeneity in clinician experience. The most commonly reported benefits were reduction in self-perceived cognitive burden (21/39), ability to finish work sooner (18/39), and ability to enjoy clinical work more (18/39). No significant change in EHR efficiency measures around documentation time, afterhours EHR time, total EHR time, or visit closure rates were observed. Clinicians reported AI scribes were most helpful for urgent care visits and for summarizing the history of present illness. Areas of improvement specific to pediatric primary care include suboptimal performance in summarizing and organizing content relating to preventive and behavioral health visits. Patient survey responses showed no difference in Net Promoter Score and related patient experience questions between ambient and non-ambient encounters.

Discussion

A subset of clinicians reported self-perceived improvements in work experience despite unchanged EHR efficiency measures. Heterogeneity in clinician experience suggests that benefit from ambient technology likely depends on personal and contextual factors. Enhancements to note organization and facility with pediatric well child visit and behavioral health content could improve the utility of this tool for pediatric primary care.

Keywords

medical informatics - artificial intelligence - pediatrics - general practice - burnout - professional - patient satisfaction

Protection of Human and Animal Subjects

This project met our institution's definition of clinical operations and quality improvement and was thus exempt from additional Institutional Review Board review.


Supplementary Material



Publication History

Received: 31 January 2025

Accepted: 30 May 2025

Accepted Manuscript online:
02 June 2025

Article published online:
31 October 2025

© 2025. Thieme. All rights reserved.

Georg Thieme Verlag KG
Oswald-Hesse-Straße 50, 70469 Stuttgart, Germany

 

  • References

  • 1 Tajirian T, Stergiopoulos V, Strudwick G. et al. The influence of electronic health record use on physician burnout: cross-sectional survey. J Med Internet Res 2020; 22 (07) e19274
    Search in Google Scholar
  • 2 Melnick ER, Dyrbye LN, Sinsky CA. et al. The association between perceived electronic health record usability and professional burnout among US physicians. Mayo Clin Proc 2020; 95 (03) 476-487
    Search in Google Scholar
  • 3 Shanafelt TD, Dyrbye LN, Sinsky C. et al. Relationship between clerical burden and characteristics of the electronic environment with physician burnout and professional satisfaction. Mayo Clin Proc 2016; 91 (07) 836-848
    Search in Google Scholar
  • 4 Li C, Parpia C, Sriharan A, Keefe DT. Electronic medical record-related burnout in healthcare providers: a scoping review of outcomes and interventions. BMJ Open 2022; 12 (08) e060865
    Search in Google Scholar
  • 5 Gardner RL, Cooper E, Haskell J. et al. Physician stress and burnout: the impact of health information technology. J Am Med Inform Assoc 2019; 26 (02) 106-114
    Search in Google Scholar
  • 6 Peccoralo LA, Kaplan CA, Pietrzak RH, Charney DS, Ripp JA. The impact of time spent on the electronic health record after work and of clerical work on burnout among clinical faculty. J Am Med Inform Assoc 2021; 28 (05) 938-947
    Search in Google Scholar
  • 7 Harry E, Sinsky C, Dyrbye LN. et al. Physician task load and the risk of burnout among US physicians in a national survey. Jt Comm J Qual Patient Saf 2021; 47 (02) 76-85
    Search in Google Scholar
  • 8 Budd J. Burnout related to electronic health record use in primary care. J Prim Care Community Health 2023; 14: 21 501319231166921
    Search in Google Scholar
  • 9 Downing NL, Bates DW, Longhurst CA. Physician burnout in the electronic health record era: are we ignoring the real cause?. Ann Intern Med 2018; 169 (01) 50-51
    Search in Google Scholar
  • 10 Bundy H, Gerhart J, Baek S. et al. Can the administrative loads of physicians be alleviated by AI-facilitated clinical documentation?. J Gen Intern Med 2024; 39 (15) 2995-3000
    Search in Google Scholar
  • 11 Tierney AA, Gayre G, Hoberman B. et al. Ambient artificial intelligence scribes to alleviate the burden of clinical documentation. NEJM Catal 2024 5. 03
    Search in Google Scholar
  • 12 Ma SP, Liang AS, Shah SJ. et al. Ambient artificial intelligence scribes: utilization and impact on documentation time. J Am Med Inform Assoc 2025; 32 (02) 381-385
    Search in Google Scholar
  • 13 Owens LM, Wilda JJ, Hahn PY, Koehler T, Fletcher JJ. The association between use of ambient voice technology documentation during primary care patient encounters, documentation burden, and provider burnout. Fam Pract 2024; 41 (02) 86-91
    Search in Google Scholar
  • 14 Shah SJ, Devon-Sand A, Ma SP. et al. Ambient artificial intelligence scribes: physician burnout and perspectives on usability and documentation burden. J Am Med Inform Assoc 2025; 32 (02) 375-380
    Search in Google Scholar
  • 15 Liu TL, Hetherington TC, Dharod A. et al. Does AI-powered clinical documentation enhance clinician efficiency? A longitudinal study. NEJM AI 2024 1. 12
    Search in Google Scholar
  • 16 Liu TL, Hetherington TC, Stephens C. et al. AI-powered clinical documentation and clinicians' electronic health record experience: a nonrandomized clinical trial. JAMA Netw Open 2024; 7 (09) e2432460
    Search in Google Scholar
  • 17 Miles MB, Michael Huberman A, Saldana J. Qualitative Data Analysis: A Methods Sourcebook. Thousand Oaks, CA: SAGE Publications; 2018: 549
    Search in Google Scholar
  • 18 Galloway JL, Munroe D, Vohra-Khullar PD. et al. Impact of an artificial intelligence-based solution on clinicians' clinical documentation experience: initial findings using ambient listening technology. J Gen Intern Med 2024; 39 (13) 2625-2627
    Search in Google Scholar
  • 19 Hudson TJ, Albrecht M, Smith TR. et al. Impact of ambient AI documentation on cognitive load. Mayo Clin Proc Digit Health 2025; 3 (01) 100193
    Search in Google Scholar
  • 20 Melnick ER, Harry E, Sinsky CA. et al. Perceived electronic health record usability as a predictor of task load and burnout among US physicians: mediation analysis. J Med Internet Res 2020; 22 (12) e23382
    Search in Google Scholar
  • 21 Tai-Seale M, Baxter S, Millen M. et al. Association of physician burnout with perceived EHR work stress and potentially actionable factors. J Am Med Inform Assoc 2023; 30 (10) 1665-1672
    Search in Google Scholar
  • 22 Adler-Milstein J, Zhao W, Willard-Grace R, Knox M, Grumbach K. Electronic health records and burnout: time spent on the electronic health record after hours and message volume associated with exhaustion but not with cynicism among primary care clinicians. J Am Med Inform Assoc 2020; 27 (04) 531-538
    Search in Google Scholar