Appl Clin Inform 2024; 15(01): 034-044
DOI: 10.1055/a-2194-1061
Research Article

Electronic Health Record Usage Patterns Across Surgical Subspecialties

Autoren

  • Kevin Tang*

    1   Albert Einstein College of Medicine, Bronx, New York, United States
  • Kevin Labagnara*

    1   Albert Einstein College of Medicine, Bronx, New York, United States
  • Mustufa Babar

    1   Albert Einstein College of Medicine, Bronx, New York, United States
  • Justin Loloi

    2   Department of Urology, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, New York, United States
  • Kara L. Watts

    2   Department of Urology, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, New York, United States
  • Sunit Jariwala

    3   Department of Medicine, Division of Allergy/Immunology, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, New York, United States
  • Nitya Abraham

    2   Department of Urology, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, New York, United States

Funding None.
 

Abstract

Objectives This study aimed to utilize metrics from physician action logs to analyze surgeon clinical, volume, electronic health record (EHR) efficiency, EHR proficiency, and workload outside scheduled time as impacted by physician characteristics such as years of experience, gender, subspecialty, academic title, and administrative title.

Methods We selected 30 metrics from Epic Signal, an analytic tool in Epic that extracts metrics related to clinician documentation. Metrics measuring appointments, messages, and scheduled hours per day were used as a correlate for volume. EHR efficiency, and proficiency were measured by scores built into Epic Signal. Metrics measuring time spent in the EHR outside working hours were used as a correlate for documentation burden. We analyzed these metrics among surgeons at our institution across 4 months and correlated them with physician characteristics.

Results Analysis of 133 surgeons showed that, when stratified by gender, female surgeons had significantly higher EHR metrics for time per day, time per appointment, and documentation burden, and significantly lower EHR metrics for efficiency when compared to male surgeons. When stratified by experience, surgeons with 0 to 5 years of experience had significantly lower EHR metrics for volume, time per day, efficiency, and proficiency when compared to surgeons with 6 to 10 and more than 10 years of experience. On multivariate analysis, having over 10 years of experience was an independent predictor of more appointments per day, greater proficiency, and spending less time per completed message. Female gender was an independent predictor of spending more time in notes per appointment and time spent in the EHR outside working hours.

Conclusion The burden associated with volume, proficiency, efficiency, and workload outside scheduled time related to EHR use varies by gender and years of experience in our cohort of surgeons. Evaluation of physician action logs could help identify those at higher risk of burnout due to burdensome medical documentation.


Background and Significance

Since the American Recovery and Reinvestment Act, physicians' use of electronic health records (EHR) has risen from 9% in 2008 to 96% in 2017, primarily due to its use as a requirement for clinicians who seek to receive Medicaid and Medicare reimbursement.[1] [2] Although EHR implementation has led to quicker and more efficient information sharing between institutions and vastly improved continuity of patient care, there are unique challenges that physicians face in having to care for patients while also fulfilling required electronic documentation. Several recent studies have associated EHR use with an increase in clinician frustration and burnout with many clinicians citing EHR use as a major contributor to their feelings of burnout.[3] [4] [5] [6] [7] [8] [9] [10]

Across general surgery and the surgical subspecialities, quantitative evidence demonstrating the struggles of EHR documentation is lacking. Few studies have described the time spent on the EHR in individual surgical specialties, such as general surgery, vascular surgery, orthopaedic surgery, and ophthalmology. Despite this, none have broadly analyzed all surgical fields and attempted to describe predictors of time spent on EHR.[11] [12] [13] [14] [15] Moreover, there is evidence highlighting that women and less experienced clinicians spend more time on the EHR, possibly correlating with more feelings of burnout.[16] However, these studies were limited to the ambulatory setting and lacked an analysis on clinician characteristics, such as age, gender, and experience.


Objectives

The objective of the current study is to identify and evaluate the impact of surgeon-level characteristics on volume, efficiency, proficiency, and burden as it pertains to EHR usage by surgeons across various surgical specialties. Given that current literature indicates that certain surgeon-level characteristics, such as being female and having fewer years of experience, are associated with higher EHR burden,[16] we hypothesize that males and those with more years of experience will handle higher volumes more efficiently and proficiently, resulting in lower EHR burden.


Methods

Data on surgeon EHR usage were collected using Epic Signal, a software that can extract a variety of clinician outpatient documentation over a specified period in the EHR system Epic.[17] [18] [19] Institutional review board approval was obtained prior to study commencement. Clinician data from each month between February and June of 2022 were collected and included those from the fields of general surgery, cardiothoracic surgery, neurosurgery, orthopaedic surgery, otolaryngology, plastic and reconstructive surgery, urology, vascular surgery, and pediatric surgery. Those from the department of transplant surgery, ophthalmology, and obstetrics and gynecology were excluded due to their unique work schedules. Surgeons not working full-time over the course of 5 months were excluded, along with those holding the most senior administrative positions in their respective departments.

Surgeon demographic characteristics were collected from the Montefiore physician directory, Albert Einstein College of Medicine faculty, and their public profile on Doximity. Demographic information collected included years of experience, gender, specialty, academic title, and administrative title. Surgeon experience was evaluated as the number of years practicing as an attending, which was determined from the surgeon's year of graduation from their last residency or fellowship. Metrics including appointments per day, scheduled hours per day, messages per day, time in system, time in notes per appointment, time per completed message, proficiency score, time on unscheduled days, and time outside of 7 a.m. to 7 p.m. were collected for each of the 5 months in the study and averaged for each surgeon. A detailed breakdown of surgeon electronic medical record (EMR) metrics is provided in [Table 1].

Table 1

Description of Epic Signal outcome metrics

Metric

Description

Volume

Appointments per day

Average number of appointments per day

Percentage of days with appointments

Percentage of days in the reporting period with at least one appointment

Scheduled hours per day

Average number of hours scheduled per provider per day

Aggregate messages per day

Average number of in-basket messages received per provider per day

Time per day

Time in system

Average number of minutes the provider was logged into the system per day

Time in notes

Average number of minutes the provider spends in notes each day

Time in clinical review

Average number of minutes the provider spent per day in clinical review activities, such as Chart Review

Time in schedule

Average number of minutes spent in the schedule per provider per day

Time in orders

Average number of minutes the provider spends in orders per day

Time in visit navigator

Average number of minutes spent in a visit navigator per provider per day

Time in in-basket

Average number of minutes spent in in-basket per provider per day

Percentage of time in ambulatory

Percentage of time spent in system in ambulatory functions

Percentage of time in ED

Percentage of time spent in system in emergency department functions

Percentage of time in inpatient

Percentage of time spent in system in inpatient functions

Time per appointment

Time in notes

Minutes spent writing notes per appointment

Time in clinical review

Minutes spent in clinical review activities per appointment

Time in in-basket

Minutes spent in in-basket per scheduled appointment

Time in orders

Minutes spent in orders per scheduled appointment

Efficiency

Percentage appointments closed same day

Percentage of appointments that were closed the same day as the appointment date

Time in notes per note

Average number of minutes spent writing a note for each note written per provider

Time per completed message

Average number of minutes the provider spent in in-basket per completed message

Documentation length per note

Average number of characters per note written by the provider

Progress note length

Average number of characters per progress note written by the provider

Orders with team contributions

Percentage of orders signed by the provider that were pended by another provider

Proficiency

Proficiency score

How frequently the provider uses the following efficiency tools:

• 0.01 points per QuickAction used, up to 100 uses

• 0.01 points per provider preference list entry, up to 100 entries

• 0.2 points per 10% of notes written using Smart Tools

• 2 points for having customized level of service speed buttons

• 2 points for having customized diagnosis speed buttons

• 2 points for using Chart Search

Workload outside scheduled time

Pajama time

Average number of minutes spent in charting activities on weekdays outside 7:00 a.m. and 5:30 p.m. and any time on weekends and nonscheduled holidays. This metric does not include time spent during scheduled hours on any day of the week

Time on unscheduled days

Average number of minutes spent in the system on days with no scheduled patients

Time outside of 7 a.m. to 7 p.m.

Average number of minutes spent in the system outside of 7 a.m. to 7 p.m.

Time outside scheduled hours

Average number of minutes spent in the system outside of scheduled hours. Scheduled hours are determined using Cadence schedule data and this metric has a 30-minute buffer before the start of the first appointment and after the end of the last appointment

Abbreviation: ED, Emergency Department.


For all time-related metrics, time was measured starting from the moment the physician logged into the Epic system and began actively interacting with it, including any mouse activity, clicks, scrolling, and key presses. Periods of inactivity longer than 5 seconds, or instances when the physician logged out of the Epic system, resulted in pauses in the time measurement. Metrics were collected solely from surgeons' individual Epic accounts, and not from other health care providers who may have assisted in patient care. Proficiency, scaled from 0 to 10, reflects the frequency with which a physician utilizes Epic's integrated efficiency features such as chart search, preference lists, quick action tools, and speed buttons.

Descriptive statistics were generated for all metrics during the specified time period among all physicians, by gender and by years of experience. Years of experience was categorized as groups of 0 to 5, 6 to 10, and >10 years. Chi-square tests were used to compare categorical variables. Due to their skewed distributions, continuous metrics were analyzed using Mann–Whitney U tests for gender, and Kruskal–Wallis tests for years of experience.

Univariate analyses to analyze the association of select outcome metrics with gender, years of experience, pediatric specialty, associate professor tenure, and holding an administrative position were performed using linear regression. These metrics include appointments per day, scheduled hours per day, messages per day, time in system, time in notes per appointment, time per completed message, proficiency score, time on unscheduled days, and time outside of 7 a.m. to 7 p.m. Multivariate regression models that included all the aforementioned predictors were then generated for each outcome metric. Significance level of p-values for all tests was set at <0.05. All statistical analysis was performed using SPSS v28.0 (IBM Corp., Armonk, NY).


Results

A total of 158 surgeons were screened for eligibility, of which 133 (84.2%) met inclusion. Twenty-five surgeons were excluded for the following reasons: within the department of transplant surgery (9), not working full-time over the course of the 5 months (4), and holding the most senior administrative positions (12).

All Surgeons

The majority of surgeons were males (70.7%), in the specialty of Orthopaedic Surgery (27.8%), held the administrative title of assistant professor (68.0%) and had >10 years of experience (38.3%). All surgeons had a median of 18.6 appointments (13.2–26.5) per day, spent a median of 3.5 minutes (2.0–5.7 min) in in-basket per day, and 2.4 minutes (1.6–4.1 min) in Notes per appointment. In terms of efficiency, all surgeons closed 81.5% (49.7–94.8%) of appointments the same day and spent 0.4 minute (0.2–0.6 min) per completed message. All surgeons spent a median of 19.4 minutes (11.6–33.6 min) on unscheduled days with a median pajama time of 10.4 minutes (4.5–24.5 min; [Table 2]).

Table 2

Descriptive statistics of outcome metrics by gender

All providers

Male

Female

p-Value

n (%)

133

94 (70.7)

39 (29.3)

Experience, n (%)

0.91

 0 to 5 years

41 (30.8)

28 (29.8)

13 (33.3)

 6 to 10 years

41 (30.8)

29 (30.9)

12 (30.8)

 >10 years

51 (38.3)

37 (39.4)

14 (35.9)

Specialty, n (%)

0.010

 Cardiothoracic surgery

8 (6.0)

7 (7.4)

1 (2.6)

 Neurosurgery

10 (7.5)

9 (9.6)

1 (2.6)

 Orthopaedic surgery

37 (27.8)

33 (35.1)

4 (10.3)

 Otolaryngology

20 (15.0)

10 (10.6)

10 (25.6)

 Plastic/Reconstructive surgery

7 (5.3)

5 (5.3)

2 (5.1)

 Surgery

29 (21.8)

18 (19.1)

11 (28.2)

 Urology

15 (11.3)

7 (7.4)

8 (20.5)

 Vascular surgery

7 (5.3)

5 (5.3)

2 (5.1)

 Pediatric (across all specialties)[a]

18 (13.5)

9 (9.6)

9 (23.1)

0.038

Title, n (%)

0.48

 Professor

8 (6.3)

7 (7.8)

1 (2.6)

 Associate professor

33 (25.8)

24 (26.7)

9 (23.7)

 Assistant professor

87 (68.0)

59 (65.6)

28 (73.7)

 Admin position[a]

53 (39.8)

41 (43.6)

12 (30.8)

0.17

Volume, median (IQR)

 Appointments per day

18.6 (13.2–26.5)

19.5 (12.4–29.0)

17.1 (13.3–22.5)

0.19

 Percentage of days with appointments

27.0 (18.2–35.9)

27.4 (18.5–35.9)

26.7 (17.7–36.0)

0.72

 Scheduled hours per day

5.7 (3.7–7.7)

6.0 (3.4–7.9)

5.5 (4.2–6.4)

0.38

 Aggregate messages per day

11.5 (7.9–19.9)

11.1 (7.5–20.3)

14.0 (8.5–18.3)

0.44

Time per day, median (IQR)

 Time in system (min)

57.5 (27.2–96.1)

53.3 (24.4–90.8)

73.6 (40.1–110.0)

0.046

 Time in notes (min)

18.1 (7.6–37.0)

16.1 (7.1–35.8)

30.2 (10.3–39.8)

0.067

 Time in clinical review (min)

9.7 (5.5–14.7)

8.8 (5.4–13.9)

11.6 (7.2–17.4)

0.06

 Time in schedule (min)

7.9 (3.8–12.6)

7.5 (3.7–12.7)

9.4 (5.2–11.9)

0.54

 Time in orders (min)

6.9 (2.5–13.4)

5.7 (2.1–13.4)

8.9 (4.0–15.0)

0.13

 Time in visit navigator (min)

4.1 (2.1–7.3)

3.6 (2.0–6.2)

5.3 (2.7–7.9)

0.05

 Time in in-basket (min)

3.5 (2.0–5.7)

3.4 (1.3–5.3)

4.5 (2.9–7.6)

0.016

 Percentage of time in system: ambulatory

57.3 (41.2–66.6)

56.1 (35.8–66.6)

61.4 (52.1–66.9)

0.26

 Percentage of time in system: ED

0.2 (0.0–1.0)

0.1 (0.0–1.0)

0.1 (0.0–0.8)

0.91

 Percentage of time in system: inpatient

11.9 (5.9–21.8)

12.6 (5.9–24.2)

7.4 (5.9–16.5)

0.11

Time per appointment, median (IQR)

 Time in notes (min)

2.4 (1.6–4.1)

2.1 (1.4–3.7)

3.2 (2.0–4.8)

0.009

 Time in clinical review (min)

1.4 (0.7–2.3)

1.4 (0.6–2.1)

1.7 (1.0–2.7)

0.084

 Time in in-basket (min)

0.5 (0.2–1.0)

0.4 (0.2–1.0)

0.7 (0.5–1.2)

0.01

 Time in orders (min)

0.8 (0.4–1.4)

0.7 (0.4–1.2)

1.2 (0.5–2.1)

0.01

Efficiency, median (IQR)

 Percentage of appointments closed same day

81.5 (49.7–94.8)

82.3 (46.9–96.3)

77.5 (50.0–87.4)

0.56

 Time in notes per note (min)

1.8 (1.2–3.1)

1.8 (1.1–3.2)

2.2 (1.3–3.1)

0.4

 Time per completed message (min)

0.4 (0.2–0.6)

0.4 (0.3–0.6)

0.5 (0.3–0.7)

0.045

 Documentation length per note (characters)

2,278 (1,605–4,113)

2,365 (1,491–4,295)

2,148 (1,714–2,879)

0.27

 Progress note length (characters)

4,495 (3,250–5,780)

4,585 (2,855–5,982)

4,400 (3,386–5,373)

0.8

 Orders with team contributions (%)

7.3 (0.9–51.8)

7.5 (0.6–54.6)

7.3 (1.5–47.7)

0.77

Proficiency, median (IQR)

 Proficiency score

3.4 (2.1–6.0)

3.7 (1.9–6.5)

3.2 (2.2–5.2)

0.21

Workload outside scheduled time, median (IQR)

 Pajama time (min)

10.4 (4.5–24.5)

8.6 (4.2–26.0)

12.5 (6.5–23.4)

0.56

 Time on unscheduled days (min)

19.4 (11.6–33.6)

17.2 (10.2–31.4)

23.4 (15.9–39.6)

0.023

 Time outside 7 a.m. to 7 p.m. (min)

6.3 (2.2–15.8)

5.5 (2.3–14.5)

9.4 (2.1–21.7)

0.18

 Time outside scheduled hours (min)

19.1 (8.4–28.8)

17.9 (7.9–31.0)

21.0 (12.2–25.5)

0.55

Abbreviation: IQR, interquartile range.


a Pediatric and Admin position were tested separately.



Gender

When stratified by gender, the majority of surgeons were males (70.7%). A significantly greater proportion of male surgeons were in the specialty of Orthopaedic Surgery (male 35.1% vs. female 10.3%, p = 0.010) when compared to other specialties. On the contrary, a significantly greater proportion of female surgeons were in the specialty of Otolaryngology (female 25.6% vs. male 10.6%, p = 0.010), Urology (female 28.2% vs. male 19.1%, p = 0.010), and Pediatrics (female 23.1% vs. male 9.6%, p = 0.038). There were no significant differences in years of experience or academic and administrative titles between genders.

Female surgeons had significantly higher EHR metrics for time per day, time per appointment, and documentation burden, and significantly lower EHR metric for efficiency when compared to male surgeons. More specifically, for time per day, female surgeons spent significantly more time in the system (female 73.6 min [40.1–110.0 min] vs. male 53.3 min [24.4–90.8 min], p = 0.046), time in visit navigator (female 5.3 min [2.7–7.9 min] vs. male 3.6 min [2.0–6.2 min], p = 0.05), and time in basket (female 4.5 min [2.9–7.6 min] vs. male 3.4 min [1.3–5.3 min], p = 0.016). For time per appointment, female surgeons spent significantly more time in notes (female 3.2 min [2.0–4.8 min] vs. male 2.1 min [1.4–3.7 min], p = 0.009), time in basket (female 0.7 min [0.5–1.2 min] vs. male 0.4 min [0.2–1.0 min], p = 0.01), and time in orders (female 1.2 min [0.5–2.1 min] vs. male 0.7 min [0.4–1.2 min], p = 0.01). Regarding workload outside scheduled time metrics, female surgeons spent significantly more time on unscheduled days (female 23.4 min [15.9–39.6 min] vs. male 17.2 min [10.2–31.4 min], p = 0.023). For efficiency, female surgeons spent significantly more time per completed message (female 0.5 min [0.3–0.7 min] vs. male 0.4 min [0.2–0.6 min], p = 0.045). There were no significant differences in the EHR metrics of volume or proficiency between genders ([Table 2]).


Years of Experience

When stratified by years of experience, there were similar number of surgeons in each group: 0 to 5 years (30.8%), 6 to 10 years (30.8%), >10 years (38.3%). Surgeons with 6 to 10 or >10 years of experience held significantly more admin positions (0–5 years 7.3% vs. 6–10 years 53.7% vs. >10 years 54.9%, p < 0.001), while surgeons with 0 to 5 years of experience held significantly more assistant professor positions (0–5 years 94.9% vs. 6–10 years 67.5% vs. >10 years 46.9%, p < 0.001).

Surgeons with 0 to 5 years of experience had significantly lower EHR metrics for volume, time per day, efficiency, and proficiency when compared to surgeons with 6 to 10 and >10 years of experience. More specifically, for volume, surgeons with 0 to 5 years of experience had significantly fewer appointments per day (0–5 years 14.7 [9.4–25.0] vs. 6–10 years 19.7 [15.1–24.7] vs. >10 years 19.3 [15.0–30.5], p = 0.017), fewer scheduled hours per day (0–5 years 4.4 [3.0–6.4] vs. 6–10 years 6.0 [4.3–7.7] vs. >10 years 5.9 [4.2–8.4], p = 0.041), and aggregate messages per day (0–5 years 8.9 [5.6–16.6] vs. 6–10 years 14.5 [9.6–21.1] vs. >10 years 11.3 [8.7–19.4], p = 0.015). For time per day, surgeons with 0 to 5 years of experience spent significantly less time in orders (0–5 years 3.4 min [0.9–10.5 min] vs. 6–10 years 7.6 min [3.7–13.6 min] vs. >10 years 8.9 min [3.4–15.0 min], p = 0.034), and time in visitor navigator (0–5 years 2.8 min [1.3–5.9 min] vs. 6–10 years 4.5 min [2.4–7.3 min] vs. >10 years 4.3 min [2.7–8.0], p = 0.023). For efficiency, surgeons with 0 to 5 years of experience spent significantly more time per note (0–5 years 2.4 min [1.5–4.4 min] vs. 6–10 years 1.4 min [1.1–2.7 min] vs. >10 years 1.8 min [1.2–2.9 min], p = 0.016) and time per completed message (0–5 years 0.6 min [0.3–0.8] vs. 6–10 years 0.4 min [0.2–0.6] vs. >10 years 0.3 min [0.2–0.5 min], p = 0.002). For proficiency, surgeons with 0 to 5 years of experience had a significantly lower proficiency score (0–5 years 2.9 [1.6–4.5] vs. 6–10 years 3.3 [2.2–4.5] vs. >10 years 5.2 [2.6–6.6], p = 0.035). There were no significant differences in the EHR metrics of specialty or workload outside scheduled time across years of experience ([Table 3]).

Table 3

Descriptive statistics of outcome metrics by years of experience

All providers

0 to 5 years

6 to 10 years

>10 years

p-Value

n (%)

133

41 (30.8)

41 (30.8)

51 (38.3)

Gender, n (%)

0.91

 Male

94 (70.7)

28 (68.3)

29 (70.7)

37 (72.5)

 Female

39 (29.3)

13 (31.7)

12 (29.3)

14 (27.5)

Specialty, n (%)

0.35

 Cardiothoracic Surgery

8 (6.0)

3 (7.3)

3 (7.3)

2 (3.9)

 Neurosurgery

10 (7.5)

6 (14.6)

2 (4.9)

2 (3.9)

 Orthopaedic surgery

37 (27.8)

9 (22.0)

10 (24.4)

18 (35.3)

 Otolaryngology

20 (15.0)

5 (12.2)

9 (22.0)

6 (11.8)

 Plastic/Reconstructive surgery

7 (5.3)

2 (4.9)

3 (7.3)

2 (3.9)

 Surgery

29 (21.8)

8 (19.5)

6 (14.6)

15 (29.4)

 Urology

15 (11.3)

4 (9.8)

7 (17.1)

4 (7.8)

 Vascular surgery

7 (5.3)

4 (9.8)

1 (2.4)

2 (3.9)

 Pediatric (across all specialties)

18 (13.5)

5 (12.2)

7 (17.1)

6 (11.8)

0.73

Title, n (%)

<0.001

 Professor

8 (6.3)

0 (0.0)

0 (0.0)

8 (16.3)

 Associate professor

33 (25.8)

2 (5.1)

13 (32.5)

18 (36.7)

 Assistant professor

87 (68.0)

37 (94.9)

27 (67.5)

23 (46.9)

 Admin position

53 (39.8)

3 (7.3)

22 (53.7)

28 (54.9)

<0.001

Volume, median (IQR)

 Appointments per day

18.6 (13.2–26.5)

14.7 (9.4–25.0)

19.7 (15.1–24.7)

19.3 (15.0–30.5)

0.017

 Percentage of days with appointments

27.0 (18.2–35.9)

24.1 (17.9–36.9)

27.0 (19.1–34.9)

27.7 (15.9–35.9)

0.96

 Scheduled hours per day

5.7 (3.7–7.7)

4.4 (3.0–6.4)

6.0 (4.3–7.7)

5.9 (4.2–8.4)

0.041

 Aggregate messages per day

11.5 (7.9–19.9)

8.9 (5.6–16.6)

14.5 (9.6–21.1)

11.3 (8.7–19.4)

0.015

Time per day, median (IQR)

 Time in system (min)

57.5 (27.2–96.1)

54.3 (22.8–97.2)

58.3 (35.8–100.5)

61.6 (29.2–93.0)

0.73

 Time in notes (min)

18.1 (7.6–37.0)

15.7 (5.0–38.3)

18.0 (7.8–39.3)

22.4 (10.2–35.8)

0.57

 Time in clinical review (min)

9.7 (5.5–14.7)

9.2 (5.3–15.5)

11.6 (6.2–15.8)

9.1 (5.4–12.5)

0.36

 Time in schedule (min)

7.9 (3.8–12.6)

10.1 (5.1–14.3)

7.8 (3.6–13.0)

5.4 (2.9–10.9)

0.076

 Time in orders (min)

6.9 (2.5–13.4)

3.4 (0.9–10.5)

7.6 (3.7–13.6)

8.9 (3.4–15.0)

0.034

 Time in visit navigator (min)

4.1 (2.1–7.3)

2.8 (1.3–5.9)

4.5 (2.4–7.3)

4.3 (2.7–8.0)

0.023

 Time in in-basket (min)

3.5 (2.0–5.7)

3.5 (2.2–5.6)

4.0 (2.5–7.9)

3.4 (1.3–4.7)

0.14

 Percentage of time in system: ambulatory

57.3 (41.2–66.6)

53.1 (25.6–58.9)

62.7 (50.4–67.4)

63.1 (46.7–70.2)

<0.001

 Percentage of time in system: ED

0.2 (0.0–1.0)

0.6 (0.1–1.7)

0.1 (0.0–0.5)

0.1 (0.0–0.8)

0.001

 Percentage of time in system: inpatient

11.9 (5.9–21.8)

14.5 (10.3–28.3)

8.3 (5.5–17.3)

9.3 (4.7–18.9)

0.008

Time per appointment, median (IQR)

 Time in notes (min)

2.4 (1.6–4.1)

2.9 (1.7–4.9)

2.0 (1.4–4.0)

2.3 (1.7–3.2)

0.23

 Time in clinical review (min)

1.4 (0.7–2.3)

1.9 (1.1–3.0)

1.4 (0.9–2.1)

1.1 (0.6–1.8)

0.005

 Time in in-basket (min)

0.5 (0.2–1.0)

0.7 (0.4–1.5)

0.6 (0.3–1.1)

0.4 (0.1–0.7)

0.008

 Time in orders (min)

0.8 (0.4–1.4)

0.8 (0.3–1.2)

1.0 (0.6–1.4)

0.7 (0.5–1.5)

0.48

Efficiency, median (IQR)

 Percentage of appointments closed same day

81.5 (49.7–94.8)

86.9 (47.4–97.0)

77.5 (47.0–94.0)

80.5 (52.8–91.2)

0.62

 Time in notes per note (min)

1.8 (1.2–3.1)

2.4 (1.5–4.4)

1.4 (1.1–2.7)

1.8 (1.2–2.9)

0.016

 Time per completed message (min)

0.4 (0.2–0.6)

0.6 (0.3–0.8)

0.5 (0.2–0.6)

0.3 (0.2–0.5)

0.002

 Documentation length per note (characters)

2,278 (1,605–4,113)

2,195 (1,194–4,049)

2,323 (1,681–3,541)

2,679 (1,714–4,232)

0.52

 Progress note length (characters)

4,495 (3,250–5,780)

4,400 (1,993–5,761)

4,315 (3,449–5,981)

4,586 (3,431–5,698)

0.67

 Orders with team contributions (%)

7.3 (0.9–51.8)

5.3 (0.5–82.5)

8.6 (2.7–30.1)

6.0 (0.6–66.0)

0.93

Proficiency, median (IQR)

 Proficiency score

3.4 (2.1–6.0)

2.9 (1.6–4.5)

3.3 (2.2–4.5)

5.2 (2.6–6.6)

0.035

Documentation burden, median (IQR)

 Pajama time (min)

10.4 (4.5–24.5)

12.9 (4.9–31.8)

7.9 (4.9–17.8)

12.3 (2.9–24.6)

0.35

 Time on unscheduled days (min)

19.4 (11.6–33.6)

20.9 (11.0–41.0)

21.0 (14.7–36.2)

17.2 (10.3–33.4)

0.48

 Time outside of 7 a.m. to 7 p.m. (min)

6.3 (2.2–15.8)

7.1 (2.7–17.6)

6.1 (2.2–14.2)

6.3 (2.2–16.1)

0.75

 Time outside the scheduled hours (min)

19.1 (8.4–28.8)

21.6 (7.4–33.7)

17.9 (8.1–23.8)

17.4 (10.4–32.4)

0.5

Abbreviation: IQR, interquartile range.



Multivariate Analysis

On multivariate analysis, >10 years of experience was an independent predictor of more appointments per day (odds ratio [OR] 7.96, 95% confidence interval [CI] 2.30, 13.62) and scheduled hours per day (OR 1.74, 95% CI 0.38, 3.10), greater proficiency (OR 1.53, 95% CI 0.43, 2.63), and spending less time per completed message (OR −15.26, 95% CI −25.49, −5.04). Pediatric specialty was an independent predictor of fewer scheduled hours per day (OR −1.69, 95% CI −3.12, −0.26) and spending more time per completed message (OR 11.52, 95% CI 0.75, 22.29). Furthermore, 6 to 10 years of experience was an independent predictor of receiving more messages per day (OR 4.50, 95% CI 0.51, 8.49). Finally, female gender was an independent predictor of spending more time in notes per appointment (OR 1.07, 95% CI 0.18, 1.95) and time outside of 7 a.m. to 7 p.m. (OR 4.75, 95% CI 0.47, 9.04; [Table 4]).

Table 4

Multivariate analyses of provider characteristics on select outcomes' metrics

Univariate

Multivariate

Appointments per day

Coeff (95% CI)

p-Value

Coeff (95% CI)

p-Value

Female

−3.54 (−7.92, 0.83)

0.11

−3.01 (−7.54, 1.52)

0.19

6 to 10 years as attending

4.46 (−0.55, 9.48)

0.080

4.69 (−0.93, 10.30)

0.10

>10 years as attending

6.18 (1.42, 10.94)

0.011

7.96 (2.30, 13.62)

0.006

Associate professor

2.74 (−2.03, 7.50)

0.26

−0.24 (−5.47, 4.99)

0.93

Admin position

2.36 (−1.73, 6.44)

0.26

0.74 (−4.16, 5.63)

0.77

Pediatric specialty

−3.18 (−9.03, 2.68)

0.29

−1.84 (−7.80, 4.12)

0.54

Scheduled hours per day

Coeff (95% CI)

p -Value

Coeff (95% CI)

p -Value

Female

−0.64 (−1.73, 0.44)

0.24

−0.42 (−1.51, 0.67)

0.45

6 to 10 years as attending

1.19 (−0.05, 2.43)

0.060

1.21 (−0.14, 2.56)

0.078

>10 years as attending

1.38 (0.20, 2.56)

0.022

1.74 (0.38, 3.10)

0.013

Associate professor

0.91 (−0.25, 2.07)

0.12

0.36 (−0.90, 1.62)

0.57

Admin position

0.48 (−0.53, 1.49)

0.35

0.11 (−1.06, 1.29)

0.85

Pediatric specialty

−1.89 (−3.31, −0.48)

0.009

−1.69 (−3.12, −0.26)

0.021

Messages per day

Coeff (95% CI)

p -Value

Coeff (95% CI)

p -Value

Female

1.11 (−2.02, 4.25)

0.48

1.65 (−1.56, 4.87)

0.31

6 to 10 years as attending

4.67 (1.10, 8.23)

0.011

4.50 (0.51, 8.49)

0.027

>10 years as attending

2.62 (−0.77, 6.01)

0.13

3.13 (−0.88, 7.15)

0.13

Associate professor

2.59 (−0.77, 5.95)

0.13

1.58 (−2.13, 5.30)

0.40

Admin position

1.56 (−1.35, 4.47)

0.29

0.25 (−3.22, 3.73)

0.89

Pediatric specialty

−3.44 (−7.58, 0.70)

0.10

−4.16 (−8.39, 0.08)

0.054

Time in system

Coeff (95% CI)

P-value

Coeff (95% CI)

P-value

Female

14.70 (−0.95, 30.35)

0.065

15.49 (−1.15, 31.14)

0.068

6 to 10 years as attending

8.07 (−10.33, 26.47)

0.39

10.67 (−9.97, 31.31)

0.31

>10 years as attending

6.34 (−11.13, 23.82)

0.47

12.92 (−7.88, 33.72)

0.22

Associate professor

−0.24 (−17.33, 16.86)

0.98

−2.81 (−22.02, 16.40)

0.77

Admin position

−2.48 (−17.22, 12.26)

0.74

−3.40 (−21.38, 14.59)

0.71

Pediatric specialty

6.70 (−14.37, 27.78)

0.53

4.18 (−17.72, 26.09)

0.71

Time in notes per appointment

Coeff (95% CI)

p -Value

Coeff (95% CI)

p -Value

Female

1.16 (0.31, 2.01)

0.008

1.07 (0.18, 1.95)

0.018

6 to 10 years as attending

−1.07 (−2.07, −0.07)

0.036

−0.75 (−1.86, 0.35)

0.18

>10 years as attending

−1.03 (−1.97, −0.09)

0.032

−0.65 (−1.75, 0.45)

0.24

Associate professor

−1.06 (−2.00, −0.13)

0.026

−0.61 (−1.63, 0.41)

0.24

Admin position

−0.88 (−1.68, −0.09)

0.030

−0.46 (−1.41, 0.50)

0.35

Pediatric specialty

0.96 (−0.19, 2.11)

0.10

0.77 (−0.39, 1.93)

0.19

Time per completed message

Coeff (95% CI)

p -Value

Coeff (95% CI)

p -Value

Female

3.61 (−4.78, 11.99)

0.40

1.62 (−6.56, 9.80)

0.70

6 to 10 years as attending

−7.90 (−17.25, 1.46)

0.097

−9.88 (−20.02, 0.27)

0.056

>10 years as attending

−15.69 (−24.57, −6.81)

<0.001

−15.26 (−25.49, −5.04)

0.004

Associate professor

2.00 (−10.81, 6.82)

0.65

4.14 (−5.31, 13.58)

0.97

Admin position

−8.16 (−15.84, −0.47)

0.038

−3.95 (−12.79, 4.89)

0.38

Pediatric specialty

11.43 (0.43, 22.44)

0.042

11.52 (0.75, 22.29)

0.036

Proficiency score

Coeff (95% CI)

p -Value

Coeff (95% CI)

p -Value

Female

−0.56 (−1.42, 0.31)

0.21

−0.61 (−1.49, 0.27)

0.17

6 to 10 years as attending

0.38 (−0.60, 1.37)

0.45

0.32 (−0.77, 1.41)

0.56

>10 years as attending

1.27 (0.34, 2.21)

0.008

1.53 (0.43, 2.63)

0.007

Associate professor

0.08 (−0.85, 1.01)

0.87

−0.54 (−1.55, 0.48)

0.30

Admin position

0.45 (−0.36, 1.26)

0.27

0.16 (−0.79, 1.12)

0.73

Pediatric specialty

0.62 (−0.53, 1.78)

0.29

0.89 (−0.27, 2.05)

0.13

Time on unscheduled days

Coeff (95% CI)

p -Value

Coeff (95% CI)

p -Value

Female

6.13 (0.04, 12.21)

0.048

5.58 (−0.91, 12.06)

0.091

6 to 10 years as attending

−1.39 (−8.56, 5.79)

0.70

0.60 (−7.53, 8.72)

0.89

>10 years as attending

−4.24 (−11.02, 2.53)

0.22

−0.48 (−8.58, 7.62)

0.91

Associate professor

−2.45 (−9.09, 4.20)

0.47

−1.73 (−9.20, 5.75)

0.65

Admin position

−3.06 (−8.78, 2.67)

0.29

−1.41 (−8.44, 5.62)

0.69

Pediatric specialty

4.74 (−3.43, 12.91)

0.25

3.96 (−4.56, 12.48)

0.36

Time outside of 7 a.m. to 7 p.m.

Coeff (95% CI)

p -Value

Coeff (95% CI)

p -Value

Female

4.05 (−0.43, 8.52)

0.076

4.75 (0.47, 9.04)

0.030

6 to 10 years as attending

−2.79 (−8.05, 2.47)

0.30

0.32 (−4.96, 5.61)

0.90

>10 years as attending

−0.52 (−5.48, 4.45)

0.84

2.50 (−2.83, 7.83)

0.36

Associate professor

−5.40 (−9.78, −1.02)

0.016

−5.32 (−10.21, −0.42)

0.034

Admin position

−3.61 (−7.76, 0.53)

0.087

−1.31 (−5.90, 3.27)

0.57

Pediatric specialty

−0.79 (−6.76, 5.18)

0.79

−0.64 (−6.23, 4.95)

0.82

Abbreviation: CI, confidence interval.




Discussion

The current study is the largest to analyze EHR use within general surgery and surgical subspecialties adjusted by gender, years of experience, and tenure. By using quantitative metrics representative for volume, efficiency, proficiency, and burden, we presented a tangible method to describe surgeons' experience with the EHR. Overall, surgeons spent 57.5 minutes per day logged into the EHR, 19.1 minutes per day in the EHR outside the scheduled hours, and 19.4 minutes per day in the EHR outside the scheduled days. After adjusting for surgeon gender, years of experience, tenure, and pediatric specialties, we found significant associations between female gender and time spent in notes per appointment, along with time spent outside the work hours. Additionally, having over 10 years of experience was significantly associated with higher metrics for volume, efficiency, and proficiency.

We found female surgeons spent just over 1 minute longer writing notes per appointment and additionally spent more time outside work hours despite having a similar patient volume as their male surgeon counterparts. Given that documentation burden is a contributor to burnout, burnout in our study may be more prevalent among female surgeons and is consistent with the numerous studies that have documented higher rates of burnout in female surgeons at the workplace.[20] [21] [22] [23] [24] [25] [26] Burnout in female surgeons is likely multifactorial. One study found that burnout among female surgeons may be related to frustrations with gender bias encountered in the workplace regarding being seen as incompetent by colleagues.[21] Another study found that female surgical residents reported more frequently feeling under strain, burned out from work, unhappy/depressed, less confident, and thought of themselves as worthless as they navigate residency. The study suggested that female surgical residents may be experiencing these more negative outcomes during residency due to lack of like-gendered leadership and mentorship.[22] Furthermore, another study observed that burnout among female general surgeons was associated with decreased professional fulfillment and lower sense of control over schedule.[23] Our current study adds to the body of the gender-specific surgeon burnout literature by suggesting that female surgeon burnout may also be attributed to spending more time in the EHR. This is an important area for further research, and future studies should focus on understanding the underlying causes to guide targeted interventions aimed at reducing this gender imbalance.

As surgeons move onto practicing as independent attendings, often in health care systems with different EHR, they must balance establishing a patient base and managing their care with learning how to operate efficiently and effectively in this new role. With the growing emphasis and subsequent time spent on documentation, the learning curve is only becoming steeper for new attending physicians. In our cohort, we observed significant differences in surgeon EHR metrics among those with more years of experience since completing training, even after controlling for gender, tenure, administrative duties, and specialty. Those with more than 5 years of experience saw a greater workload in the form of patient volume, scheduled hours per day, and aggregate messages received per day, with the number of messages declining after 10 years. With more experience, surgeons spent more of their day in the ambulatory setting and placing orders in the visit navigator, although they became quicker overall on a per-appointment basis. Surgeons also had significantly higher efficiency and proficiency metrics after 10 years of experience. Although not significant, this may be reflected in the overall decrease in burden metrics which is strongest at 10 years. These findings indicate that while the overall workload may increase, physicians are learning to become even more efficient to maintain a balanced lifestyle. We were unable to control for presence of physician extenders who may be helping with documentation and easing the burden for more senior surgeons.

Limitations of our study include the duration of data collection for the study. With only 5 months of data, our study may not fully capture the overall experience that surgeons actually have with the EHR. There are also limitations regarding the metrics that we have used to represent volume, efficiency, proficiency, and burden. Appointments per day did not consider whether a physician had a full or half day at the clinic. Because scheduled time was determined by Epic Signal, we could not stratify our analysis based on scheduled time for clinic versus scheduled time for operating room or administrative tasks. Time per day spent in the EHR may not be representative of actual time because Epic Signal incorporates a 5-second time-out rule where the clock stops measuring if no cursor activity is detected after 5 seconds. Caution should be used when considering our metrics for efficiency and proficiency, as Epic Signal definitions for “Proficiency Score” has not been extensively used in other studies. Moreover, interpreting and validating proficiency scores generated by vendors can be challenging. Without universally accepted methodology for measuring proficiency, Epic's algorithm may not factor in various other time-saving methods implemented by physicians. The current state of research does not provide clear guidance on the practicality of using proficiency scores. Additionally, we used time spent working outside of normal working hours as a proxy for burden, but there are many other contributors to burden, such as lack of autonomy, lack of staff, and personal characteristics. The gold standard for burnout is the quantitative burnout survey, which we did not include in our study. Additionally, we did not have any other EHR usage metrics in our system other than Signal to compare and validate our findings.

In summary, our study has important implications for using EHR-generated reports to quantify EHR use by general surgery and subspecialty surgical attendings as impacted by individual characteristics. By classifying proficiency and efficiency and defining the amount of time that surgeons spent on the EHR during and after workhours, we hope to raise awareness of the burden placed by the EHR and highlight certain groups of surgeons who may experience a disproportionate amount of documentation burden. Globally, health systems face challenges in improving productivity while reducing surgeon burnout. Our data demonstrate that EHR-provided data can be used to assess volume, productivity, and surrogate markers of burnout with the goal of improving both. These data can then provide the evidence for funding and implementation of programs and interventions to help decrease the electronic documentation load. Further studies are warranted to further validate this method to identify areas of interest and improvement.


Conclusion

Surgeons spend a considerable amount of time using the EHR. Studying the data collected through EHRs can be used to understand how its use is linked to burnout and job satisfaction, and to develop programs that can improve efficiency and reduce the workload associated with documentation. It is particularly important to investigate the experiences of surgeons who may be less proficient, efficient, and experience more documentation burden, as this can help to identify any obstacles that may be hindering their efficient use of the EHR.


Clinical Relevance Statement

The findings of this research add to the growing body of evidence that EHR-generated reports can serve as indicators of EHR workload that are influenced by both external factors and specific traits of physicians. By identifying the elements that affect surgeon engagement and usage, health care organizations can effectively track the effects of organizational changes and improve productivity while reducing surgeon fatigue. Additional research is needed to explore the relationship between these metrics and how to effectively utilize them.


Multiple Choice Questions

  1. Which of the following has been found in the literature to be correlated with increased physician burnout?

    • a) Increased levels of autonomy

    • b) Improved support and funding in the work environment

    • c) Male physicians

    • d) More time spent outside work hours on documentation

    Correct answer: The correct answer is option (d). Studies have found that more time spent outside work hours on documentation, lack of autonomy, and reduced support and funding are correlated with increased reported levels of physician burnout. There are also several studies that report that female physicians have increased rates of burnout.

  2. Which of the following surgeon characteristics was associated with significantly more time spent in the electronic health record outside of 7 a.m. to 7 p.m. on multivariate analysis?

    • a) Having greater than 10 years of experience

    • b) Being an associate professor

    • c) Being a female

    • d) Being from a pediatric specialty

    Correct answer: The correct answer is option (c). Results in our multivariate analysis demonstrated that female gender was an independent predictor of spending more time in notes per appointment and time outside of 7 a.m. to 7 p.m. in the EHR.



Conflict of Interest

None declared.

Acknowledgments

We would like to thank Dr. Ferdinand J. Chan for helping with acquisition of data.

Protection of Human and Animal Subjects

This study was performed in compliance with the World Medical Association Declaration of Helsinki on Ethical Principles for Medical Research Involving Human Subjects and was reviewed by the Albert Einstein College of Medicine Institutional Review Board.


All subjects were de-identified prior to conducting this study.


Authors' Contributions

All authors made substantial contributions to conception and design, acquisition of data and/or analysis/interpretation of data, and drafting and critical revision of the article for important intellectual content. All listed authors approved the version to be published.


* These authors contributed equally to this work.



Address for correspondence

Kevin Tang, BS
Albert Einstein College of Medicine
Bronx, NY, 10461
United States   

Publikationsverlauf

Eingereicht: 07. August 2023

Angenommen: 17. Oktober 2023

Accepted Manuscript online:
18. Oktober 2023

Artikel online veröffentlicht:
10. Januar 2024

© 2024. Thieme. All rights reserved.

Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany