CC BY-NC-ND 4.0 · Appl Clin Inform 2022; 13(04): 774-777
DOI: 10.1055/a-1892-1437
Invited Editorial

Measuring and Maximizing Undivided Attention in the Context of Electronic Health Records

You Chen
1   Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States
,
Julia Adler-Milstein
2   Department of Medicine, University of California, San Francisco, San Francisco, California, United States
,
Christine A. Sinsky
3   American Medical Association, Chicago, Illinois, United States
› Author Affiliations
Funding This research was supported, in part, by the National Library of Medicine of the National Institutes of Health, U.S. Department of Health and Human Services under Award Number R01LM012854.
 

Undivided attention is a clinician's superpower.[1] Often called deep work,[2] being in the flow, or being in the zone—when health professionals are able to perform their responsibilities with full focus and presence,[3] the care itself is safer and the care process is more satisfying to patients and clinicians alike.[4] The opposite of this state is split attention, moments when clinicians lose focus and, as a result, risk missing important incoming data—whether a cue from the patient's body language or tone of voice,[5] a relevant element of the past medical history, or an abnormal test result.

The design of the clinical environment can support or undermine clinicians' ability to provide undivided attention. It is readily apparent when, for example, the environment impedes a physician's ability to listen intently to his/her patient's symptoms, context, and concerns or a pharmacist's ability to perform medication reconciliation without interruption. Yet we currently have no standard metrics for this important state of work. Without such measures, there is no basis to assess current levels of undivided attention or the impact of efforts to increase undivided attention with associated benefits in terms of safety, patient and clinician experience, and other important outcomes.

This commentary identifies two key interactions where undivided attention is both critical and rare—the clinician–patient interaction and the clinician–electronic health record (EHR) interaction. We then propose proxy metrics of undivided attention during these interactions—ATTNPT and ATTNEHR ([Table 1]). These metrics, derived from the EHR, can be used for both operational improvements and research, by characterizing the current clinical environment, determining the association between undivided attention and other outcomes, and optimizing the care environment.

Table 1

Metrics for undivided attention to patient ATTNPT and undivided attention to individual EHR tasks ATTNEHR

ATTNPT = Clinician undivided attention to patient during visits/scheduled hours

PSH = Patient scheduled hours (from clarity)

EHRPSH = Total EHR hours from log-in to log-out during those same PSH (from UAL)*

Example: A clinician with 4 hours of patient scheduled time with 1 hour of EHR time during those 4 hours would have ATTNPT = (4–1)/4 = 0.75 = 75%.

*UAL data determines EHR time as “inactive” if there is no mouse or keyboard movement for 5 seconds.

ATTNEHR = Clinician undivided attention to individual EHR tasks, i.e., entering orders, viewing archived patient data, or ordering diagnostic tests.

EHRTASK = EHR hours on tasks (from UAL*)

EHRAB = EHR hours on attentional blinks, including pop-up alerts, electronic inbox messages, mandatory dialog box, or navigation from screen to screen during those same EHRTASK (from UAL + )

Example: A clinician with 4 hours of EHR time on tasks and half hour with attentional blinks would have ATTNEHR = (4–0.5)/4 = 0.875 = 87.5%.

*UAL determines tasks. A task represents a group of individual user actions performed within a certain time frame to accomplish some given clinical function using the EHR. Based on UAL, it is measured as an ordered list of user actions that occur sequentially until two actions are spaced in time by more than a certain cutoff. EHR hours on a task are calculated as the sum of its constitutive action durations.

+ UAL contains information of alerts, inbox messages, dialog box, narrator, navigator, and tabs of the encounter, note, order, and result, which can be leveraged to determine attentional blinks. EHR hours on attention blinks are calculated as the sum of durations of actions enabling attentional blinks to occur.

Cognitive Overload—a Situation where Undivided Attention is Impeded

Current clinical environments feature two core types of conceptual units during which attention is often broken with frequent multitasking, task switching, and interruptions: the clinician–patient interaction (direct patient contact) and the clinician–EHR interaction (EHR tasks). Breaks in attention within each of these two units increase clinicians' cognitive workload, which in turn contributes to burnout.[6] [7] [8] [9] [10] [11] [12] The two interactions impede each other, with EHR tasks and direct patient contact typically overlapping.

With each diversion of our attention from one focus to another, there is an attentional blink, a drop in the data we can take in, that lasts approximately 90 seconds.[4] Misdiagnosis, medication errors, and inappropriate treatment are more likely to occur when the physician or care team member is unable to devote undivided attention to the patient, on the one hand, and, separately, to EHR tasks, on the other.


#

Undivided Attention for Clinician–Patient Interactions

The natural flow of the diagnostic, therapeutic, and relationship-building conversation between a clinician and a patient can be disrupted by EHR tasks such as signing in, completing required documentation templates, and responding to alerts. For instance, when a clinician attempts to simultaneously listen to a patient and review information in the EHR, cognitive workload is increased, hazards are introduced, and the opportunity for deep work is compromised. In 2012, Benda et al found that the introduction of EHRs into the emergency room led to increased task switching and attention shifts within the patient–physician interaction.[13] Westbrook et al demonstrated that interruptions and multitasking were associated with significantly higher rates of prescribing errors among emergency physicians.[14] Recently, Schneider et al collected observations of emergency department (ED) physicians and nurses in Germany and the United States. They found the average interruption rate per hour was 10.16 and 12.04 in U.S. and German EDs, respectively.[15]

Undivided attention during clinician–patient interactions can be improved by providing dedicated time for EHR tasks separate from the patient interaction or by implementing advanced models of teamwork where upskilled team members perform many of the EHR–tasks, such as order entry and visit note documentation, in real time while the clinician provides undivided attention to the patient.[16]


#

Undivided Attention for Clinician–Electronic Health Record Interactions

A clinician completing a specific EHR task can likewise be interrupted by other EHR actions such as a pop-up alert, an electronic inbox message, or a mandatory dialog box. A study conducted in acute, intensive, and emergency room settings showed clinicians on average exhibited 1.4 ± 0.6 switches per minute in their EHR workflow.[17] Split attention, as occurs when a clinician must navigate between multiple screens within the EHR, picking up bits of data to store in their short-term memory and then knit them together into a coherent narrative, also contributes to cognitive load.

Cognitive load can be mitigated by improving EHR usability so that, for example, the test results one needs to review to safely choose a new antihypertensive medication are presented on the same screen as the medication order choices. Other approaches that decrease the cognitive load include creating clear, concise displays of all of the patient's information relevant to a particular condition,[18] reducing the number of alerts and decreasing the clutter from low value information.


#

Electronic Health Record Audit Log Data

EHR audit log data have emerged as a powerful tool to understand and improve the clinical care environment.[19] [20] [21] [22] [23] [24] Audit log data make human–EHR interactions explicit, and thus, unobtrusively provide quantifiable tracking of workflows. In a 2020 manuscript, researchers proposed seven core EHR-use metrics,[19] including total EHR time, work outside of work, and time on visit note documentation among others that served to promote EHR design improvements to facilitate the efficiency of EHR use. A growing body of literature uses these and other metrics,[20] [22] [25] [26] [27] [28] [29] [30] [31] [32] thereby demonstrating the feasibility of their implementation and how their use can help inform understanding of efficient practices and improve future EHR design. The 2020 study also proposed a measure of undivided attention in the clinician–patient interaction, specified as the proportion of a clinic session that the physician spent not engaged with the EHR.[19] This represents the outer envelope of time available for undivided attention. Here, we add operational detail by identifying the specifications for this measure within one of the major EHR vendors, Epic.

Granular EHR actions, such as those documented in user action logs (UAL) and clinician efficiency profile (CEP) data, contain information on EHR tasks such as in-basket, orders, notes, and clinical review, as well as interruptions such as pop-up alerts, electronic inbox messages or mandatory dialog boxes. Switches in clinicians' attention as they move rapidly between logging into the EHR, working in the inbox, switching to laboratory review, switching again to medication list and then to problem list, order entry, etc., can also be captured with UAL or CEP.[17] [33] In a 2021 study, UAL was leveraged to identify EHR tasks and their complexity profiles.[34] Therefore, UAL and/or CEP provide an excellent opportunity to develop metrics measuring undivided attention in EHR tasks during the clinician–EHR interaction.

[Table 1] shows our proposed practical metrics: ATTNPT to measure undivided attention given to patients and ATTNEHR to measure undivided attention during EHR tasks. Although the two metrics are proxies and do not measure the absolute amount of undivided attention, they provide a directional signal and can be used for pre- and postcomparisons for operational interventions intended to improve the amount of undivided attention given to patients and EHR tasks and for comparisons across specialties and settings.


#

Utility of ATTNPT and ATTNEHR

Measures of undivided attention created from EHR audit log data can inform a variety of quality improvement activities. For example, approaches to mitigate clinician burnout or improve patient satisfaction could be targeted to redesign the components of the encounter or workflows of EHR tasks where attention is most often interrupted. Measures of undivided attention could also be examined in the context of patient safety, advancing our understanding of contributors to errors.

The interpretation of the metrics should be conducted in the context of specific care settings. For instance, in EDs, workflow interruptions, disruptions, as well as alerts raised by EHRs, often support the timeliness and efficiency of ED operations. Switching attention to emerging problems or acute care needs is an inherent demand in acute care; however, it may break ED physician or nurse's attention and lead to a decreased value of ATTNPT and ATTNEHR. In this situation, the interpretation of the metrics needs to establish user actions that represent interruptions and acknowledge that some interruptions, such as an alert regarding a rapidly destabilizing patient in the ED, can advance patient care. These will be critical to frame the interpretation of the measures such that large reductions may not necessarily be considered beneficial.

Multitasking is also prevalent and may be a necessity or even beneficial in certain settings. However, there are also potential hazards for patients and it is draining for clinicians. Thus, a measure that allows assessment of whether or not this is occurring is still useful in the scenarios when there is a goal to reduce multitasking. More broadly, it is important to recognize that our commentary aims to propose metrics that could provide a directional (NOT exact) measure of undivided attention in clinician–patient and clinician–EHR interactions across various settings in an automated way, which relies on EHR audit logs. The metrics will need to be fine-tuned for specific settings and interpreted with relevant caveats in mind. Nonetheless, there is important value in a measure as a starting point—to be used in the context of efforts to reduce interruptions and to prompt ongoing measure improvement.


#

Limitations with ATTNPT and ATTNEHR

EHR log data have advantages in measuring interruptions related to EHR system utilizations; however, they carry challenges in measuring undivided attention. There are various other types of interruptions that can break clinicians' attention in the direct patient care but are not captured by the log data. Those interruptions include but are not limited to verbal interruptions such as another physician updates patient handoff information, a medication request by a nurse, an environment alarm, a pager resuscitation team notification, a knock on the door, a lost document, a technology failure, etc. ATTNPT would not count workflow interruptions beyond EHRs. For instance, workflow interruptions by interprofessional communication have been identified as one of the most prevalent stressors in ED work but would not be captured by ATTNPT. ED is a complex, uncertain, high-paced work environment requiring high coordination demands to meet emergent needs and uphold patient flow. Therefore, ED physicians and nurses allocate a large amount of working time to intradepartmental communication with other ED professionals in direct patient care.[15] Although ATTNPT is restricted to interruptions raised by EHR use (EHRPSH in [Table 1]), it suggests that the metrics can still provide directional information for pre- and postcomparisons.

ATTNEHR requires defining the full spectrum of EHR tasks, measuring task durations, and establishing which user actions represent interruptions or switches between screens. Although UAL along with informatics approaches provide a potential way to identify EHR tasks, interruptions, and screen switches, and measure their durations, fine granular UAL and advanced approaches are still required to develop more precise metrics to quantify undivided attention in the clinician–EHR interactions.


#

Conclusion

Defining and then measuring undivided attention in clinician–patient interactions and clinician–EHR tasks offer a new strategy to support achieving the quadruple aim of better health, better care, lower costs, with improved clinician well-being.[16] Doing so could help clinical and administrative leaders reengineer workflows, optimize team composition, and improve task delegation to maximize the amount of undivided attention that patients receive from their physicians and care teams. Measuring undivided attention is a real problem, and applying our proposed metrics in practice would face many challenges. A pilot study, including with survey-based feedback to test the metrics in a specific setting and identify the difficulties and problems, would be very helpful. In addition, the commentary would provide support for an interdisciplinary study, drawing in those from social sciences who focus on ethnography or observations and interviews with those focused on medicine and quantitative studies to capture how divided attention impacts care and the experiences of the clinician and patient.


#
#

Conflict of Interest

C.A.S. is employed by the American Medical Association. The opinions expressed in this article are those of the author(s) and should not be interpreted as American Medical Association policy.

Protection of Human and Animal Subjects

Not applicable.

  • References

  • 1 Kissler MJ, Kissler K, Burden M. Toward a medical “ecology of attention”. N Engl J Med 2021; 384 (04) 299-301
  • 2 Newport C. Deep Work: Rules for Focused Success in a Distracted World. New York: Grand Central Publishing; 2016
  • 3 Zulman DM, Haverfield MC, Shaw JG. et al. Practices to foster physician presence and connection with patients in the clinical encounter. JAMA 2020; 323 (01) 70-81
  • 4 Harry EPR, Kneeland P, Huang G, Stein J, Sweller J. Cognitive load and its implications for health care. NEJM Catal 2018;4(2)
  • 5 Sinsky CA. If not for the pause. SGIM Forum 2013; 36 (05) 10-16
  • 6 Harry E, Sinsky C, Dyrbye LN. et al. Physician task load and the risk of burnout among US physicians in a national survey. Jt Comm J Qual Patient Saf 2021; 47 (02) 76-85
  • 7 Gregory ME, Russo E, Singh H. Electronic health record alert-related workload as a predictor of burnout in primary care providers. Appl Clin Inform 2017; 8 (03) 686-697
  • 8 Moy AJ, Aaron L, Cato KD. et al. Characterizing multitasking and workflow fragmentation in electronic health records among emergency department clinicians: using time-motion data to understand documentation burden. Appl Clin Inform 2021; 12 (05) 1002-1013
  • 9 Barth A, Schneider D. Manipulating the focus of attention in working memory: evidence for a protection of multiple items against perceptual interference. Psychophysiology 2018; 55 (07) e13062
  • 10 Tajirian T, Stergiopoulos V, Strudwick G. et al. The influence of electronic health record use on physician burnout: cross-sectional survey. J Med Internet Res 2020; 22 (07) e19274
  • 11 Pfoh ER, Hong S, Baranek L. et al. Reduced cognitive burden and increased focus: a mixed-methods study exploring how implementing scribes impacted physicians. Med Care 2022; 60 (04) 316-320
  • 12 Ratanawongsa N, Matta GY, Bohsali FB, Chisolm MS. Reducing misses and near misses related to multitasking on the electronic health record: observational study and qualitative analysis. JMIR Human Factors 2018; 5 (01) e4
  • 13 Benda NC, Meadors ML, Hettinger AZ, Ratwani RM. Emergency physician task switching increases with the introduction of a commercial electronic health record. Ann Emerg Med 2016; 67 (06) 741-746
  • 14 Westbrook JI, Raban MZ, Walter SR, Douglas H. Task errors by emergency physicians are associated with interruptions, multitasking, fatigue and working memory capacity: a prospective, direct observation study. BMJ Qual Saf 2018; 27 (08) 655-663
  • 15 Schneider A, Williams DJ, Kalynych C, Wehler M, Weigl M. Physicians' and nurses' work time allocation and workflow interruptions in emergency departments: a comparative time-motion study across two countries. Emerg Med J 2021; 38 (04) 263-268
  • 16 Bodenheimer T, Sinsky C. From triple to quadruple aim: care of the patient requires care of the provider. Ann Fam Med 2014; 12 (06) 573-576
  • 17 Moy AJ, Schwartz JM, Elias J. et al. Time-motion examination of electronic health record utilization and clinician workflows indicate frequent task switching and documentation burden. AMIA Annu Symp Proc 2021; 2020: 886-895
  • 18 Semanik MG, Kleinschmidt PC, Wright A. et al. Impact of a problem-oriented view on clinical data retrieval. J Am Med Inform Assoc 2021; 28 (05) 899-906
  • 19 Sinsky CA, Rule A, Cohen G. et al. Metrics for assessing physician activity using electronic health record log data. J Am Med Inform Assoc 2020; 27 (04) 639-643
  • 20 Rule A, Chiang MF, Hribar MR. Using electronic health record audit logs to study clinical activity: a systematic review of aims, measures, and methods. J Am Med Inform Assoc 2020; 27 (03) 480-490
  • 21 Hilliard RW, Haskell J, Gardner RL. Are specific elements of electronic health record use associated with clinician burnout more than others?. J Am Med Inform Assoc 2020; 27 (09) 1401-1410
  • 22 Holmgren AJ, Downing NL, Bates DW. et al. Assessment of electronic health record use between US and non-US health systems. JAMA Intern Med 2021; 181 (02) 251-259
  • 23 Moore C, Valenti A, Robinson E, Perkins R. Using log data to measure provider EHR activity at a cancer center during rapid telemedicine deployment. Appl Clin Inform 2021; 12 (03) 629-636
  • 24 Chen Y, Patel MB, McNaughton CD, Malin BA. Interaction patterns of trauma providers are associated with length of stay. J Am Med Inform Assoc 2018; 25 (07) 790-799
  • 25 Adler-Milstein J, Adelman JS, Tai-Seale M, Patel VL, Dymek C. EHR audit logs: a new goldmine for health services research?. J Biomed Inform 2020; 101: 103343
  • 26 Adler-Milstein J, Zhao W, Willard-Grace R, Knox M, Grumbach K. Electronic health records and burnout: time spent on the electronic health record after hours and message volume associated with exhaustion but not with cynicism among primary care clinicians. J Am Med Inform Assoc 2020; 27 (04) 531-538
  • 27 Hripcsak G, Vawdrey DK, Fred MR, Bostwick SB. Use of electronic clinical documentation: time spent and team interactions. J Am Med Inform Assoc 2011; 18 (02) 112-117
  • 28 Melnick ER, Ong SY, Fong A. et al. Characterizing physician EHR use with vendor derived data: a feasibility study and cross-sectional analysis. J Am Med Inform Assoc 2021; 28 (07) 1383-1392
  • 29 Rotenstein LS, Holmgren AJ, Downing NL, Bates DW. Differences in total and after-hours electronic health record time across ambulatory specialties. JAMA Intern Med 2021; 181 (06) 863-865
  • 30 Tai-Seale M, Dillon EC, Yang Y. et al. Physicians' well-being linked to in-basket messages generated by algorithms in electronic health records. Health Aff (Millwood) 2019; 38 (07) 1073-1078
  • 31 Tai-Seale M, Olson CW, Li J. et al. Electronic health record logs indicate that physicians split time evenly between seeing patients and desktop medicine. Health Aff (Millwood) 2017; 36 (04) 655-662
  • 32 Rotenstein LS, Fong AS, Jeffery MM. et al. Gender differences in time spent on documentation and the electronic health record in a large ambulatory network. JAMA Netw Open 2022; 5 (03) e223935-e223935
  • 33 Lieu TA, Warton EM, East JA. et al. Evaluation of attention switching and duration of electronic inbox work among primary care physicians. JAMA Netw Open 2021; 4 (01) e2031856-e2031856
  • 34 Chen B, Alrifai W, Gao C. et al. Mining tasks and task characteristics from electronic health record audit logs with unsupervised machine learning. J Am Med Inform Assoc 2021; 28 (06) 1168-1177

Address for correspondence

You Chen, PhD
Department of Biomedical Informatics, Vanderbilt University Medical Center
Nashville, TN 37232
United States   

Publication History

Received: 18 April 2022

Accepted: 30 June 2022

Accepted Manuscript online:
05 July 2022

Article published online:
11 August 2022

© 2022. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/)

Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany

  • References

  • 1 Kissler MJ, Kissler K, Burden M. Toward a medical “ecology of attention”. N Engl J Med 2021; 384 (04) 299-301
  • 2 Newport C. Deep Work: Rules for Focused Success in a Distracted World. New York: Grand Central Publishing; 2016
  • 3 Zulman DM, Haverfield MC, Shaw JG. et al. Practices to foster physician presence and connection with patients in the clinical encounter. JAMA 2020; 323 (01) 70-81
  • 4 Harry EPR, Kneeland P, Huang G, Stein J, Sweller J. Cognitive load and its implications for health care. NEJM Catal 2018;4(2)
  • 5 Sinsky CA. If not for the pause. SGIM Forum 2013; 36 (05) 10-16
  • 6 Harry E, Sinsky C, Dyrbye LN. et al. Physician task load and the risk of burnout among US physicians in a national survey. Jt Comm J Qual Patient Saf 2021; 47 (02) 76-85
  • 7 Gregory ME, Russo E, Singh H. Electronic health record alert-related workload as a predictor of burnout in primary care providers. Appl Clin Inform 2017; 8 (03) 686-697
  • 8 Moy AJ, Aaron L, Cato KD. et al. Characterizing multitasking and workflow fragmentation in electronic health records among emergency department clinicians: using time-motion data to understand documentation burden. Appl Clin Inform 2021; 12 (05) 1002-1013
  • 9 Barth A, Schneider D. Manipulating the focus of attention in working memory: evidence for a protection of multiple items against perceptual interference. Psychophysiology 2018; 55 (07) e13062
  • 10 Tajirian T, Stergiopoulos V, Strudwick G. et al. The influence of electronic health record use on physician burnout: cross-sectional survey. J Med Internet Res 2020; 22 (07) e19274
  • 11 Pfoh ER, Hong S, Baranek L. et al. Reduced cognitive burden and increased focus: a mixed-methods study exploring how implementing scribes impacted physicians. Med Care 2022; 60 (04) 316-320
  • 12 Ratanawongsa N, Matta GY, Bohsali FB, Chisolm MS. Reducing misses and near misses related to multitasking on the electronic health record: observational study and qualitative analysis. JMIR Human Factors 2018; 5 (01) e4
  • 13 Benda NC, Meadors ML, Hettinger AZ, Ratwani RM. Emergency physician task switching increases with the introduction of a commercial electronic health record. Ann Emerg Med 2016; 67 (06) 741-746
  • 14 Westbrook JI, Raban MZ, Walter SR, Douglas H. Task errors by emergency physicians are associated with interruptions, multitasking, fatigue and working memory capacity: a prospective, direct observation study. BMJ Qual Saf 2018; 27 (08) 655-663
  • 15 Schneider A, Williams DJ, Kalynych C, Wehler M, Weigl M. Physicians' and nurses' work time allocation and workflow interruptions in emergency departments: a comparative time-motion study across two countries. Emerg Med J 2021; 38 (04) 263-268
  • 16 Bodenheimer T, Sinsky C. From triple to quadruple aim: care of the patient requires care of the provider. Ann Fam Med 2014; 12 (06) 573-576
  • 17 Moy AJ, Schwartz JM, Elias J. et al. Time-motion examination of electronic health record utilization and clinician workflows indicate frequent task switching and documentation burden. AMIA Annu Symp Proc 2021; 2020: 886-895
  • 18 Semanik MG, Kleinschmidt PC, Wright A. et al. Impact of a problem-oriented view on clinical data retrieval. J Am Med Inform Assoc 2021; 28 (05) 899-906
  • 19 Sinsky CA, Rule A, Cohen G. et al. Metrics for assessing physician activity using electronic health record log data. J Am Med Inform Assoc 2020; 27 (04) 639-643
  • 20 Rule A, Chiang MF, Hribar MR. Using electronic health record audit logs to study clinical activity: a systematic review of aims, measures, and methods. J Am Med Inform Assoc 2020; 27 (03) 480-490
  • 21 Hilliard RW, Haskell J, Gardner RL. Are specific elements of electronic health record use associated with clinician burnout more than others?. J Am Med Inform Assoc 2020; 27 (09) 1401-1410
  • 22 Holmgren AJ, Downing NL, Bates DW. et al. Assessment of electronic health record use between US and non-US health systems. JAMA Intern Med 2021; 181 (02) 251-259
  • 23 Moore C, Valenti A, Robinson E, Perkins R. Using log data to measure provider EHR activity at a cancer center during rapid telemedicine deployment. Appl Clin Inform 2021; 12 (03) 629-636
  • 24 Chen Y, Patel MB, McNaughton CD, Malin BA. Interaction patterns of trauma providers are associated with length of stay. J Am Med Inform Assoc 2018; 25 (07) 790-799
  • 25 Adler-Milstein J, Adelman JS, Tai-Seale M, Patel VL, Dymek C. EHR audit logs: a new goldmine for health services research?. J Biomed Inform 2020; 101: 103343
  • 26 Adler-Milstein J, Zhao W, Willard-Grace R, Knox M, Grumbach K. Electronic health records and burnout: time spent on the electronic health record after hours and message volume associated with exhaustion but not with cynicism among primary care clinicians. J Am Med Inform Assoc 2020; 27 (04) 531-538
  • 27 Hripcsak G, Vawdrey DK, Fred MR, Bostwick SB. Use of electronic clinical documentation: time spent and team interactions. J Am Med Inform Assoc 2011; 18 (02) 112-117
  • 28 Melnick ER, Ong SY, Fong A. et al. Characterizing physician EHR use with vendor derived data: a feasibility study and cross-sectional analysis. J Am Med Inform Assoc 2021; 28 (07) 1383-1392
  • 29 Rotenstein LS, Holmgren AJ, Downing NL, Bates DW. Differences in total and after-hours electronic health record time across ambulatory specialties. JAMA Intern Med 2021; 181 (06) 863-865
  • 30 Tai-Seale M, Dillon EC, Yang Y. et al. Physicians' well-being linked to in-basket messages generated by algorithms in electronic health records. Health Aff (Millwood) 2019; 38 (07) 1073-1078
  • 31 Tai-Seale M, Olson CW, Li J. et al. Electronic health record logs indicate that physicians split time evenly between seeing patients and desktop medicine. Health Aff (Millwood) 2017; 36 (04) 655-662
  • 32 Rotenstein LS, Fong AS, Jeffery MM. et al. Gender differences in time spent on documentation and the electronic health record in a large ambulatory network. JAMA Netw Open 2022; 5 (03) e223935-e223935
  • 33 Lieu TA, Warton EM, East JA. et al. Evaluation of attention switching and duration of electronic inbox work among primary care physicians. JAMA Netw Open 2021; 4 (01) e2031856-e2031856
  • 34 Chen B, Alrifai W, Gao C. et al. Mining tasks and task characteristics from electronic health record audit logs with unsupervised machine learning. J Am Med Inform Assoc 2021; 28 (06) 1168-1177