An Observation Tool for Studying Patient-oriented Workflow in Hospital Emergency Departments^[*]

Summary

Background: Studying workflow is a critical step in designing, implementing and evalu -ating informatics interventions in complex sociotechnical settings, such as hospital emergency departments (EDs). Known approaches to studying workflow in clinical settings attend to the activities of individual clinicians, thus being inadequate to characterize patient care as a cooperative work.

Objectives: The purpose of this paper is twofold. First, we introduce a novel, theory-driven patient-oriented workflow method -ology, which better addresses the complex, multiple-provider nature of patient care.

Second, we report the development of an observational tool and protocol for use in studies of this type, and the results of an evaluation study.

Methods: We created a tablet computer implementation of an instrument to efficiently capture patient-oriented workflow, and evaluated it through a field study in three EDs. We focused on activities occurring over time during a single patient care episode as well as the roles of the ED staff members who conducted the activities.

Results: The evidence generated supports the validity, viability, and reliability of the tool. The coverage of the tool in terms of ac -tivities and roles was satisfactory. The tool was able to capture the sequence of activity-role pairs for 108 patient care episodes. The inter-rater reliability assessment yielded a high kappa value (0.79).

Discussion: The patient-oriented workflow methodology has the potential to facilitate modeling patient care in EDs by character -izing both roles and activities in sequence. The methodology also provides researchers and practitioners a more realistic and comprehensive workflow perspective that can inform the design, implementation and evaluation of health information technology interventions.

Keywords

Emergency departments - workflow - observation tool - cooperative work

^* Supplementary material published on our web-site www.methods-online.com

• References

• 1 van der Aalst W, van Hee K. Workflow Management Models, Methods, and Systems. Cambridge, MA: MIT Press; 2002.
• 2 Bowers J, Button G, Sharrock W. Workflow from within and without: Technology and cooperative work on the print industry shopfloor. ECSCW’95: Proceedings of the Fourth Conference on European Conference on Computer-Supported Cooperative Work. Norwell, MA, USA: Kluwer Academic Publishers; 1995.
• 3 International Organization for Standardization. Graphic technology: Database architecture model and control parameter coding for process control and workflow (Database AMPAC) = Technologie graphique : codage du modèle d’architecture de base de données et des paramètres de commande pour le contrôle du procédé et le déroulement des opérations (Database AMPAC). 1st ed Geneva: ISO; 2004.
• 4 Brixey JJ, Robinson DJ, Tang Z, Johnson TR, Zhang J, Turley JP. Interruptions in workflow for RNs in a level one trauma center. AMIA Annu Symp Proc 2005: 86-90.
• 5 Wolf LD, Potter P, Sledge JA, Boxerman SB, Grayson D, Evanoff B. Describing nurses’ work: Combining quantitative and qualitative analysis. Human Factors 2006; 48 (01) 5-14.
• 6 Tang Z, Weavind L, Mazabob J, Thomas EJ, Chu-Weininger MY, Johnson TR. Workflow in intensive care unit remote monitoring: A time-and-motion study. Crit Care Med 2007; 35 (09) 2057-2063.
• 7 Schmidt K. Analysis of Cooperative Work - A Conceptual Framework. Risø National Laboratory, DK-4000 Roskilde, Denmark, 1990. [Risø-M-2890]
• 8 Laxmisan A, Hakimzada F, Sayan OR, Green RA, Zhang J, Patel VL. The multitasking clinician: Decision-making and cognitive demand during and after team handoffs in emergency care. Int J Med Inform 2007; 76 (11-12) 801-811.
• 9 Puentes J, Roux M, Montagner J, Lecornu L. Development framework for a patient-centered record. Comput Methods Programs Biomed 2012; 108 (03) 1036-1051.
• 10 Ash JS, Sittig DF, Poon EG, Guappone K, Campbell E, Dykstra RH. The extent and importance of unintended consequences related to computerized provider order entry. J Am Med Inform Assoc 2007; 14 (04) 415-423.
• 11 Ash JS, Berg M, Coiera E. Some unintended consequences of information technology in health care: the nature of patient care information system-related errors. J Am Med Inform Assoc 2004; 11 (02) 104-112.
• 12 Campbell EM, Sittig DF, Ash JS, Guappone KP, Dykstra RH. Types of unintended consequences related to computerized provider order entry. J Am Med Inform Assoc 2006; 13 (05) 547-556.
• 13 Pratt W, Reddy MC, McDonald DW, Tarczy-Hornoch P, Gennari JH. Incorporating ideas from computer-supported cooperative work. J Biomed Inform 2004; 37 (02) 128-137.
• 14 Horsky J, Kaufman DR, Oppenheim MI, Patel VL. A framework for analyzing the cognitive complexity of computer-assisted clinical ordering. J Biomed Inform 2003; 36 (1-2) 4-22.
• 15 Hutchins E. Cognition in the Wild. Cambridge, MA: MIT Press; 1995.
• 16 Suchman LA. Plans and Situated Actions. New York: Cambridge University Press; 1987.
• 17 Horsky J, Gutnik L, Patel VL. Technology for emergency care: cognitive and workflow considerations. AMIA Annu Symp Proc 2006: 344-348.
• 18 Risser DT, Rice MM, Salisbury ML, Simon R, Jay GD, Berns SD. The potential for improved teamwork to reduce medical errors in the emergency department. The MedTeams Research Consortium. Ann Emerg Med 1999; 34 (03) 373-383.
• 19 Committee on the Future of Emergency Care in the United States Health System and Board on Health Care Services and Institute of Medicine Hospital-Based Emergency Care: At The Breaking Point. Washington, DC: National Academies Press; 2006.
• 20 Morey JC, Simon R, Jay GD, Wears RL, Salisbury M, Dukes KA. et al. Error reduction and performance improvement in the emergency department through formal teamwork training: Evaluation results of the MedTeams project. Health Serv Res 2002; 37 (06) 1553-1581.
• 21 Chisholm CD, Dornfeld AM, Nelson DR, Cordell WH. Work interrupted: A comparison of workplace interruptions in emergency departments and primary care offices. Ann Emerg Med 2001; 38 (02) 146-151.
• 22 France DJ, Levin S, Hemphill R, Chen K, Rickard D, Makowski R. et al. Emergency physicians’ behaviors and workload in the presence of an electronic whiteboard. Int J Med Inform 2005; 74 (10) 827-837.
• 23 Xiao Y, Kiesler S, Mackenzie C, Kobayashi M, Plasters C, Seagull F. et al. Negotiation and conflict in large scale collaboration: a preliminary field study. Cognition, Technology & Work 2007; 9 (03) 171-176.
• 24 Xiao Y, Schenkel S, Faraj S, Mackenzie CF, Moss J. What whiteboards in a trauma center operating suite can teach us about emergency department communication. Ann Emerg Med 2007; 50 (04) 387-395.
• 25 Horsky J, McColgan K, Pang JE, Melnikas AJ, Linder JA, Schnipper JL. et al. Complementary methods of system usability evaluation: surveys and observations during software design and development cycles. J Biomed Inform 2010; 43 (05) 782-790.
• 26 Ammenwerth E, Spotl HP. The time needed for clinical documentation versus direct patient care. A work-sampling analysis of physicians’ activities. Methods Inf Med 2009; 48 (01) 84-91.
• 27 Zhang Y, Monsen KA, Adam TJ, Pieczkiewicz DS, Daman M, Melton GB. Systematic refinement of a health information technology time and motion workflow instrument for inpatient nursing care using a standardized interface terminology. AMIA Annu Symp Proc 2011: 1621-1629.
• 28 Ozkaynak M, Brennan PF, Hanauer DA, Johnson S, Aarts J, Zheng K. et al. Patient-centered care requires a patient-oriented workflow model. J Am Med Inform Assoc 2013; 20 (01) e14-6.
• 29 Ozkaynak M, Brennan PF. A concept analysis of phenomenon workflow. AMIA Annu Symp Proc 2008: 1078
• 30 Leont’ev A. The problem of activity in psychology. Soviet Psychology 1974; 13 (02) 4-33.
• 31 Biddle BJ, Thomas EJ. editors. Role Theory: Concepts and Research. New York: John Wiley; 1966.
• 32 Abbott A. Sequence analysis: New methods for old ideas. Annu Rev Sociol 1995; 21 (01) 93-113.
• 33 Cohen MD, Burkhart R, Dosi G, Egidi M, Marengo L, Warglien M. et al. Routines and other recurring action patterns of organizations: Contemporary research issues. Ind Corp Change 1996; 5 (03) 653-698.
• 34 Feldman MS, Pentland BT. Reconceptualizing organizational routines as a source of flexibility and change. Adm Sci Q 2003; 48 (01) 94-118.
• 35 Lazaric N. The role of routines, rules and habits in collective learning: Some epistemological and ontological considerations. EJESS 2000; 14 (02) 157-171.
• 36 Pentland BT, Rueter HH. Organizational routines as grammars of action. Adm Sci Q 1994; 39 (03) 484-510.
• 37 Unertl KM, Novak LL, Johnson KB, Lorenzi NM. Traversing the many paths of workflow research: Developing a conceptual framework of workflow terminology through a systematic literature review. J Am Med Inform Assoc 2010; 17 (03) 265-273.
• 38 Schmidt K, Simone C. Coordination mechanisms: Towards a conceptual foundation of CSCW systems design. Comput Supp Coop W J 1996; 5 (02) 155-200.
• 39 Schmidt K, Simone C. Mind the gap! Towards a unified view of CSCW. In: The Fourth International Conference on the Design of Cooperative Systems COOP: IOS Press; 2000.
• 40 Carayon P, Wetterneck TB, Hundt AS, Ozkaynak M, DeSilvey J, Ludwig B. et al. Evaluation of nurse interaction with bar code medication administration technology in the work environment. J Patient Saf 2007; 3 (01) 34-42.
• 41 Friedman DM, Sokal SM, Chang Y, Berger DL. Increasing operating room efficiency through parallel processing. Ann Surg 2006; 243 (01) 10-14.
• 42 Grumbach K, Bodenheimer T. Can health care teams improve primary care practice?. JAMA 2004; 291 (10) 1246-1251.
• 43 Ozkaynak M, Brennan PF. Characterizing patient care in hospital emergency departments. Health Systems 2012; 1 (02) 104-117.
• 44 Reddy MC, Dourish P, Pratt W. Coordinating Heterogeneous Work: Information and Representation in Medical Care. In: Prinz et al. Kluwer Academic Publishers 2001.
• 45 Strauss AL, Fagerhaugh S, Suczek B, Wiener C. Social Organization of Medical Work. Chicago: The University of Chicago; 1985.
• 46 Gooch P, Roudsari A. Computerization of workflows, guidelines, and care pathways: A review of implementation challenges for process-oriented health information systems. J Am Med Inform Assoc 2011; 18 (06) 738-748.
• 47 Sridhar S, Brennan PF, Wright SJ, Robinson SM. Optimizing financial effects of HIE: A multi-party linear programming approach. J Am Med Inform Assoc 2012; 19 (06) 1082-1088.
• 48 Ozkaynak M, Brennan PF. Revisiting sociotechnical systems in a case of unreported use of health information exchange system in three hospital emergency departments. J Eval Clin Pract 2012; 19 (02) 370-373.
• 49 Abell P. The Syntax of Social Life: The Theory and Method of Comparative Narratives. New York: Clarendon Press; 1987.
• 50 Malone TW, Crowston K, Lee J. et al. Tools for inventing organizations: Toward a handbook of organizational processes. Management Science; 1999; 45 (03) 425-443.
• 51 Bakeman R, Gottman JM. Observing Interaction: An Introduction To Sequential Analysis. Cambridge, UK: Cambridge University Press; 1997.
• 52 Gorelick MH, Yen K, Yun HJ. The effect of in-room registration on emergency department length of stay. Ann Emerg Med 2005; 45 (02) 128-133.
• 53 Whyte L, Youhill G. The nursing process in the care of the mentally ill. Nurs Times 1984; 80 (05) 49-51.
• 54 Cameron KA, Engel KG, McCarthy DM, Buckley BA, Mercer Kollar LM, Donlan SM. et al. Examining emergency department communication through a staff-based participatory research method: Identifying barriers and solutions to meaningful change. Ann Emerg Med 2010; 56 (06) 614-622.
• 55 Woloshynowych M, Davis R, Brown R, Vincent C. Communication patterns in a UK emergency department. Ann Emerg Med 2007; 50 (04) 407-413.
• 56 Spencer R, Coiera E, Logan P. Variation in communication loads on clinical staff in the emergency department. Ann Emerg Med 2004; 44 (03) 268-273.
• 57 Segen J. Concise Dictionary of Modern Medicine. Park Ridge, NJ: McGraw-Hill; 2005.
• 58 MedlinePlus. Available at: http://www.nlm.nih.gov/medlineplus/mplusdictionary.html. Accessed 08/01 2013
• 59 Kalton G. Introduction to Survey Sampling. Newbury Park, California: Sage Publications; 1983.
• 60 Guo S, Hussey DL. Nonprobability sampling in social work research: Dilemmas, consequences, and strategies. J Soc Serv Res 2004; 30 (03) 1-18.
• 61 Unertl KM, Weinger MB, Johnson KB, Lorenzi NM. Describing and modeling workflow and information flow in chronic disease care. J Am Med Inform Assoc 2009; 16 (06) 826-836.
• 62 Carmines EG, Zeller RA. Reliability and Validity Assessment. Beverly Hills, California: Sage Publications; 1990.
• 63 Hollingsworth JC, Chisholm CD, Giles BK, Cordell WH, Nelson DR. How do physicians and nurses spend their time in the emergency department?. Ann Emerg Med 1998; 31 (01) 87-91.
• 64 Fairbanks RJ, Bisantz AM, Sunm M. Emergency department communication links and patterns. Ann Emerg Med 2007; 50 (04) 396-406.
• 65 Robson C. Real World Research. 2nd ed. Malden, MA: Blackwell; 2002.
• 66 Quera V, Bakeman R, Gnisci A. Observer agreement for event sequences: methods and software for sequence alignment and reliability estimates. Behav Res Methods 2007; 39 (01) 39-49.
• 67 Viera AJ, Garrett JM. Understanding interobserver agreement: The kappa statistic. Fam Med 2005; 37 (05) 360-363.
• 68 Behara R, Wears RL, Perry SJ, Eisenberg E, Murphy L, Vanderhoef M. et al. A Conceptual Framework for Studying the Safety of Transitions in Emergency Care. Advances in Patient Safety: From Research to Implementation Rockville, MD: Agency for Healthcare Research and Quality 2005.
• 69 Patterson ES, Cook RI, Render ML. Improving patient safety by identifying side effects from introducing bar coding in medication administration. J Am Med Inform Assoc 2002; 9 (05) 540-553.
• 70 Kaplan B. Addressing Organizational Issues into the Evaluation of Medical Systems. J Am Med Inform Assoc 1997; 4 (02) 94-101.
• 71 Zheng K, Haftel HM, Hirschl RB, O’Reilly M, Hanauer DA. Quantifying the impact of health IT implementations on clinical workflow: A new methodological perspective. J Am Med Inform Assoc 2010; 17 (04) 454-461.
• 72 Karsh BT, Alper SJ. Work system analysis: The key to understanding health care systems. In: Henriksen K, Battles JB, Marks ES, Lewin DI. editors. Advances in Patient Safety: From Research to Implementation. Rockville, MD: Agency for Healthcare Research and Quality; 2005.