Subscribe to RSS
![](/products/assets/desktop/img/oa-logo.png)
DOI: 10.1055/s-0041-1726510
The Use and Promise of Conversational Agents in Digital Health
![](https://www.thieme-connect.de/media/10.1055-s-00034612/202101/lookinside/thumbnails/10-1055-s-0041-1726510_dingler-1.jpg)
Summary
Objectives: To describe the use and promise of conversational agents in digital health—including health promotion andprevention—and how they can be combined with other new technologies to provide healthcare at home.
Method: A narrative review of recent advances in technologies underpinning conversational agents and their use and potential for healthcare and improving health outcomes.
Results: By responding to written and spoken language, conversational agents present a versatile, natural user interface and have the potential to make their services and applications more widely accessible. Historically, conversational interfaces for health applications have focused mainly on mental health, but with an increase in affordable devices and the modernization of health services, conversational agents are becoming more widely deployed across the health system. We present our work on context-aware voice assistants capable of proactively engaging users and delivering health information and services. The proactive voice agents we deploy, allow us to conduct experience sampling in people's homes and to collect information about the contexts in which users are interacting with them.
Conclusion: In this article, we describe the state-of-the-art of these and other enabling technologies for speech and conversation and discuss ongoing research efforts to develop conversational agents that “live” with patients and customize their service offerings around their needs. These agents can function as ‘digital companions’ who will send reminders about medications and appointments, proactively check in to gather self-assessments, and follow up with patients on their treatment plans. Together with an unobtrusive and continuous collection of other health data, conversational agents can provide novel and deeply personalized access to digital health care, and they will continue to become an increasingly important part of the ecosystem for future healthcare delivery.
Publication History
Article published online:
03 September 2021
© 2021. IMIA and Thieme. This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/)
Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany
-
References
- 1 Wosik J, Fudim M, Cameron B, Gellad ZF, Cho A, Phinney D. et al. Telehealth Transformation: COVID-19 and the rise of Virtual Care. J Am Med Inform Assoc 2020; 27 (06) 957-62
- 2 Monaghesh E, Hajizadeh A. The role of telehealth during COVID-19 outbreak: a systematic review based on current evidence. BMC Public Health 2020; 20 (01) 1-9
- 3 Rush KL, Hatt L, Janke R, Burton L, Ferrier M, Tetrault M. The efficacy of telehealth delivered educational approaches for patients with chronic diseases: A systematic review. Patient Educ Couns 2018; 101 (08) 1310-21
- 4 Jin K, Khonsari S, Gallagher R, Gallagher P, Clark AM, Freedman B. et al. Telehealth interventions for the secondary prevention of coronary heart disease: a systematic review and meta-analysis. Eur J Cardiovasc Nurs 2019; 18 (04) 260-71
- 5 Orlando JF, Beard M, Kumar S. Systematic review of patient and caregivers’ satisfaction with telehealth videoconferencing as a mode of service delivery in managing patients’ health. PloS One 2019; 14 (08) e0221848
- 6 Chudasama YV, Gillies CL, Zaccardi F, Coles B, Davies MJ, Seidu S. et al. Impact of COVID-19 on routine care for chronic diseases: a global survey of views from healthcare professionals. Diabetes Metab Syndr Clin Res Rev 2020; 14 (05) 965-7
- 7 Wright A, Salazar A, Mirica M, Volk LA, Schiff GD. The invisible epidemic: neglected chronic disease management during COVID-19. J Gen Intern Med 2020; 35 (09) 2816-7
- 8 Druss BG. Addressing the COVID-19 pandemic in populations with serious mental illness. JAMA Psychiatry 2020; 77 (09) 891-2
- 9 Sezgin E, Huang Y, Ramtekkar U, Lin S. Readiness for voice assistants to support healthcare delivery during a health crisis and pandemic. Npj Digit Med 2020; 3 (01) 1-4
- 10 Braun M, Mainz A, Chadowitz R, Pfleging B, Alt F. At Your Service: Designing Voice Assistant Personalities to Improve Automotive User Interfaces. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems [Internet] Glasgow Scotland Uk: ACM 2019 [cited 2021 Feb 2]. p. 1-11. Available from: https://dl.acm.org/doi/10.1145/3290605.3300270
- 11 Laranjo L, Dunn AG, Tong HL, Kocaballi AB, Chen J, Bashir R. et al. Conversational agents in healthcare: a systematic review. J Am Med Inform Assoc 2018; 25 (09) 1248-58
- 12 Singh RP, Javaid M, Haleem A, Suman R. Internet of things (IoT) applications to fight against COVID-19 pandemic. Diabetes Metab Syndr Clin Res Rev 2020; 14 (04) 521-4
- 13 Machinery C. Computing machinery and intelligence-AM Turing. Mind 1950; 59 (236) 433
- 14 Reeves B, Nass C. The media equation: How people treat computers, television, and new media like real people. Cambridge university press Cambridge; UK: 1996
- 15 Mairesse F, Walker MA. Towards personality-based user adaptation: psychologically informed stylistic language generation. User Model User-Adapt Interact 2010; 20 (03) 227-78
- 16 Wallace RS. The anatomy of ALICE. In: Parsing the Turing Test. Springer; 2009; 181-210
- 17 Dialogflow Google Cloud [Internet]. [cited 2021 Feb 2]. Available from: https://cloud.google.com/dialogflow/
- 18 Gong E, Baptista S, Russell A, Scuffham P, Riddell M, Speight J. et al. My Diabetes Coach, a Mobile App-Based Interactive Conversational Agent to Support Type 2 Diabetes Self-Management: Randomized Effectiveness-Implementation Trial. J Med Internet Res 2020 Nov 5; 22 (11) e20322
- 19 Kepuska V, Bohouta G. Next-generation of virtual personal assistants (microsoft cortana, apple siri, amazon alexa and google home). In IEEE; 2018. 99-103
- 20 Park C, Lim J, Kim J, Lee S-J, Lee D. Don't Bother Me. I'm Socializing! A Breakpoint-Based Smartphone Notification System. In: CSCW 2017. Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing; 2017; 541-54
- 21 Sacks H, Schegloff EA, Jefferson G. A simplest systematics for the organization of turn taking for conversation. In: Studies in the organization of conversational interaction; Elsevier: 1978: 7-55
- 22 Liao QV, Davis M, Geyer W, Muller M, Shami NS. What can you do? Studying social-agent orientation and agent proactive interactions with an agent for employees. In: DIS ‘16. Proceedings of the 2016 ACM Conference on Designing Interactive Systems; 2016; 264-75
- 23 Wei J., Dingler T., Kostakos V.. Developing the Proactive Speaker Prototype Based on Google Home. In: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems; 2021; 1-6
- 24 Consolvo S, Walker M. Using the experience sampling method to evaluate ubicomp applications. IEEE Pervasive Comput 2003; 2 (02) 24-31
- 25 Nahum-Shani I, Hekler EB, Spruijt-Metz D. Building health behavior models to guide the development of just-in-time adaptive interventions: A pragmatic framework. Health Psychol 2015; 34 (S) 1209
- 26 Google Duplex: A.I. Assistant Calls Local Businesses To Make Appointments - YouTube [Internet]. [cited 2021 Feb 2]. Available from: https://www.youtube.com/atch?v=D5VN56jQMWM&t=3s&ab_channel=JeffreyGrubb
- 27 Hancock JT, Naaman M, Levy K. AI-mediated communication: definition, research agenda, and ethical considerations. J Comput-Mediat Commun 2020; 25 (01) 89-100
- 28 Palanica A, Flaschner P, Thommandram A, Li M, Fossat Y. Physicians’ perceptions of chatbots in health care: Cross-sectional web-based survey. J Med Internet Res 2019; 21 (04) e12887
- 29 Househ M, Doha R. Perceptions and Opinions of Patients About Mental Health Chatbots: Scoping Review. J Med Internet Res 2021; 23 (01) e17828
- 30 Luxton DD. Ethical implications of conversational agents in global public health. Bull World Health Organ 2020; 98 (04) 285
- 31 Laranjo L, Dunn AG, Tong HL, Kocaballi AB, Chen J, Bashir R. et al. Conversational agents in healthcare: a systematic review. J Am Med Inform Assoc 2018; 25 (09) 1248-58
- 32 Car LT, Dhinagaran DA, Kyaw BM, Kowatsch T, Rayhan JS, Theng YL. et al. Conversational agents in health care: Scoping review and conceptual analysis. J Med Internet Res 2020; 22 (08) e17158
- 33 Kocaballi AB, Berkovsky S, Quiroz JC, Laranjo L, Tong HL, Rezazadegan D. et al. The personalization of conversational agents in health care: systematic review. J Med Internet Res 2019; 21 (11) e15360
- 34 Montenegro JLZ, da Costa CA, da Rosa Righi R. Survey of conversational agents in health. Expert Syst Appl 2019; 129: 56-67
- 35 Chang P, Sheng Y-H, Sang Y-Y, Wang D-W. Developing a wireless speech-and touch-based intelligent comprehensive triage support system. CIN Comput Inform Nurs 2008; 26 (01) 31-8
- 36 Xu R, Mei G, Zhang G, Gao P, Judkins T, Cannizzaro M. et al. A voice-based automated system for PTSD screening and monitoring. Stud Health Technol Inform 2012; 173: 552-8
- 37 Spänig S, Emberger-Klein A, Sowa J-P, Canbay A, Menrad K, Heider D. The virtual doctor: An interactive clinical-decision-support system based on deep learning for non-invasive prediction of diabetes. Artif Intell Med 2019; 100: 101706
- 38 Ghosh S, Bhatia S, Bhatia A. Quro: facilitating user symptom check using a personalised chatbot-oriented dialogue system. Stud Health Technol Inf 2018; 252: 51-6
- 39 Almalki M, Azeez F. Health Chatbots for Fighting COVID-19: a Scoping Review. Acta Inform Medica 2020; 28 (04) 241
- 40 Middleton K, Butt M, Hammerla N, Hamblin S, Mehta K, Parsa A. Sorting out symptoms: design and evaluation of the’babylon check’automated triage system. ArXiv Prepr ArXiv160602041.. 2016
- 41 Razzaki S, Baker A, Perov Y, Middleton K, Baxter J, Mullarkey D. et al. A comparative study of artificial intelligence and human doctors for the purpose of triage and diagnosis. ArXiv Prepr ArXiv180610698.. 2018
- 42 Adams WG, Phillips BD, Bacic JD, Walsh KE, Shanahan CW, Paasche-Orlow MK. Automated conversation system before pediatric primary care visits: a randomized trial. Pediatrics 2014; 134 (03) e691-9
- 43 Provoost S, Lau HM, Ruwaard J, Riper H. Embodied conversational agents in clinical psychology: a scoping review. J Med Internet Res 2017; 19 (05) e151
- 44 Pereira J. Díaz Ó. Using health chatbots for behavior change: A mapping Study. J Med Syst 2019; 43 (05) 135
- 45 Williams ED, Bird D, Forbes AW, Russell A, Ash S, Friedman R. et al. Randomised controlled trial of an automated, interactive telephone intervention (TLC Diabetes) to improve type 2 diabetes management: baseline findings and six-month outcomes. BMC Public Health 2012; 12 (01) 1-11
- 46 Tropea P, Schlieter H, Sterpi I, Judica E, Gand K, Caprino M. et al. Rehabilitation, the great absentee of virtual coaching in medical care: scoping review. J Med Internet Res 2019; 21 (10) e12805
- 47 Milne-Ives M, de Cock C, Lim E, Shehadeh MH, de Pennington N, Mole G. et al. The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review. J Med Internet Res 2020; 22 (10) e20346
- 48 Gong E, Baptista S, Russell A, Scuffham P, Riddell M, Speight J. et al. My Diabetes Coach, a mobile application-based interactive conversational agent to support type 2 diabetes self-management: A randomized effectiveness-implementation trial. Forthcoming. 2021
- 49 Kramer LL, Ter Stal S, Mulder BC, de Vet E, van Velsen L. Developing Embodied Conversational Agents for Coaching People in a Healthy Lifestyle: Scoping Review. J Med Internet Res 2020; 22 (02) e14058
- 50 Baptista S, Wadley G, Bird D, Harris M, Riddell M, Russell A. et al. Acceptability of an embodied conversational agent for type 2 diabetes self-management education and support via a smartphone app: a mixed-methods study. Diabetes Technol Ther 2020; 22: A221-2
- 51 Gao L, Maddison R, Rawstorn J, Ball K, Oldenburg B, Chow C. et al. Protocol: Economic evaluation protocol for a multicentre randomised controlled trial to compare Smartphone Cardiac Rehabilitation, Assisted self-Management (SCRAM) versus usual care cardiac rehabilitation among people with coronary heart disease. BMJ Open 2020;10(8)
- 52 The Heart Foundation. Australian heart disease statistics [Internet]. The Heart Foundation. 2020 [cited 2020 Apr 22]. Available from: https://www.heartfoundation.org.au/about-us/what-we-do/heart-disease-in-australia/australian-heart-disease-statistics
- 53 Böhmer M, Hecht B, Schöning J, Krüger A, Bauer G. Falling asleep with angry birds, facebook and kindle: a large scale study on mobile application usage. In: Proceedings of the 13th Conference on Human-Computer Interaction with Mobile Devices and Services, Mobile HCI; 2011; 47-56
- 54 Meadows R, Hine C, Suddaby E. Conversational agents and the making of mental health recovery. Digit Health 2020; 6: 2055207620966170
- 55 Sebastian J, Richards D. Changing stigmatizing attitudes to mental health via education and contact with embodied conversational agents. Comput Hum Behav 2017; 73: 479-88
- 56 Open source conversational AI [Internet]. Rasa 2020 [cited 2021 Feb 2]. Available from: https://rasa.com/
- 57 Gong E, Baptista S, Russell A, Scuffham P, Riddell M, Speight J. et al. My Diabetes Coach, a Mobile App-Based Interactive Conversational Agent to Support Type 2 Diabetes Self-Management: Randomized Effectiveness-Implementation Trial. J Med Internet Res 2020 Nov 5; 22 (11) e20322
- 58 Mental Health Chatbot [Internet]. Woebot Health. [cited 2021 Feb 2]. Available from: https://woebothealth.com/
- 59 Liao K, Liu Q, Wei Z, Peng B, Chen Q, Sun W. et al. Task-oriented Dialogue System for Automatic Disease Diagnosis via Hierarchical Reinforcement Learning. ArXiv Prepr ArXiv200414254. 2020