Download PDF
CC BY-NC-ND 4.0 · Yearb Med Inform 2021; 30(01): 191-199
DOI: 10.1055/s-0041-1726510
Section 7: Consumer Health Informatics and Education
Survey

The Use and Promise of Conversational Agents in Digital Health

Tilman Dingler
1   NHMRC CRE in Digital Technology to Transform Chronic Disease Outcomes, School of Computing and Information Systems, University of Melbourne, Parkville, Australia
,
Dominika Kwasnicka
2   NHMRC CRE in Digital Technology to Transform Chronic Disease Outcomes, Melbourne School of Population and Global Health, University of Melbourne, Melbourne, Australia
,
Jing Wei
1   NHMRC CRE in Digital Technology to Transform Chronic Disease Outcomes, School of Computing and Information Systems, University of Melbourne, Parkville, Australia
,
Enying Gong
2   NHMRC CRE in Digital Technology to Transform Chronic Disease Outcomes, Melbourne School of Population and Global Health, University of Melbourne, Melbourne, Australia
,
Brian Oldenburg
2   NHMRC CRE in Digital Technology to Transform Chronic Disease Outcomes, Melbourne School of Population and Global Health, University of Melbourne, Melbourne, Australia
› Author Affiliations
› Further Information
   Permissions and Reprints

Summary

Objectives: To describe the use and promise of conversational agents in digital health—including health promotion andprevention—and how they can be combined with other new technologies to provide healthcare at home.

Method: A narrative review of recent advances in technologies underpinning conversational agents and their use and potential for healthcare and improving health outcomes.

Results: By responding to written and spoken language, conversational agents present a versatile, natural user interface and have the potential to make their services and applications more widely accessible. Historically, conversational interfaces for health applications have focused mainly on mental health, but with an increase in affordable devices and the modernization of health services, conversational agents are becoming more widely deployed across the health system. We present our work on context-aware voice assistants capable of proactively engaging users and delivering health information and services. The proactive voice agents we deploy, allow us to conduct experience sampling in people's homes and to collect information about the contexts in which users are interacting with them.

Conclusion: In this article, we describe the state-of-the-art of these and other enabling technologies for speech and conversation and discuss ongoing research efforts to develop conversational agents that “live” with patients and customize their service offerings around their needs. These agents can function as ‘digital companions’ who will send reminders about medications and appointments, proactively check in to gather self-assessments, and follow up with patients on their treatment plans. Together with an unobtrusive and continuous collection of other health data, conversational agents can provide novel and deeply personalized access to digital health care, and they will continue to become an increasingly important part of the ecosystem for future healthcare delivery.

Keywords

Conversational agents - digital healthcare - telehealth - healthcare ecosystem


Publication History

Article published online:
03 September 2021

© 2021. IMIA and Thieme. This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/)

Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany

 

  • References

  • 1 Wosik J, Fudim M, Cameron B, Gellad ZF, Cho A, Phinney D. et al. Telehealth Transformation: COVID-19 and the rise of Virtual Care. J Am Med Inform Assoc 2020; 27 (06) 957-62
    CrossrefPubMedGoogle Scholar
  • 2 Monaghesh E, Hajizadeh A. The role of telehealth during COVID-19 outbreak: a systematic review based on current evidence. BMC Public Health 2020; 20 (01) 1-9
    CrossrefPubMedGoogle Scholar
  • 3 Rush KL, Hatt L, Janke R, Burton L, Ferrier M, Tetrault M. The efficacy of telehealth delivered educational approaches for patients with chronic diseases: A systematic review. Patient Educ Couns 2018; 101 (08) 1310-21
    CrossrefPubMedGoogle Scholar
  • 4 Jin K, Khonsari S, Gallagher R, Gallagher P, Clark AM, Freedman B. et al. Telehealth interventions for the secondary prevention of coronary heart disease: a systematic review and meta-analysis. Eur J Cardiovasc Nurs 2019; 18 (04) 260-71
    CrossrefPubMedGoogle Scholar
  • 5 Orlando JF, Beard M, Kumar S. Systematic review of patient and caregivers’ satisfaction with telehealth videoconferencing as a mode of service delivery in managing patients’ health. PloS One 2019; 14 (08) e0221848
    CrossrefPubMedGoogle Scholar
  • 6 Chudasama YV, Gillies CL, Zaccardi F, Coles B, Davies MJ, Seidu S. et al. Impact of COVID-19 on routine care for chronic diseases: a global survey of views from healthcare professionals. Diabetes Metab Syndr Clin Res Rev 2020; 14 (05) 965-7
    CrossrefPubMedGoogle Scholar
  • 7 Wright A, Salazar A, Mirica M, Volk LA, Schiff GD. The invisible epidemic: neglected chronic disease management during COVID-19. J Gen Intern Med 2020; 35 (09) 2816-7
    CrossrefPubMedGoogle Scholar
  • 8 Druss BG. Addressing the COVID-19 pandemic in populations with serious mental illness. JAMA Psychiatry 2020; 77 (09) 891-2
    CrossrefPubMedGoogle Scholar
  • 9 Sezgin E, Huang Y, Ramtekkar U, Lin S. Readiness for voice assistants to support healthcare delivery during a health crisis and pandemic. Npj Digit Med 2020; 3 (01) 1-4
    CrossrefPubMedGoogle Scholar
  • 10 Braun M, Mainz A, Chadowitz R, Pfleging B, Alt F. At Your Service: Designing Voice Assistant Personalities to Improve Automotive User Interfaces. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems [Internet] Glasgow Scotland Uk: ACM 2019 [cited 2021 Feb 2]. p. 1-11. Available from: https://dl.acm.org/doi/10.1145/3290605.3300270
    PubMedGoogle Scholar
  • 11 Laranjo L, Dunn AG, Tong HL, Kocaballi AB, Chen J, Bashir R. et al. Conversational agents in healthcare: a systematic review. J Am Med Inform Assoc 2018; 25 (09) 1248-58
    CrossrefPubMedGoogle Scholar
  • 12 Singh RP, Javaid M, Haleem A, Suman R. Internet of things (IoT) applications to fight against COVID-19 pandemic. Diabetes Metab Syndr Clin Res Rev 2020; 14 (04) 521-4
    CrossrefPubMedGoogle Scholar
  • 13 Machinery C. Computing machinery and intelligence-AM Turing. Mind 1950; 59 (236) 433
    PubMedGoogle Scholar
  • 14 Reeves B, Nass C. The media equation: How people treat computers, television, and new media like real people. Cambridge university press Cambridge; UK: 1996
    Google Scholar
  • 15 Mairesse F, Walker MA. Towards personality-based user adaptation: psychologically informed stylistic language generation. User Model User-Adapt Interact 2010; 20 (03) 227-78
    CrossrefPubMedGoogle Scholar
  • 16 Wallace RS. The anatomy of ALICE. In: Parsing the Turing Test. Springer; 2009; 181-210
    PubMed
  • 17 Dialogflow Google Cloud [Internet]. [cited 2021 Feb 2]. Available from: https://cloud.google.com/dialogflow/
    PubMedGoogle Scholar
  • 18 Gong E, Baptista S, Russell A, Scuffham P, Riddell M, Speight J. et al. My Diabetes Coach, a Mobile App-Based Interactive Conversational Agent to Support Type 2 Diabetes Self-Management: Randomized Effectiveness-Implementation Trial. J Med Internet Res 2020 Nov 5; 22 (11) e20322
    PubMedGoogle Scholar
  • 19 Kepuska V, Bohouta G. Next-generation of virtual personal assistants (microsoft cortana, apple siri, amazon alexa and google home). In IEEE; 2018. 99-103
    PubMedGoogle Scholar
  • 20 Park C, Lim J, Kim J, Lee S-J, Lee D. Don't Bother Me. I'm Socializing! A Breakpoint-Based Smartphone Notification System. In: CSCW 2017. Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing; 2017; 541-54
    PubMedGoogle Scholar
  • 21 Sacks H, Schegloff EA, Jefferson G. A simplest systematics for the organization of turn taking for conversation. In: Studies in the organization of conversational interaction; Elsevier: 1978: 7-55
    Google Scholar
  • 22 Liao QV, Davis M, Geyer W, Muller M, Shami NS. What can you do? Studying social-agent orientation and agent proactive interactions with an agent for employees. In: DIS ‘16. Proceedings of the 2016 ACM Conference on Designing Interactive Systems; 2016; 264-75
    PubMedGoogle Scholar
  • 23 Wei J., Dingler T., Kostakos V.. Developing the Proactive Speaker Prototype Based on Google Home. In: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems; 2021; 1-6
    PubMedGoogle Scholar
  • 24 Consolvo S, Walker M. Using the experience sampling method to evaluate ubicomp applications. IEEE Pervasive Comput 2003; 2 (02) 24-31
    CrossrefPubMedGoogle Scholar
  • 25 Nahum-Shani I, Hekler EB, Spruijt-Metz D. Building health behavior models to guide the development of just-in-time adaptive interventions: A pragmatic framework. Health Psychol 2015; 34 (S) 1209
    CrossrefPubMedGoogle Scholar
  • 26 Google Duplex: A.I. Assistant Calls Local Businesses To Make Appointments - YouTube [Internet]. [cited 2021 Feb 2]. Available from: https://www.youtube.com/atch?v=D5VN56jQMWM&t=3s&ab_channel=JeffreyGrubb
    PubMed
  • 27 Hancock JT, Naaman M, Levy K. AI-mediated communication: definition, research agenda, and ethical considerations. J Comput-Mediat Commun 2020; 25 (01) 89-100
    CrossrefPubMedGoogle Scholar
  • 28 Palanica A, Flaschner P, Thommandram A, Li M, Fossat Y. Physicians’ perceptions of chatbots in health care: Cross-sectional web-based survey. J Med Internet Res 2019; 21 (04) e12887
    CrossrefPubMedGoogle Scholar
  • 29 Househ M, Doha R. Perceptions and Opinions of Patients About Mental Health Chatbots: Scoping Review. J Med Internet Res 2021; 23 (01) e17828
    CrossrefPubMedGoogle Scholar
  • 30 Luxton DD. Ethical implications of conversational agents in global public health. Bull World Health Organ 2020; 98 (04) 285
    CrossrefPubMedGoogle Scholar
  • 31 Laranjo L, Dunn AG, Tong HL, Kocaballi AB, Chen J, Bashir R. et al. Conversational agents in healthcare: a systematic review. J Am Med Inform Assoc 2018; 25 (09) 1248-58
    CrossrefPubMedGoogle Scholar
  • 32 Car LT, Dhinagaran DA, Kyaw BM, Kowatsch T, Rayhan JS, Theng YL. et al. Conversational agents in health care: Scoping review and conceptual analysis. J Med Internet Res 2020; 22 (08) e17158
    CrossrefPubMedGoogle Scholar
  • 33 Kocaballi AB, Berkovsky S, Quiroz JC, Laranjo L, Tong HL, Rezazadegan D. et al. The personalization of conversational agents in health care: systematic review. J Med Internet Res 2019; 21 (11) e15360
    CrossrefPubMedGoogle Scholar
  • 34 Montenegro JLZ, da Costa CA, da Rosa Righi R. Survey of conversational agents in health. Expert Syst Appl 2019; 129: 56-67
    CrossrefPubMedGoogle Scholar
  • 35 Chang P, Sheng Y-H, Sang Y-Y, Wang D-W. Developing a wireless speech-and touch-based intelligent comprehensive triage support system. CIN Comput Inform Nurs 2008; 26 (01) 31-8
    CrossrefPubMedGoogle Scholar
  • 36 Xu R, Mei G, Zhang G, Gao P, Judkins T, Cannizzaro M. et al. A voice-based automated system for PTSD screening and monitoring. Stud Health Technol Inform 2012; 173: 552-8
    PubMedGoogle Scholar
  • 37 Spänig S, Emberger-Klein A, Sowa J-P, Canbay A, Menrad K, Heider D. The virtual doctor: An interactive clinical-decision-support system based on deep learning for non-invasive prediction of diabetes. Artif Intell Med 2019; 100: 101706
    CrossrefPubMedGoogle Scholar
  • 38 Ghosh S, Bhatia S, Bhatia A. Quro: facilitating user symptom check using a personalised chatbot-oriented dialogue system. Stud Health Technol Inf 2018; 252: 51-6
    PubMedGoogle Scholar
  • 39 Almalki M, Azeez F. Health Chatbots for Fighting COVID-19: a Scoping Review. Acta Inform Medica 2020; 28 (04) 241
    CrossrefPubMedGoogle Scholar
  • 40 Middleton K, Butt M, Hammerla N, Hamblin S, Mehta K, Parsa A. Sorting out symptoms: design and evaluation of the’babylon check’automated triage system. ArXiv Prepr ArXiv160602041.. 2016
    PubMedGoogle Scholar
  • 41 Razzaki S, Baker A, Perov Y, Middleton K, Baxter J, Mullarkey D. et al. A comparative study of artificial intelligence and human doctors for the purpose of triage and diagnosis. ArXiv Prepr ArXiv180610698.. 2018
    PubMedGoogle Scholar
  • 42 Adams WG, Phillips BD, Bacic JD, Walsh KE, Shanahan CW, Paasche-Orlow MK. Automated conversation system before pediatric primary care visits: a randomized trial. Pediatrics 2014; 134 (03) e691-9
    CrossrefPubMedGoogle Scholar
  • 43 Provoost S, Lau HM, Ruwaard J, Riper H. Embodied conversational agents in clinical psychology: a scoping review. J Med Internet Res 2017; 19 (05) e151
    CrossrefPubMedGoogle Scholar
  • 44 Pereira J. Díaz Ó. Using health chatbots for behavior change: A mapping Study. J Med Syst 2019; 43 (05) 135
    PubMedGoogle Scholar
  • 45 Williams ED, Bird D, Forbes AW, Russell A, Ash S, Friedman R. et al. Randomised controlled trial of an automated, interactive telephone intervention (TLC Diabetes) to improve type 2 diabetes management: baseline findings and six-month outcomes. BMC Public Health 2012; 12 (01) 1-11
    CrossrefPubMedGoogle Scholar
  • 46 Tropea P, Schlieter H, Sterpi I, Judica E, Gand K, Caprino M. et al. Rehabilitation, the great absentee of virtual coaching in medical care: scoping review. J Med Internet Res 2019; 21 (10) e12805
    CrossrefPubMedGoogle Scholar
  • 47 Milne-Ives M, de Cock C, Lim E, Shehadeh MH, de Pennington N, Mole G. et al. The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review. J Med Internet Res 2020; 22 (10) e20346
    CrossrefPubMedGoogle Scholar
  • 48 Gong E, Baptista S, Russell A, Scuffham P, Riddell M, Speight J. et al. My Diabetes Coach, a mobile application-based interactive conversational agent to support type 2 diabetes self-management: A randomized effectiveness-implementation trial. Forthcoming. 2021
    PubMedGoogle Scholar
  • 49 Kramer LL, Ter Stal S, Mulder BC, de Vet E, van Velsen L. Developing Embodied Conversational Agents for Coaching People in a Healthy Lifestyle: Scoping Review. J Med Internet Res 2020; 22 (02) e14058
    CrossrefPubMedGoogle Scholar
  • 50 Baptista S, Wadley G, Bird D, Harris M, Riddell M, Russell A. et al. Acceptability of an embodied conversational agent for type 2 diabetes self-management education and support via a smartphone app: a mixed-methods study. Diabetes Technol Ther 2020; 22: A221-2
    PubMedGoogle Scholar
  • 51 Gao L, Maddison R, Rawstorn J, Ball K, Oldenburg B, Chow C. et al. Protocol: Economic evaluation protocol for a multicentre randomised controlled trial to compare Smartphone Cardiac Rehabilitation, Assisted self-Management (SCRAM) versus usual care cardiac rehabilitation among people with coronary heart disease. BMJ Open 2020;10(8)
    PubMedGoogle Scholar
  • 52 The Heart Foundation. Australian heart disease statistics [Internet]. The Heart Foundation. 2020 [cited 2020 Apr 22]. Available from: https://www.heartfoundation.org.au/about-us/what-we-do/heart-disease-in-australia/australian-heart-disease-statistics
    PubMedGoogle Scholar
  • 53 Böhmer M, Hecht B, Schöning J, Krüger A, Bauer G. Falling asleep with angry birds, facebook and kindle: a large scale study on mobile application usage. In: Proceedings of the 13th Conference on Human-Computer Interaction with Mobile Devices and Services, Mobile HCI; 2011; 47-56
    PubMedGoogle Scholar
  • 54 Meadows R, Hine C, Suddaby E. Conversational agents and the making of mental health recovery. Digit Health 2020; 6: 2055207620966170
    CrossrefPubMedGoogle Scholar
  • 55 Sebastian J, Richards D. Changing stigmatizing attitudes to mental health via education and contact with embodied conversational agents. Comput Hum Behav 2017; 73: 479-88
    CrossrefPubMedGoogle Scholar
  • 56 Open source conversational AI [Internet]. Rasa 2020 [cited 2021 Feb 2]. Available from: https://rasa.com/
    PubMedGoogle Scholar
  • 57 Gong E, Baptista S, Russell A, Scuffham P, Riddell M, Speight J. et al. My Diabetes Coach, a Mobile App-Based Interactive Conversational Agent to Support Type 2 Diabetes Self-Management: Randomized Effectiveness-Implementation Trial. J Med Internet Res 2020 Nov 5; 22 (11) e20322
    CrossrefPubMedGoogle Scholar
  • 58 Mental Health Chatbot [Internet]. Woebot Health. [cited 2021 Feb 2]. Available from: https://woebothealth.com/
    PubMedGoogle Scholar
  • 59 Liao K, Liu Q, Wei Z, Peng B, Chen Q, Sun W. et al. Task-oriented Dialogue System for Automatic Disease Diagnosis via Hierarchical Reinforcement Learning. ArXiv Prepr ArXiv200414254. 2020
    PubMedGoogle Scholar