Download PDF
Methods Inf Med 2019; 58(01): 009-023
DOI: 10.1055/s-0039-1688757
Original Article
Georg Thieme Verlag KG Stuttgart · New York

Assistive Conversational Agent for Health Coaching: A Validation Study

Ahmed Fadhil
1   University of Trento, Trento, Italy
,
Yunlong Wang   ∗
2   HCI Group, University of Konstanz, Konstanz, Germany
,
Harald Reiterer
2   HCI Group, University of Konstanz, Konstanz, Germany
› Author Affiliations
Further Information

Publication History

08 September 2018

20 March 2019

Publication Date:
22 May 2019 (online)

    Permissions and Reprints

Abstract

Objective Poor lifestyle represents a health risk factor and is the leading cause of morbidity and chronic conditions. The impact of poor lifestyle can be significantly altered by individual's behavioral modification. Although there are abundant lifestyle promotion applications and tools, they are still limited in providing tailored social support that goes beyond their predefined functionalities. In addition, virtual coaching approaches are still unable to handle user emotional needs. Our approach presents a human–virtual agent mediated system that leverages the conversational agent to handle menial caregiver's works by engaging users (e.g., patients) in a conversation with the conversational agent. The dialog used a natural conversation to interact with users, delivered by the conversational agent and handled with a finite state machine automaton. Our research differs from existing approaches that replace a human coach with a fully automated assistant on user support. The methodology allows users to interact with the technology and access health-related interventions. To assist physicians, the conversational agent gives weighting to user's adherence, based on prior defined conditions.

Materials and Methods This article describes the design and validation of CoachAI, a conversational agent-assisted health coaching system to support health intervention delivery to individuals or groups. CoachAI instantiates a text-based health care conversational agent system that bridges the remote human coach and the users.

Results We will discuss our approach and highlight the outcome of a 1-month validation study on physical activity, healthy diet, and stress coping. The study validates technology aspects of our human–virtual agent mediated health coaching system. We present the intervention settings and findings from the study. In addition, we present some user-experience validation results gathered during or after the experimentation.

Conclusions The study provided a set of dimensions when building a human–conversational agent powered health intervention tool. The results provided interesting insights when using human–conversational agent mediated approach in health coaching systems. The findings revealed that users who were highly engaged were also more adherent to conversational-agent activities. This research made key contributions to the literature on techniques in providing social, yet tailored health coaching support: (1) identifying habitual patterns to understand user preferences; (2) the role of a conversational agent in delivering health promoting microactivities; (3) building the technology while adhering to individuals' daily messaging routine; and (4) a socio-technical system that fits with the role of conversational agent as an assistive component.

Future Work Future improvements will consider building the activity recommender based on users' interaction data and integrating users' dietary pattern and emotional wellbeing into the initial user clustering by leveraging information and communication technology approaches (e.g., machine learning). We will integrate a sentiment analysis capability to gather further data about individuals and report these data to the caregiver.

Keywords

Health coaching - conversational agent - validation study - physical activity - healthy diet - mental wellness

∗ Co-first author


 

  • References

  • 1 Epstein LH, Gordy CC, Raynor HA, Beddome M, Kilanowski CK, Paluch R. Increasing fruit and vegetable intake and decreasing fat and sugar intake in families at risk for childhood obesity. Obes Res 2001; 9 (03) 171-178
    PubMedGoogle Scholar
  • 2 Bech P, Olsen LR, Kjoller M, Rasmussen NK. Measuring well-being rather than the absence of distress symptoms: a comparison of the SF-36 Mental Health subscale and the WHO-Five Well-Being Scale. Int J Methods Psychiatr Res 2003; 12 (02) 85-91
    CrossrefPubMedGoogle Scholar
  • 3 Smith KA, Dennis M, Masthoff J. Personalizing reminders to personality for melanoma self-checking. Paper presented at: Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization; July 13, 2016; New York, NY: ACM; 85–93
    PubMedGoogle Scholar
  • 4 Sawyer MG, Arney FM, Baghurst PA. , et al. The mental health of young people in Australia: key findings from the child and adolescent component of the national survey of mental health and well-being. Aust N Z J Psychiatry 2001; 35 (06) 806-814
    CrossrefPubMedGoogle Scholar
  • 5 Dol A, Kulyk O, Velthuijsen H, van Gemert-Pijnen JE, Strien TV. The use of dialectical dialogues in a personalized virtual coach for obese emotional eaters: A research protocol for a field study among target group. Paper presented at: eTELEMED 2017: The Ninth International Conference on eHealth, Telemedicine, and Social Medicine; Welmington, DE: International Academy, Research, and Industry Association (IARIA), 2017
    PubMedGoogle Scholar
  • 6 Turner-McGrievy GM, Beets MW, Moore JB, Kaczynski AT, Barr-Anderson DJ, Tate DF. Comparison of traditional versus mobile app self-monitoring of physical activity and dietary intake among overweight adults participating in an mHealth weight loss program. J Am Med Inform Assoc 2013; 20 (03) 513-518
    CrossrefPubMedGoogle Scholar
  • 7 Schoffman DE, Turner-McGrievy G, Jones SJ, Wilcox S. Mobile apps for pediatric obesity prevention and treatment, healthy eating, and physical activity promotion: just fun and games?. Transl Behav Med 2013; 3 (03) 320-325
    CrossrefPubMedGoogle Scholar
  • 8 Bosomworth D. Mobile marketing statistics 2015 . Leeds: Smart Insights (Marketing Intelligence) Ltd. 2015
    PubMed
  • 9 Seiler R, Hüttermann M. E-Health, fitness trackers and wearables—Use among Swiss students. Paper presented at: Advances in Business-Related Scientific Research Conference 2015 Proceedings; Venice, Italy. 2015
    PubMedGoogle Scholar
  • 10 Clawson J, Pater JA, Miller AD, Mynatt ED, Mamykina L. No longer wearing: investigating the abandonment of personal health-tracking technologies on craigslist. Paper presented at: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing; September 7, 2015; New York, NY: ACM; 647–658
    PubMedGoogle Scholar
  • 11 Hall AK, Cole-Lewis H, Bernhardt JM. Mobile text messaging for health: a systematic review of reviews. Annu Rev Public Health 2015; 36: 393-415
    CrossrefPubMedGoogle Scholar
  • 12 Fadhil A, Matteotti C, Armellin G, Villafiorita A, Betti D. Coach Me: a platform for promoting healthy lifestyle. Paper presented at: Proceedings of the 18th International Conference on Human–Computer Interaction with Mobile Devices and Services Adjunct; September 6, 2016; New York, NY: ACM; 1077–1080
    PubMedGoogle Scholar
  • 13 Fadhil A, Gabrielli S. Addressing challenges in promoting healthy lifestyles: the al-conversational agent approach. Paper presented at: Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare; May 23, 2017; New York, NY: ACM; 261–265
    PubMedGoogle Scholar
  • 14 Fadhil A, Schiavo G, Wang Y, Yilma BA. The effect of emojis when interacting with conversational interface assisted health coaching system. Paper presented at: Proceedings of the 12th EAI International Conference on Pervasive Computing Technologies for Healthcare; May 21, 2018; New York, NY: ACM; 378–383
    PubMedGoogle Scholar
  • 15 Bardus M, Hamadeh G, Hayek B, Al Kherfan R. A self-directed mobile intervention (WaznApp) to promote weight control among employees at a Lebanese university: protocol for a feasibility pilot randomized controlled trial. JMIR Res Protoc 2018; 7 (05) e133
    CrossrefPubMedGoogle Scholar
  • 16 Fadhil A. A Conversational Interface to Improve Medication Adherence: Towards AI Support in User‘s Treatment (preprint arXiv:1803.09844). Available at: https://arxiv.org/ftp/arxiv/papers/1803/1803.09844.pdf . Accessed April 15, 2019
    PubMedGoogle Scholar
  • 17 Fitzpatrick KK, Darcy A, Vierhile M. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR Ment Health 2017; 4 (02) e19
    CrossrefPubMedGoogle Scholar
  • 18 Brawley LR, Rejeski WJ, King AC. Promoting physical activity for older adults: the challenges for changing behavior. Am J Prev Med 2003; 25 (03) (Suppl. 02) 172-183
    CrossrefPubMedGoogle Scholar
  • 19 Abdelrazek M, Ibrahim A, Cain A, Grundy J. Vision: mobile ehealth learning and intervention platform. Paper presented at: Proceedings of the 5th International Conference on Mobile Software Engineering and Systems; May 27, 2018; New York, NY: ACM; 252–256
    PubMedGoogle Scholar
  • 20 Ibrahim ZM, Fernández de la Cruz L, Stringaris A, Goodman R, Luck M, Dobson RJ. A multi-agent platform for automating the collection of user-provided clinical feedback. Paper presented at: Proceedings of the 2015 International Conference on Autonomous Agents and Multiagent Systems; May 4, 2015; Richland, WA: International Foundation for Autonomous Agents and Multiagent Systems; 831–839
    PubMedGoogle Scholar
  • 21 Kitsiou S, Thomas M, Marai GE. , et al. Development of an innovative mHealth platform for remote physical activity monitoring and health coaching of cardiac rehabilitation patients. Paper presented at: 2017 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI); February 16, 2017. IEEE; 133–136
    PubMedGoogle Scholar
  • 22 Báez M, Ibarra F, Far IK, Ferron M, Casati F. Online group-exercises for older adults of different physical abilities. Paper presented at: 2016 International Conference on Collaboration Technologies and Systems (CTS); October 31, 2016; IEEE; 524–533
    PubMedGoogle Scholar
  • 23 Vaira L, Bochicchio MA, Conte M, Casaluci FM, Melpignano A. MamaBot: a system based on ML and NLP for supporting women and families during pregnancy. Paper presented at: Proceedings of the 22nd International Database Engineering & Applications Symposium; June 18, 2018; New York, NY: ACM; 273–277
    PubMedGoogle Scholar
  • 24 Wu J, Sinnott RO, Effendy J, Glöckner S, Hu W, Li J. Usage patterns and data quality: a case study of a national type-1 diabetes study. Paper presented at: Proceedings of the 1st International Conference on Medical and Health Informatics 2017 ; May 20, 2017; New York, NY: ACM; 18–27
    PubMedGoogle Scholar
  • 25 Cruciani F, Cleland I, Nugent C, McCullagh P, Synnes K, Hallberg J. Automatic annotation for human activity recognition in free living using a smartphone. Sensors (Basel) 2018; 18 (07) 2203
    CrossrefPubMedGoogle Scholar
  • 26 Sourial M, Elnaggar A, Reichardt D. Development of a virtual coach scenario for hand therapy using LEAP motion. Paper presented at: 2016 Future Technologies Conference (FTC); December 2016; IEEE; 1071–1078
    PubMedGoogle Scholar
  • 27 Haug S, Castro RP, Filler A, Kowatsch T, Fleisch E, Schaub MP. Efficacy of an Internet and SMS-based integrated smoking cessation and alcohol intervention for smoking cessation in young people: study protocol of a two-arm cluster randomised controlled trial. BMC Public Health 2014; 14 (01) 1140
    CrossrefPubMedGoogle Scholar
  • 28 Shamekhi A, Trinh H, Bickmore TW. , et al. A virtual self-care coach for individuals with spinal cord injury. Paper presented at: Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility; October 23, 2016; New York, NY: ACM; 327–328
    PubMedGoogle Scholar
  • 29 Villalonga C, Hermens H, Herrera LJ. , et al. Ontological modeling of motivational messages for physical activity coaching. Paper presented at: Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare; May 23, 2017; New York, NY: ACM; 355–364
    PubMedGoogle Scholar
  • 30 Boratto L, Carta S, Mulas F, Pilloni P. An e-coaching ecosystem: design and effectiveness analysis of the engagement of remote coaching on athletes. Pers Ubiquitous Comput 2017; 21 (04) 689-704
    CrossrefPubMedGoogle Scholar
  • 31 Wang Y, Fadhil A, Reiterer H. Supporting action planning for sedentary behavior change by visualizing personal mobility patterns on smartphone. Paper presented at: Proceedings of the 12th EAI International Conference on Pervasive Computing Technologies for Healthcare; May 21, 2018; New York, NY: ACM; 396–401
    PubMedGoogle Scholar
  • 32 Ghose S, Barua JJ. Toward the implementation of a topic specific dialogue based natural language conversational agent as an undergraduate advisor. Paper presented at: 2013 International Conference on Informatics, Electronics & Vision (ICIEV); May 17, 2013; IEEE; 1–5
    PubMedGoogle Scholar
  • 33 Fadhil A, Villafiorita A. An adaptive learning with gamification & conversational UIs: the rise of CiboPoliBot. Paper presented at: Adjunct Publication of the 25th Conference on user Modeling, Adaptation and Personalization; July 9, 2017; New York, NY: ACM; 408–412
    PubMedGoogle Scholar
  • 34 Lokman AS, Zain JM, Komputer FS, Perisian K. Designing a conversational agent for diabetic users. Paper presented at: International Conference on Software Engineering & Computer Systems (ICSECS'09); October 2009; 19–21
    PubMedGoogle Scholar
  • 35 Sperling RA, Aisen PS, Beckett LA. , et al. Toward defining the preclinical stages of Alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement 2011; 7 (03) 280-292
    CrossrefPubMedGoogle Scholar
  • 36 Veen EV, Bovendeert JF, Backx FJG, Huisstede BMA. E-coaching: New future for cardiac rehabilitation? A systematic review. 2017; 100 (Suppl. 12) 2218-2230
    PubMedGoogle Scholar
  • 37 Bickmore TW, Pfeifer LM, Byron D. , et al. Usability of conversational agents by patients with inadequate health literacy: evidence from two clinical trials. J Health Commun 2010; 15 (Suppl. 02) 197-210
    CrossrefPubMedGoogle Scholar
  • 38 Schulman D, Bickmore TW, Sidner CL. An intelligent conversational agent for promoting long-term health behavior change using motivational interviewing. Paper presented at: AAAI Spring Symposium: AI and Health Communication; March 20, 2011
    PubMedGoogle Scholar
  • 39 Johnston B, Wheeler L, Deuser J, Sousa KH. Outcomes of the Kaiser Permanente tele-home health research project. Arch Fam Med 2000; 9 (01) 40-45
    CrossrefPubMedGoogle Scholar
  • 40 Borawska-Popielarz M. Addressing internalizing problems in middle school youth with check in/check out. Available at: https://scholarworks.waldenu.edu/cgi/viewcontent.cgi?referer=https://www.google.com/&httpsredir=1&article=3124&context=dissertations . Accessed April 15, 2019
    PubMed
  • 41 Schwarzer R, Lippke S, Luszczynska A. Mechanisms of health behavior change in persons with chronic illness or disability: the Health Action Process Approach (HAPA). Rehabil Psychol 2011; 56 (03) 161-170
    CrossrefPubMedGoogle Scholar
  • 42 Venkatesh V, Davis FD. A theoretical extension of the technology acceptance model: four longitudinal field studies. Manage Sci 2000; 46 (02) 186-204
    CrossrefPubMedGoogle Scholar
  • 43 Hassenzahl M, Burmester M, Koller F. AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. Paper presented at: Mensch & Computer 2003; Teubner Verlag, Vieweg + ; 2003 :187–196
    PubMedGoogle Scholar
  • 44 United States Department of Agriculture. Choose MyPlate. How many vegetables are needed daily or weekly? 2012. Available at: https://www.choosemyplate.gov/vegetables . Accessed April 15, 2019
    PubMedGoogle Scholar
  • 45 Lentferink AJ, Oldenhuis HK, de Groot M, Polstra L, Velthuijsen H, van Gemert-Pijnen JE. Key components in eHealth interventions combining self-tracking and persuasive eCoaching to promote a healthier lifestyle: a scoping review. J Med Internet Res 2017; 19 (08) e277
    CrossrefPubMedGoogle Scholar
  • 46 Morrison LG, Yardley L, Powell J, Michie S. What design features are used in effective e-health interventions? A review using techniques from critical interpretive synthesis. Telemed J E Health 2012; 18 (02) 137-144
    CrossrefPubMedGoogle Scholar
  • 47 Schwarzer R. Modeling health behavior change: how to predict and modify the adoption and maintenance of health behaviors. Appl Psychol 2008; 57 (01) 1-29
    CrossrefPubMedGoogle Scholar
  • 48 Cole-Lewis H, Kershaw T. Text messaging as a tool for behavior change in disease prevention and management. Epidemiol Rev 2010; 32 (01) 56-69
    CrossrefPubMedGoogle Scholar
  • 49 Tatai G, Csordás A, Kiss Á, Laufer L, Szaló A. The chatbot who loved me. Paper presented at: Proceedings of the ECA Workshop of AAMAS 2003 ; Melbourne, Australia; 2003
    PubMedGoogle Scholar