TY - JOUR
T1 - What to Discuss?—A Blueprint Topic Model for Health Coaching Dialogues With Conversational Agents
AU - Beinema, Tessa
AU - op den Akker, Harm
AU - Hermens, Hermie J.
AU - van Velsen, Lex
N1 - Publisher Copyright:
© 2022 The Author(s). Published with license by Taylor & Francis Group, LLC.
PY - 2023
Y1 - 2023
N2 - Conversational agents (CAs) are often included as virtual coaches in eHealth applications. Tailoring conversations with these coaches to the individual user can increase the effectiveness of the coaching. An improvement for this tailoring process could be to (automatically) tailor the conversation at the topic level. In this article, we describe the design and evaluation of a blueprint topic model for use in the implementation of such topic selection. First, we constructed a topic model by extracting actions from the literature that a CA as coach could perform. We divided these actions in groups and labeled them with topics. We included literature from the behavioral psychology, relational agents and persuasive technology domains. Second, we evaluated this topic model through an online closed card sort study with health coaching experts. The constructed topic model contains 30 topics and 115 actions. Overall, the sorting of actions into topics was validated by the 11 experts participating in the card sort. Cards with actions that were sorted incorrectly mostly missed an immediacy indicator in their description (e.g., the difference between “you could plan regular walks” as opposed to “let’s plan a walk”) and/or were based on behavior change techniques that were difficult to translate to a conversation. The blueprint topic model presented in this article is an important step towards more intelligent virtual coaches. Future research should focus on the implementation of automatic topic selection. Furthermore, tailoring of coaching dialogues with CAs in multiple steps could be further investigated, for example, from the technical or user interaction perspective.
AB - Conversational agents (CAs) are often included as virtual coaches in eHealth applications. Tailoring conversations with these coaches to the individual user can increase the effectiveness of the coaching. An improvement for this tailoring process could be to (automatically) tailor the conversation at the topic level. In this article, we describe the design and evaluation of a blueprint topic model for use in the implementation of such topic selection. First, we constructed a topic model by extracting actions from the literature that a CA as coach could perform. We divided these actions in groups and labeled them with topics. We included literature from the behavioral psychology, relational agents and persuasive technology domains. Second, we evaluated this topic model through an online closed card sort study with health coaching experts. The constructed topic model contains 30 topics and 115 actions. Overall, the sorting of actions into topics was validated by the 11 experts participating in the card sort. Cards with actions that were sorted incorrectly mostly missed an immediacy indicator in their description (e.g., the difference between “you could plan regular walks” as opposed to “let’s plan a walk”) and/or were based on behavior change techniques that were difficult to translate to a conversation. The blueprint topic model presented in this article is an important step towards more intelligent virtual coaches. Future research should focus on the implementation of automatic topic selection. Furthermore, tailoring of coaching dialogues with CAs in multiple steps could be further investigated, for example, from the technical or user interaction perspective.
UR - http://www.scopus.com/inward/record.url?scp=85130205036&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85130205036&partnerID=8YFLogxK
U2 - 10.1080/10447318.2022.2041884
DO - 10.1080/10447318.2022.2041884
M3 - Article
AN - SCOPUS:85130205036
SN - 1044-7318
VL - 39
SP - 164
EP - 182
JO - International Journal of Human-Computer Interaction
JF - International Journal of Human-Computer Interaction
IS - 1
ER -