Mood mirroring with an embodied virtual agent: A pilot study on the relationship between personalized visual feedback and adherence

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

Abstract

Human support is thought to increase adherence to internet-based interventions for common mental health disorders, but can be costly and reduce treatment accessibility. Embodied virtual agents may be used to deliver automated support, but while many solutions have been shown to be feasible, there is still little controlled research that empirically validates their clinical effectiveness in this context. This study uses a controlled and randomized paradigm to investigate whether feedback from an embodied virtual agent can increase adherence. In a three-week ecological momentary assessment smartphone study, 68 participants were asked to report their mood three times a day. An embodied virtual agent could mirror participant-reported mood states when thanking them for their answers. A two-stage randomization into a text and personalized visual feedback group, versus a text-only control group, was applied to control for individual differences (study onset) and feedback history (after two weeks). Results indicate that while personalized visual feedback did not increase adherence, it did manage to keep adherence constant over a three-week period, whereas fluctuations in adherence could be observed in the text-only control group. Although this was a pilot study, and its results should be interpreted with some caution, this paper shows how virtual agent feedback may have a stabilizing effect on adherence, how controlled experiments on the relationship between virtual agent support and clinically relevant measures such as adherence can be conducted, and how results may be analyzed.

LanguageEnglish
Title of host publicationHighlights of practical applications of agents, multi-agent systems, and complexity: The PAAMS collection
Subtitle of host publicationProceedings of the 16th InternationalInternational Workshops of PAAMS 2018, Toledo, Spain, June 20-22, 2018, Proceedings
EditorsJavier Bajo
PublisherSpringer/Verlag
Pages24-35
Number of pages12
Volume[2]
ISBN (Electronic)9783319947792
ISBN (Print)9783319947785
DOIs
StatePublished - 2018
Event16th International Conference on Practical Applications of Agents, Multi-Agent Systems, PAAMS 2018 - Toledo, Spain
Duration: 20 Jun 201822 Jun 2018

Publication series

NameCommunications in Computer and Information Science
PublisherSpringer
Volume887
ISSN (Print)1865-0929
ISSN (Electronic)1865-0937

Conference

Conference16th International Conference on Practical Applications of Agents, Multi-Agent Systems, PAAMS 2018
CountrySpain
CityToledo
Period20/06/1822/06/18

Fingerprint

Virtual Agents
Mood
Feedback
Individual Differences
Smartphones
Randomisation
Accessibility
Disorder
Mirror
Mirrors
Health
Paradigm
Relationships
Vision
Internet
Fluctuations
Experiment
Text
Experiments

Keywords

  • Adherence
  • Ecological momentary assessment
  • Feedback
  • Virtual agent

Cite this

Provoost, S., Ruwaard, J., Neijenhuijs, K., Bosse, T., & Riper, H. (2018). Mood mirroring with an embodied virtual agent: A pilot study on the relationship between personalized visual feedback and adherence. In J. Bajo (Ed.), Highlights of practical applications of agents, multi-agent systems, and complexity: The PAAMS collection : Proceedings of the 16th InternationalInternational Workshops of PAAMS 2018, Toledo, Spain, June 20-22, 2018, Proceedings (Vol. [2], pp. 24-35). (Communications in Computer and Information Science; Vol. 887). Springer/Verlag. DOI: 10.1007/978-3-319-94779-2_3
Provoost, Simon ; Ruwaard, Jeroen ; Neijenhuijs, Koen ; Bosse, Tibor ; Riper, Heleen. / Mood mirroring with an embodied virtual agent : A pilot study on the relationship between personalized visual feedback and adherence. Highlights of practical applications of agents, multi-agent systems, and complexity: The PAAMS collection : Proceedings of the 16th InternationalInternational Workshops of PAAMS 2018, Toledo, Spain, June 20-22, 2018, Proceedings . editor / Javier Bajo. Vol. [2] Springer/Verlag, 2018. pp. 24-35 (Communications in Computer and Information Science).
@inproceedings{2b51d0d1deb24fc78e284c8071306e6f,
title = "Mood mirroring with an embodied virtual agent: A pilot study on the relationship between personalized visual feedback and adherence",
abstract = "Human support is thought to increase adherence to internet-based interventions for common mental health disorders, but can be costly and reduce treatment accessibility. Embodied virtual agents may be used to deliver automated support, but while many solutions have been shown to be feasible, there is still little controlled research that empirically validates their clinical effectiveness in this context. This study uses a controlled and randomized paradigm to investigate whether feedback from an embodied virtual agent can increase adherence. In a three-week ecological momentary assessment smartphone study, 68 participants were asked to report their mood three times a day. An embodied virtual agent could mirror participant-reported mood states when thanking them for their answers. A two-stage randomization into a text and personalized visual feedback group, versus a text-only control group, was applied to control for individual differences (study onset) and feedback history (after two weeks). Results indicate that while personalized visual feedback did not increase adherence, it did manage to keep adherence constant over a three-week period, whereas fluctuations in adherence could be observed in the text-only control group. Although this was a pilot study, and its results should be interpreted with some caution, this paper shows how virtual agent feedback may have a stabilizing effect on adherence, how controlled experiments on the relationship between virtual agent support and clinically relevant measures such as adherence can be conducted, and how results may be analyzed.",
keywords = "Adherence, Ecological momentary assessment, Feedback, Virtual agent",
author = "Simon Provoost and Jeroen Ruwaard and Koen Neijenhuijs and Tibor Bosse and Heleen Riper",
year = "2018",
doi = "10.1007/978-3-319-94779-2_3",
language = "English",
isbn = "9783319947785",
volume = "[2]",
series = "Communications in Computer and Information Science",
publisher = "Springer/Verlag",
pages = "24--35",
editor = "Javier Bajo",
booktitle = "Highlights of practical applications of agents, multi-agent systems, and complexity: The PAAMS collection",

}

Provoost, S, Ruwaard, J, Neijenhuijs, K, Bosse, T & Riper, H 2018, Mood mirroring with an embodied virtual agent: A pilot study on the relationship between personalized visual feedback and adherence. in J Bajo (ed.), Highlights of practical applications of agents, multi-agent systems, and complexity: The PAAMS collection : Proceedings of the 16th InternationalInternational Workshops of PAAMS 2018, Toledo, Spain, June 20-22, 2018, Proceedings . vol. [2], Communications in Computer and Information Science, vol. 887, Springer/Verlag, pp. 24-35, 16th International Conference on Practical Applications of Agents, Multi-Agent Systems, PAAMS 2018, Toledo, Spain, 20/06/18. DOI: 10.1007/978-3-319-94779-2_3

Mood mirroring with an embodied virtual agent : A pilot study on the relationship between personalized visual feedback and adherence. / Provoost, Simon; Ruwaard, Jeroen; Neijenhuijs, Koen; Bosse, Tibor; Riper, Heleen.

Highlights of practical applications of agents, multi-agent systems, and complexity: The PAAMS collection : Proceedings of the 16th InternationalInternational Workshops of PAAMS 2018, Toledo, Spain, June 20-22, 2018, Proceedings . ed. / Javier Bajo. Vol. [2] Springer/Verlag, 2018. p. 24-35 (Communications in Computer and Information Science; Vol. 887).

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - Mood mirroring with an embodied virtual agent

T2 - A pilot study on the relationship between personalized visual feedback and adherence

AU - Provoost,Simon

AU - Ruwaard,Jeroen

AU - Neijenhuijs,Koen

AU - Bosse,Tibor

AU - Riper,Heleen

PY - 2018

Y1 - 2018

N2 - Human support is thought to increase adherence to internet-based interventions for common mental health disorders, but can be costly and reduce treatment accessibility. Embodied virtual agents may be used to deliver automated support, but while many solutions have been shown to be feasible, there is still little controlled research that empirically validates their clinical effectiveness in this context. This study uses a controlled and randomized paradigm to investigate whether feedback from an embodied virtual agent can increase adherence. In a three-week ecological momentary assessment smartphone study, 68 participants were asked to report their mood three times a day. An embodied virtual agent could mirror participant-reported mood states when thanking them for their answers. A two-stage randomization into a text and personalized visual feedback group, versus a text-only control group, was applied to control for individual differences (study onset) and feedback history (after two weeks). Results indicate that while personalized visual feedback did not increase adherence, it did manage to keep adherence constant over a three-week period, whereas fluctuations in adherence could be observed in the text-only control group. Although this was a pilot study, and its results should be interpreted with some caution, this paper shows how virtual agent feedback may have a stabilizing effect on adherence, how controlled experiments on the relationship between virtual agent support and clinically relevant measures such as adherence can be conducted, and how results may be analyzed.

AB - Human support is thought to increase adherence to internet-based interventions for common mental health disorders, but can be costly and reduce treatment accessibility. Embodied virtual agents may be used to deliver automated support, but while many solutions have been shown to be feasible, there is still little controlled research that empirically validates their clinical effectiveness in this context. This study uses a controlled and randomized paradigm to investigate whether feedback from an embodied virtual agent can increase adherence. In a three-week ecological momentary assessment smartphone study, 68 participants were asked to report their mood three times a day. An embodied virtual agent could mirror participant-reported mood states when thanking them for their answers. A two-stage randomization into a text and personalized visual feedback group, versus a text-only control group, was applied to control for individual differences (study onset) and feedback history (after two weeks). Results indicate that while personalized visual feedback did not increase adherence, it did manage to keep adherence constant over a three-week period, whereas fluctuations in adherence could be observed in the text-only control group. Although this was a pilot study, and its results should be interpreted with some caution, this paper shows how virtual agent feedback may have a stabilizing effect on adherence, how controlled experiments on the relationship between virtual agent support and clinically relevant measures such as adherence can be conducted, and how results may be analyzed.

KW - Adherence

KW - Ecological momentary assessment

KW - Feedback

KW - Virtual agent

UR - https://rd.springer.com/book/10.1007/978-3-319-94779-2

UR - http://www.scopus.com/inward/record.url?scp=85049365026&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85049365026&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-94779-2_3

DO - 10.1007/978-3-319-94779-2_3

M3 - Conference contribution

SN - 9783319947785

VL - [2]

T3 - Communications in Computer and Information Science

SP - 24

EP - 35

BT - Highlights of practical applications of agents, multi-agent systems, and complexity: The PAAMS collection

PB - Springer/Verlag

ER -

Provoost S, Ruwaard J, Neijenhuijs K, Bosse T, Riper H. Mood mirroring with an embodied virtual agent: A pilot study on the relationship between personalized visual feedback and adherence. In Bajo J, editor, Highlights of practical applications of agents, multi-agent systems, and complexity: The PAAMS collection : Proceedings of the 16th InternationalInternational Workshops of PAAMS 2018, Toledo, Spain, June 20-22, 2018, Proceedings . Vol. [2]. Springer/Verlag. 2018. p. 24-35. (Communications in Computer and Information Science). Available from, DOI: 10.1007/978-3-319-94779-2_3