Abstract
Explanation of actions is important for transparency of-, and trust in the decisions of smart systems. Literature suggests that emotions and emotion words-in addition to beliefs and goals-are used in human explanations of behaviour. Furthermore, research in e-health support systems and human-robot interaction stresses the need for studying long-term interaction with users. However, state of the art explainable artificial intelligence for intelligent agents focuses mainly on explaining an agent's behaviour based on the underlying beliefs and goals in short-term experiments. In this paper, we report on a long-term experiment in which we tested the effect of cognitive, affective and lack of explanations on children's motivation to use an e-health support system. Children (aged 6-14) suffering from type 1 diabetes mellitus interacted with a virtual robot as part of the e-health system over a period of 2.5-3 months. Children alternated between the three conditions. Agent behaviours that were explained to the children included why 1) the agent asks a certain quiz question; 2) the agent provides a specific tip (a short instruction) about diabetes; or, 3) the agent provides a task suggestion, e.g., play a quiz, or, watch a video about diabetes. Their motivation was measured by counting how often children would follow the agent's suggestion, how often they would continue to play the quiz or ask for an additional tip, and how often they would request an explanation from the system. Surprisingly, children proved to follow task suggestions more often when no explanation was given, while other explanation effects did not appear. This is to our knowledge the first longterm study to report empirical evidence for an agent explanation effect, challenging the next studies to uncover the underlying mechanism.
Original language | English |
---|---|
Title of host publication | Proceedings - 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII) |
Subtitle of host publication | 3-6 Sept. 2019 |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 304-310 |
Number of pages | 7 |
ISBN (Electronic) | 9781728138886 |
ISBN (Print) | 9781728138893 |
DOIs | |
Publication status | Published - 9 Dec 2019 |
Event | 8th International Conference on Affective Computing and Intelligent Interaction, ACII 2019 - Cambridge, United Kingdom Duration: 3 Sept 2019 → 6 Sept 2019 |
Publication series
Name | 2019 8th International Conference on Affective Computing and Intelligent Interaction, ACII 2019 |
---|
Conference
Conference | 8th International Conference on Affective Computing and Intelligent Interaction, ACII 2019 |
---|---|
Country/Territory | United Kingdom |
City | Cambridge |
Period | 3/09/19 → 6/09/19 |
Funding
This work has been supported by the PAL project, Horizon2020 grant nr. 643783-RIA. 1TU Delft, Van Mourik Broekmanweg 6, 2628 XE Delft, The Netherlands [email protected] 2Leiden University, LIACS, Niels Bohrweg 1, 2333 CA Leiden, The Netherlands 3VU, De Boelelaan 1105, 1081 HV Amsterdam, The Netherlands 4TNO, Postbus 23, 3769 ZG Soesterberg, The Netherlands
Keywords
- Emotions in explanations
- Explainable AI
- Goal-based XAI
- Long-term human-agent interaction