Effects of a robotic storyteller's moody gestures on storytelling perception

Junchao Xu, Joost Broekens, Koen Hindriks, Mark A. Neerincx

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

Abstract

A parameterized behavior model was developed for robots to show mood during task execution. In this study, we applied the model to the coverbal gestures of a robotic storyteller. This study investigated whether parameterized mood expression can 1) show mood that is changing over time; 2) reinforce affect communication when other modalities exist; 3) influence the mood induction process of the story; and 4) improve listeners' ratings of the storytelling experience and the robotic storyteller. We modulated the gestures to show either a congruent or an incongruent mood with the story mood. Results show that it is feasible to use parameterized coverbal gestures to express mood evolving over time and that participants can distinguish whether the mood expressed by the gestures is congruent or incongruent with the story mood. In terms of effects on participants we found that mood-modulated gestures (a) influence participants' mood, and (b) influence participants' ratings of the storytelling experience and the robotic storyteller.

Original languageEnglish
Title of host publication2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages449-455
Number of pages7
ISBN (Electronic)9781479999538
DOIs
Publication statusPublished - 2 Dec 2015
Externally publishedYes
Event2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015 - Xi'an, China
Duration: 21 Sep 201524 Sep 2015

Conference

Conference2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015
CountryChina
CityXi'an
Period21/09/1524/09/15

Fingerprint

Robotics
Robots
Communication

Keywords

  • Body Language
  • Human Robot Interaction
  • Mood Expression
  • Social Robots
  • Storytelling

Cite this

Xu, J., Broekens, J., Hindriks, K., & Neerincx, M. A. (2015). Effects of a robotic storyteller's moody gestures on storytelling perception. In 2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015 (pp. 449-455). [7344609] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ACII.2015.7344609
Xu, Junchao ; Broekens, Joost ; Hindriks, Koen ; Neerincx, Mark A. / Effects of a robotic storyteller's moody gestures on storytelling perception. 2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 449-455
@inproceedings{f49203d408c642c0a4751edf451258a3,
title = "Effects of a robotic storyteller's moody gestures on storytelling perception",
abstract = "A parameterized behavior model was developed for robots to show mood during task execution. In this study, we applied the model to the coverbal gestures of a robotic storyteller. This study investigated whether parameterized mood expression can 1) show mood that is changing over time; 2) reinforce affect communication when other modalities exist; 3) influence the mood induction process of the story; and 4) improve listeners' ratings of the storytelling experience and the robotic storyteller. We modulated the gestures to show either a congruent or an incongruent mood with the story mood. Results show that it is feasible to use parameterized coverbal gestures to express mood evolving over time and that participants can distinguish whether the mood expressed by the gestures is congruent or incongruent with the story mood. In terms of effects on participants we found that mood-modulated gestures (a) influence participants' mood, and (b) influence participants' ratings of the storytelling experience and the robotic storyteller.",
keywords = "Body Language, Human Robot Interaction, Mood Expression, Social Robots, Storytelling",
author = "Junchao Xu and Joost Broekens and Koen Hindriks and Neerincx, {Mark A.}",
year = "2015",
month = "12",
day = "2",
doi = "10.1109/ACII.2015.7344609",
language = "English",
pages = "449--455",
booktitle = "2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

Xu, J, Broekens, J, Hindriks, K & Neerincx, MA 2015, Effects of a robotic storyteller's moody gestures on storytelling perception. in 2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015., 7344609, Institute of Electrical and Electronics Engineers Inc., pp. 449-455, 2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015, Xi'an, China, 21/09/15. https://doi.org/10.1109/ACII.2015.7344609

Effects of a robotic storyteller's moody gestures on storytelling perception. / Xu, Junchao; Broekens, Joost; Hindriks, Koen; Neerincx, Mark A.

2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015. Institute of Electrical and Electronics Engineers Inc., 2015. p. 449-455 7344609.

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - Effects of a robotic storyteller's moody gestures on storytelling perception

AU - Xu, Junchao

AU - Broekens, Joost

AU - Hindriks, Koen

AU - Neerincx, Mark A.

PY - 2015/12/2

Y1 - 2015/12/2

N2 - A parameterized behavior model was developed for robots to show mood during task execution. In this study, we applied the model to the coverbal gestures of a robotic storyteller. This study investigated whether parameterized mood expression can 1) show mood that is changing over time; 2) reinforce affect communication when other modalities exist; 3) influence the mood induction process of the story; and 4) improve listeners' ratings of the storytelling experience and the robotic storyteller. We modulated the gestures to show either a congruent or an incongruent mood with the story mood. Results show that it is feasible to use parameterized coverbal gestures to express mood evolving over time and that participants can distinguish whether the mood expressed by the gestures is congruent or incongruent with the story mood. In terms of effects on participants we found that mood-modulated gestures (a) influence participants' mood, and (b) influence participants' ratings of the storytelling experience and the robotic storyteller.

AB - A parameterized behavior model was developed for robots to show mood during task execution. In this study, we applied the model to the coverbal gestures of a robotic storyteller. This study investigated whether parameterized mood expression can 1) show mood that is changing over time; 2) reinforce affect communication when other modalities exist; 3) influence the mood induction process of the story; and 4) improve listeners' ratings of the storytelling experience and the robotic storyteller. We modulated the gestures to show either a congruent or an incongruent mood with the story mood. Results show that it is feasible to use parameterized coverbal gestures to express mood evolving over time and that participants can distinguish whether the mood expressed by the gestures is congruent or incongruent with the story mood. In terms of effects on participants we found that mood-modulated gestures (a) influence participants' mood, and (b) influence participants' ratings of the storytelling experience and the robotic storyteller.

KW - Body Language

KW - Human Robot Interaction

KW - Mood Expression

KW - Social Robots

KW - Storytelling

UR - http://www.scopus.com/inward/record.url?scp=84964038419&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84964038419&partnerID=8YFLogxK

U2 - 10.1109/ACII.2015.7344609

DO - 10.1109/ACII.2015.7344609

M3 - Conference contribution

SP - 449

EP - 455

BT - 2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Xu J, Broekens J, Hindriks K, Neerincx MA. Effects of a robotic storyteller's moody gestures on storytelling perception. In 2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015. Institute of Electrical and Electronics Engineers Inc. 2015. p. 449-455. 7344609 https://doi.org/10.1109/ACII.2015.7344609