Effects of a robotic storyteller's moody gestures on storytelling perception

Junchao Xu; Joost Broekens; Koen Hindriks; Mark A. Neerincx

doi:10.1109/ACII.2015.7344609

Effects of a robotic storyteller's moody gestures on storytelling perception

Junchao Xu, Joost Broekens, Koen Hindriks, Mark A. Neerincx

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

Abstract

A parameterized behavior model was developed for robots to show mood during task execution. In this study, we applied the model to the coverbal gestures of a robotic storyteller. This study investigated whether parameterized mood expression can 1) show mood that is changing over time; 2) reinforce affect communication when other modalities exist; 3) influence the mood induction process of the story; and 4) improve listeners' ratings of the storytelling experience and the robotic storyteller. We modulated the gestures to show either a congruent or an incongruent mood with the story mood. Results show that it is feasible to use parameterized coverbal gestures to express mood evolving over time and that participants can distinguish whether the mood expressed by the gestures is congruent or incongruent with the story mood. In terms of effects on participants we found that mood-modulated gestures (a) influence participants' mood, and (b) influence participants' ratings of the storytelling experience and the robotic storyteller.

Original language	English
Title of host publication	2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	449-455
Number of pages	7
ISBN (Electronic)	9781479999538
DOIs	https://doi.org/10.1109/ACII.2015.7344609
Publication status	Published - 2 Dec 2015
Externally published	Yes
Event	2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015 - Xi'an, China Duration: 21 Sept 2015 → 24 Sept 2015

Conference

Conference	2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015
Country/Territory	China
City	Xi'an
Period	21/09/15 → 24/09/15

Keywords

Body Language
Human Robot Interaction
Mood Expression
Social Robots
Storytelling

Access to Document

10.1109/ACII.2015.7344609

Handle.net

Persistent link

Cite this

@inproceedings{f49203d408c642c0a4751edf451258a3,

title = "Effects of a robotic storyteller's moody gestures on storytelling perception",

abstract = "A parameterized behavior model was developed for robots to show mood during task execution. In this study, we applied the model to the coverbal gestures of a robotic storyteller. This study investigated whether parameterized mood expression can 1) show mood that is changing over time; 2) reinforce affect communication when other modalities exist; 3) influence the mood induction process of the story; and 4) improve listeners' ratings of the storytelling experience and the robotic storyteller. We modulated the gestures to show either a congruent or an incongruent mood with the story mood. Results show that it is feasible to use parameterized coverbal gestures to express mood evolving over time and that participants can distinguish whether the mood expressed by the gestures is congruent or incongruent with the story mood. In terms of effects on participants we found that mood-modulated gestures (a) influence participants' mood, and (b) influence participants' ratings of the storytelling experience and the robotic storyteller.",

keywords = "Body Language, Human Robot Interaction, Mood Expression, Social Robots, Storytelling",

author = "Junchao Xu and Joost Broekens and Koen Hindriks and Neerincx, {Mark A.}",

year = "2015",

month = dec,

day = "2",

doi = "10.1109/ACII.2015.7344609",

language = "English",

pages = "449--455",

booktitle = "2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

address = "United States",

note = "2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015 ; Conference date: 21-09-2015 Through 24-09-2015",

}

Xu, J, Broekens, J, Hindriks, K & Neerincx, MA 2015, Effects of a robotic storyteller's moody gestures on storytelling perception. in 2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015., 7344609, Institute of Electrical and Electronics Engineers Inc., pp. 449-455, 2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015, Xi'an, China, 21/09/15. https://doi.org/10.1109/ACII.2015.7344609

Effects of a robotic storyteller's moody gestures on storytelling perception. / Xu, Junchao; Broekens, Joost; Hindriks, Koen et al.

2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015. Institute of Electrical and Electronics Engineers Inc., 2015. p. 449-455 7344609.

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Effects of a robotic storyteller's moody gestures on storytelling perception

AU - Xu, Junchao

AU - Broekens, Joost

AU - Hindriks, Koen

AU - Neerincx, Mark A.

PY - 2015/12/2

Y1 - 2015/12/2

N2 - A parameterized behavior model was developed for robots to show mood during task execution. In this study, we applied the model to the coverbal gestures of a robotic storyteller. This study investigated whether parameterized mood expression can 1) show mood that is changing over time; 2) reinforce affect communication when other modalities exist; 3) influence the mood induction process of the story; and 4) improve listeners' ratings of the storytelling experience and the robotic storyteller. We modulated the gestures to show either a congruent or an incongruent mood with the story mood. Results show that it is feasible to use parameterized coverbal gestures to express mood evolving over time and that participants can distinguish whether the mood expressed by the gestures is congruent or incongruent with the story mood. In terms of effects on participants we found that mood-modulated gestures (a) influence participants' mood, and (b) influence participants' ratings of the storytelling experience and the robotic storyteller.

AB - A parameterized behavior model was developed for robots to show mood during task execution. In this study, we applied the model to the coverbal gestures of a robotic storyteller. This study investigated whether parameterized mood expression can 1) show mood that is changing over time; 2) reinforce affect communication when other modalities exist; 3) influence the mood induction process of the story; and 4) improve listeners' ratings of the storytelling experience and the robotic storyteller. We modulated the gestures to show either a congruent or an incongruent mood with the story mood. Results show that it is feasible to use parameterized coverbal gestures to express mood evolving over time and that participants can distinguish whether the mood expressed by the gestures is congruent or incongruent with the story mood. In terms of effects on participants we found that mood-modulated gestures (a) influence participants' mood, and (b) influence participants' ratings of the storytelling experience and the robotic storyteller.

KW - Body Language

KW - Human Robot Interaction

KW - Mood Expression

KW - Social Robots

KW - Storytelling

UR - http://www.scopus.com/inward/record.url?scp=84964038419&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84964038419&partnerID=8YFLogxK

U2 - 10.1109/ACII.2015.7344609

DO - 10.1109/ACII.2015.7344609

M3 - Conference contribution

AN - SCOPUS:84964038419

SP - 449

EP - 455

BT - 2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015

Y2 - 21 September 2015 through 24 September 2015

ER -

Effects of a robotic storyteller's moody gestures on storytelling perception

Abstract

Conference

Keywords

Access to Document

Handle.net

Other files and links

Fingerprint

Cite this