A Conversational Agent that Reacts to Vocal Signals

D. Formolo; T. Bosse

doi:10.1007/978-3-319-49616-0

A Conversational Agent that Reacts to Vocal Signals

D. Formolo
, T. Bosse

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

Abstract

Conversational agents are increasingly being used for training of social skills. One of their most important benefits is their ability to provide natural interaction with humans. This work proposes to extend conversational agents’ benefits for social skills training by analysing the emotion conveyed by the user’s speech. For that, we developed a new system that captures emotions from human voice and, combined with the context of a particular situation, uses this to influence the internal state of the agent and change its behaviour. An example of the system’s use is shown and its limitations and advantages are discussed, together with the internal workflow of the system.

Original language	English
Title of host publication	Intelligent Technologies for Interactive Entertainment - 8th International Conference, INTETAIN 2016, Utrecht, The Netherlands, June 28-30, 2016, Revised Selected Papers
Editors	Ronald Poppe, John-Jules Meyer, Remco Veltkamp, Mehdi Dastani
Publisher	Springer Verlag
Pages	285-291
Number of pages	7
Volume	178
ISBN (Print)	978-3-319-49615-3
DOIs	https://doi.org/10.1007/978-3-319-49616-0
Publication status	Published - 2016
Event	8th International Conference on Intelligent Technologies for Interactive Entertainment, INTETAIN 2016 - Utrecht, Netherlands Duration: 28 Jun 2016 → 30 Jun 2016

Publication series

Name	Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
Publisher	Springer
Volume	178
ISSN (Print)	1867-8211

Conference

Conference	8th International Conference on Intelligent Technologies for Interactive Entertainment, INTETAIN 2016
Country/Territory	Netherlands
City	Utrecht
Period	28/06/16 → 30/06/16

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 4 Quality Education

Keywords

Emotions
Social skills training
Speech analysis
Virtual agents
Vocal signals

Access to Document

10.1007/978-3-319-49616-0

Persistent URL (handle)

Persistent link

Cite this

Formolo, D., & Bosse, T. (2016). A Conversational Agent that Reacts to Vocal Signals. In R. Poppe, J.-J. Meyer, R. Veltkamp, & M. Dastani (Eds.), Intelligent Technologies for Interactive Entertainment - 8th International Conference, INTETAIN 2016, Utrecht, The Netherlands, June 28-30, 2016, Revised Selected Papers (Vol. 178, pp. 285-291). (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering; Vol. 178). Springer Verlag. https://doi.org/10.1007/978-3-319-49616-0

Formolo, D. ; Bosse, T. / A Conversational Agent that Reacts to Vocal Signals. Intelligent Technologies for Interactive Entertainment - 8th International Conference, INTETAIN 2016, Utrecht, The Netherlands, June 28-30, 2016, Revised Selected Papers. editor / Ronald Poppe ; John-Jules Meyer ; Remco Veltkamp ; Mehdi Dastani. Vol. 178 Springer Verlag, 2016. pp. 285-291 (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering).

@inproceedings{f6e2fef7f5544c32b03a2eaae884f745,

title = "A Conversational Agent that Reacts to Vocal Signals",

abstract = "Conversational agents are increasingly being used for training of social skills. One of their most important benefits is their ability to provide natural interaction with humans. This work proposes to extend conversational agents{\textquoteright} benefits for social skills training by analysing the emotion conveyed by the user{\textquoteright}s speech. For that, we developed a new system that captures emotions from human voice and, combined with the context of a particular situation, uses this to influence the internal state of the agent and change its behaviour. An example of the system{\textquoteright}s use is shown and its limitations and advantages are discussed, together with the internal workflow of the system.",

keywords = "Emotions, Social skills training, Speech analysis, Virtual agents, Vocal signals",

author = "D. Formolo and T. Bosse",

year = "2016",

doi = "10.1007/978-3-319-49616-0",

language = "English",

isbn = "978-3-319-49615-3",

volume = "178",

series = "Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering",

publisher = "Springer Verlag",

pages = "285--291",

editor = "Ronald Poppe and John-Jules Meyer and Remco Veltkamp and Mehdi Dastani",

booktitle = "Intelligent Technologies for Interactive Entertainment - 8th International Conference, INTETAIN 2016, Utrecht, The Netherlands, June 28-30, 2016, Revised Selected Papers",

note = "8th International Conference on Intelligent Technologies for Interactive Entertainment, INTETAIN 2016 ; Conference date: 28-06-2016 Through 30-06-2016",

}

Formolo, D & Bosse, T 2016, A Conversational Agent that Reacts to Vocal Signals. in R Poppe, J-J Meyer, R Veltkamp & M Dastani (eds), Intelligent Technologies for Interactive Entertainment - 8th International Conference, INTETAIN 2016, Utrecht, The Netherlands, June 28-30, 2016, Revised Selected Papers. vol. 178, Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol. 178, Springer Verlag, pp. 285-291, 8th International Conference on Intelligent Technologies for Interactive Entertainment, INTETAIN 2016, Utrecht, Netherlands, 28/06/16. https://doi.org/10.1007/978-3-319-49616-0

A Conversational Agent that Reacts to Vocal Signals. / Formolo, D.; Bosse, T.
Intelligent Technologies for Interactive Entertainment - 8th International Conference, INTETAIN 2016, Utrecht, The Netherlands, June 28-30, 2016, Revised Selected Papers. ed. / Ronald Poppe; John-Jules Meyer; Remco Veltkamp; Mehdi Dastani. Vol. 178 Springer Verlag, 2016. p. 285-291 (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering; Vol. 178).

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - A Conversational Agent that Reacts to Vocal Signals

AU - Formolo, D.

AU - Bosse, T.

PY - 2016

Y1 - 2016

N2 - Conversational agents are increasingly being used for training of social skills. One of their most important benefits is their ability to provide natural interaction with humans. This work proposes to extend conversational agents’ benefits for social skills training by analysing the emotion conveyed by the user’s speech. For that, we developed a new system that captures emotions from human voice and, combined with the context of a particular situation, uses this to influence the internal state of the agent and change its behaviour. An example of the system’s use is shown and its limitations and advantages are discussed, together with the internal workflow of the system.

AB - Conversational agents are increasingly being used for training of social skills. One of their most important benefits is their ability to provide natural interaction with humans. This work proposes to extend conversational agents’ benefits for social skills training by analysing the emotion conveyed by the user’s speech. For that, we developed a new system that captures emotions from human voice and, combined with the context of a particular situation, uses this to influence the internal state of the agent and change its behaviour. An example of the system’s use is shown and its limitations and advantages are discussed, together with the internal workflow of the system.

KW - Emotions

KW - Social skills training

KW - Speech analysis

KW - Virtual agents

KW - Vocal signals

UR - https://www.scopus.com/pages/publications/85000785444

UR - https://www.scopus.com/pages/publications/85000785444#tab=citedBy

U2 - 10.1007/978-3-319-49616-0

DO - 10.1007/978-3-319-49616-0

M3 - Conference contribution

SN - 978-3-319-49615-3

VL - 178

T3 - Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

SP - 285

EP - 291

BT - Intelligent Technologies for Interactive Entertainment - 8th International Conference, INTETAIN 2016, Utrecht, The Netherlands, June 28-30, 2016, Revised Selected Papers

A2 - Poppe, Ronald

A2 - Meyer, John-Jules

A2 - Veltkamp, Remco

A2 - Dastani, Mehdi

PB - Springer Verlag

T2 - 8th International Conference on Intelligent Technologies for Interactive Entertainment, INTETAIN 2016

Y2 - 28 June 2016 through 30 June 2016

ER -

Formolo D, Bosse T. A Conversational Agent that Reacts to Vocal Signals. In Poppe R, Meyer JJ, Veltkamp R, Dastani M, editors, Intelligent Technologies for Interactive Entertainment - 8th International Conference, INTETAIN 2016, Utrecht, The Netherlands, June 28-30, 2016, Revised Selected Papers. Vol. 178. Springer Verlag. 2016. p. 285-291. (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering). doi: 10.1007/978-3-319-49616-0

A Conversational Agent that Reacts to Vocal Signals

Abstract

Publication series

Conference

UN SDGs

Keywords

Access to Document

Persistent URL (handle)

Other files and links

Fingerprint

Cite this