A Conversational Agent that Reacts to Vocal Signals

D. Formolo, T. Bosse

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

Abstract

Conversational agents are increasingly being used for training of social skills. One of their most important benefits is their ability to provide natural interaction with humans. This work proposes to extend conversational agents’ benefits for social skills training by analysing the emotion conveyed by the user’s speech. For that, we developed a new system that captures emotions from human voice and, combined with the context of a particular situation, uses this to influence the internal state of the agent and change its behaviour. An example of the system’s use is shown and its limitations and advantages are discussed, together with the internal workflow of the system.
Original languageEnglish
Title of host publicationIntelligent Technologies for Interactive Entertainment - 8th International Conference, INTETAIN 2016, Utrecht, The Netherlands, June 28-30, 2016, Revised Selected Papers
EditorsRonald Poppe, John-Jules Meyer, Remco Veltkamp, Mehdi Dastani
PublisherSpringer Verlag
Pages285-291
Number of pages7
Volume178
ISBN (Print)978-3-319-49615-3
DOIs
Publication statusPublished - 2016
Event8th International Conference on Intelligent Technologies for Interactive Entertainment, INTETAIN 2016 - Utrecht, Netherlands
Duration: 28 Jun 201630 Jun 2016

Publication series

NameLecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
PublisherSpringer
Volume178
ISSN (Print)1867-8211

Conference

Conference8th International Conference on Intelligent Technologies for Interactive Entertainment, INTETAIN 2016
CountryNetherlands
CityUtrecht
Period28/06/1630/06/16

Keywords

  • Emotions
  • Social skills training
  • Speech analysis
  • Virtual agents
  • Vocal signals

Cite this