Leolani: A reference machine with a theory of mind for social communication

Piek Vossen*, Selene Baez, Lenka Bajc̆etić, Bram Kraaijeveld

*Corresponding author for this work

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

58 Downloads (Pure)

Abstract

Our state of mind is based on experiences and what other people tell us. This may result in conflicting information, uncertainty, and alternative facts. We present a robot that models relativity of knowledge and perception within social interaction following principles of the theory of mind. We utilized vision and speech capabilities on a Pepper robot to build an interaction model that stores the interpretations of perceptions and conversations in combination with provenance on its sources. The robot learns directly from what people tell it, possibly in relation to its perception. We demonstrate how the robot’s communication is driven by hunger to acquire more knowledge from and on people and objects, to resolve uncertainties and conflicts, and to share awareness of the perceived environment. Likewise, the robot can make reference to the world and its knowledge about the world and the encounters with people that yielded this knowledge.

Original languageEnglish
Title of host publicationText, Speech, and Dialogue
Subtitle of host publication21st International Conference, TSD 2018, Brno, Czech Republic, September 11-14, 2018, Proceedings
EditorsPetr Sojka, Aleš Horák, Ivan Kopecek, Karel Pala
PublisherSpringer/Verlag
Pages15-25
Number of pages11
ISBN (Electronic)9783030007942
ISBN (Print)9783030007935
DOIs
Publication statusPublished - 2018
Event21st International Conference on Text, Speech, and Dialogue, TSD 2018 - Brno, Czech Republic
Duration: 11 Sept 201814 Sept 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11107 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference21st International Conference on Text, Speech, and Dialogue, TSD 2018
Country/TerritoryCzech Republic
CityBrno
Period11/09/1814/09/18

Funding

Acknowledgement. This research was funded by the VU University Amsterdam and the Netherlands Organization for Scientific Research via the Spinoza grant awarded to Piek Vossen. We also thank Bob van der Graft for his support.

FundersFunder number
Netherlands Organization for Scientific Research
Vrije Universiteit Amsterdam

    Keywords

    • Communication
    • Robot
    • Social learning
    • Theory of mind

    Fingerprint

    Dive into the research topics of 'Leolani: A reference machine with a theory of mind for social communication'. Together they form a unique fingerprint.

    Cite this