Leolani: A reference machine with a theory of mind for social communication

Piek Vossen, Selene Baez, Lenka Bajc̆etić, Bram Kraaijeveld

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

Abstract

Our state of mind is based on experiences and what other people tell us. This may result in conflicting information, uncertainty, and alternative facts. We present a robot that models relativity of knowledge and perception within social interaction following principles of the theory of mind. We utilized vision and speech capabilities on a Pepper robot to build an interaction model that stores the interpretations of perceptions and conversations in combination with provenance on its sources. The robot learns directly from what people tell it, possibly in relation to its perception. We demonstrate how the robot’s communication is driven by hunger to acquire more knowledge from and on people and objects, to resolve uncertainties and conflicts, and to share awareness of the perceived environment. Likewise, the robot can make reference to the world and its knowledge about the world and the encounters with people that yielded this knowledge.

LanguageEnglish
Title of host publicationText, Speech, and Dialogue
Subtitle of host publication21st International Conference, TSD 2018, Proceedings
EditorsPetr Sojka, Aleš Horák, Ivan Kopecek, Karel Pala
PublisherSpringer/Verlag
Pages15-25
Number of pages11
ISBN (Electronic)9783030007942
ISBN (Print)9783030007935
DOIs
StatePublished - 2018
Event21st International Conference on Text, Speech, and Dialogue, TSD 2018 - Brno, Czech Republic
Duration: 11 Sep 201814 Sep 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11107 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference21st International Conference on Text, Speech, and Dialogue, TSD 2018
CountryCzech Republic
CityBrno
Period11/09/1814/09/18

Fingerprint

Robot
Robots
Communication
Uncertainty
Relativity
Provenance
Social Interaction
Resolve
Knowledge
Alternatives
Interaction
Model
Demonstrate
Perception

Keywords

  • Communication
  • Robot
  • Social learning
  • Theory of mind

Cite this

Vossen, P., Baez, S., Bajc̆etić, L., & Kraaijeveld, B. (2018). Leolani: A reference machine with a theory of mind for social communication. In P. Sojka, A. Horák, I. Kopecek, & K. Pala (Eds.), Text, Speech, and Dialogue: 21st International Conference, TSD 2018, Proceedings (pp. 15-25). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11107 LNAI). Springer/Verlag. DOI: 10.1007/978-3-030-00794-2_2
Vossen, Piek ; Baez, Selene ; Bajc̆etić, Lenka ; Kraaijeveld, Bram. / Leolani : A reference machine with a theory of mind for social communication. Text, Speech, and Dialogue: 21st International Conference, TSD 2018, Proceedings. editor / Petr Sojka ; Aleš Horák ; Ivan Kopecek ; Karel Pala. Springer/Verlag, 2018. pp. 15-25 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{a7bc1fe0574945339a31442b0dbe8920,
title = "Leolani: A reference machine with a theory of mind for social communication",
abstract = "Our state of mind is based on experiences and what other people tell us. This may result in conflicting information, uncertainty, and alternative facts. We present a robot that models relativity of knowledge and perception within social interaction following principles of the theory of mind. We utilized vision and speech capabilities on a Pepper robot to build an interaction model that stores the interpretations of perceptions and conversations in combination with provenance on its sources. The robot learns directly from what people tell it, possibly in relation to its perception. We demonstrate how the robot’s communication is driven by hunger to acquire more knowledge from and on people and objects, to resolve uncertainties and conflicts, and to share awareness of the perceived environment. Likewise, the robot can make reference to the world and its knowledge about the world and the encounters with people that yielded this knowledge.",
keywords = "Communication, Robot, Social learning, Theory of mind",
author = "Piek Vossen and Selene Baez and Lenka Bajc̆etić and Bram Kraaijeveld",
year = "2018",
doi = "10.1007/978-3-030-00794-2_2",
language = "English",
isbn = "9783030007935",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer/Verlag",
pages = "15--25",
editor = "Petr Sojka and Aleš Hor{\'a}k and Ivan Kopecek and Karel Pala",
booktitle = "Text, Speech, and Dialogue",

}

Vossen, P, Baez, S, Bajc̆etić, L & Kraaijeveld, B 2018, Leolani: A reference machine with a theory of mind for social communication. in P Sojka, A Horák, I Kopecek & K Pala (eds), Text, Speech, and Dialogue: 21st International Conference, TSD 2018, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11107 LNAI, Springer/Verlag, pp. 15-25, 21st International Conference on Text, Speech, and Dialogue, TSD 2018, Brno, Czech Republic, 11/09/18. DOI: 10.1007/978-3-030-00794-2_2

Leolani : A reference machine with a theory of mind for social communication. / Vossen, Piek; Baez, Selene; Bajc̆etić, Lenka; Kraaijeveld, Bram.

Text, Speech, and Dialogue: 21st International Conference, TSD 2018, Proceedings. ed. / Petr Sojka; Aleš Horák; Ivan Kopecek; Karel Pala. Springer/Verlag, 2018. p. 15-25 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11107 LNAI).

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - Leolani

T2 - A reference machine with a theory of mind for social communication

AU - Vossen,Piek

AU - Baez,Selene

AU - Bajc̆etić,Lenka

AU - Kraaijeveld,Bram

PY - 2018

Y1 - 2018

N2 - Our state of mind is based on experiences and what other people tell us. This may result in conflicting information, uncertainty, and alternative facts. We present a robot that models relativity of knowledge and perception within social interaction following principles of the theory of mind. We utilized vision and speech capabilities on a Pepper robot to build an interaction model that stores the interpretations of perceptions and conversations in combination with provenance on its sources. The robot learns directly from what people tell it, possibly in relation to its perception. We demonstrate how the robot’s communication is driven by hunger to acquire more knowledge from and on people and objects, to resolve uncertainties and conflicts, and to share awareness of the perceived environment. Likewise, the robot can make reference to the world and its knowledge about the world and the encounters with people that yielded this knowledge.

AB - Our state of mind is based on experiences and what other people tell us. This may result in conflicting information, uncertainty, and alternative facts. We present a robot that models relativity of knowledge and perception within social interaction following principles of the theory of mind. We utilized vision and speech capabilities on a Pepper robot to build an interaction model that stores the interpretations of perceptions and conversations in combination with provenance on its sources. The robot learns directly from what people tell it, possibly in relation to its perception. We demonstrate how the robot’s communication is driven by hunger to acquire more knowledge from and on people and objects, to resolve uncertainties and conflicts, and to share awareness of the perceived environment. Likewise, the robot can make reference to the world and its knowledge about the world and the encounters with people that yielded this knowledge.

KW - Communication

KW - Robot

KW - Social learning

KW - Theory of mind

UR - http://www.scopus.com/inward/record.url?scp=85053936325&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85053936325&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-00794-2_2

DO - 10.1007/978-3-030-00794-2_2

M3 - Conference contribution

SN - 9783030007935

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 15

EP - 25

BT - Text, Speech, and Dialogue

PB - Springer/Verlag

ER -

Vossen P, Baez S, Bajc̆etić L, Kraaijeveld B. Leolani: A reference machine with a theory of mind for social communication. In Sojka P, Horák A, Kopecek I, Pala K, editors, Text, Speech, and Dialogue: 21st International Conference, TSD 2018, Proceedings. Springer/Verlag. 2018. p. 15-25. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). Available from, DOI: 10.1007/978-3-030-00794-2_2