A Cognitive and Neural Model for Adaptive Emotion Reading by Mirroring Preparation States and Hebbian Learning

T. Bosse, Z.A. Memon, J. Treur

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

Two types of modelling approaches exist to reading an observed person's emotions: with or without making use of the observing person's own emotions. This paper focuses on an integrated approach that combines both types of approaches in an adaptive manner. The proposed models were inspired by recent advances in neurological context. Both a neural model and a more abstracted cognitive model are presented. In the first place emotion reading is modelled involving (preparatory) mirroring of body states of the observed person within the observing person. This involves a recursive body loop: a converging positive feedback loop based on reciprocal causation between preparations for body states and emotions felt. Here emotion reading involves the person's own body states and emotions in reading somebody else's emotions: first the same feeling is developed by mirroring, and after feeling the emotion, it is imputed to the other person. In the second place, as an extension an adaptive process is modelled based on Hebbian learning of a direct connection between a sensed stimulus concerning another agent's body state (e.g., face expression) and an emotion imputation state. After this Hebbian learning process the emotion is imputed to the other agent before it is actually felt, or even without it is felt. Both the mirroring and Hebbian learning processes first have been modelled at a neural level, and next, in a more abstracted form at a cognitive level. By means of an interpretation mapping the paper shows the relation between the obtained cognitive model and the neurological model. In addition to specifications of both models and the interpretation mapping, simulation results are shown, and automated verification of relevant emerging properties is discussed. © 2010 Elsevier B.V.
LanguageEnglish
Pages39-58
Number of pages20
JournalCognitive Systems Research
Volume13
Issue number1
DOIs
Publication statusPublished - 2012

Fingerprint

Reading
Emotions
Learning
Neurological Models
Specifications
Feedback
Causality

Cite this

@article{1b58089fcc3c4aa9b3b72b5afb981304,
title = "A Cognitive and Neural Model for Adaptive Emotion Reading by Mirroring Preparation States and Hebbian Learning",
abstract = "Two types of modelling approaches exist to reading an observed person's emotions: with or without making use of the observing person's own emotions. This paper focuses on an integrated approach that combines both types of approaches in an adaptive manner. The proposed models were inspired by recent advances in neurological context. Both a neural model and a more abstracted cognitive model are presented. In the first place emotion reading is modelled involving (preparatory) mirroring of body states of the observed person within the observing person. This involves a recursive body loop: a converging positive feedback loop based on reciprocal causation between preparations for body states and emotions felt. Here emotion reading involves the person's own body states and emotions in reading somebody else's emotions: first the same feeling is developed by mirroring, and after feeling the emotion, it is imputed to the other person. In the second place, as an extension an adaptive process is modelled based on Hebbian learning of a direct connection between a sensed stimulus concerning another agent's body state (e.g., face expression) and an emotion imputation state. After this Hebbian learning process the emotion is imputed to the other agent before it is actually felt, or even without it is felt. Both the mirroring and Hebbian learning processes first have been modelled at a neural level, and next, in a more abstracted form at a cognitive level. By means of an interpretation mapping the paper shows the relation between the obtained cognitive model and the neurological model. In addition to specifications of both models and the interpretation mapping, simulation results are shown, and automated verification of relevant emerging properties is discussed. {\circledC} 2010 Elsevier B.V.",
author = "T. Bosse and Z.A. Memon and J. Treur",
year = "2012",
doi = "10.1016/j.cogsys.2010.10.003",
language = "English",
volume = "13",
pages = "39--58",
journal = "Cognitive Systems Research",
issn = "1389-0417",
publisher = "Elsevier",
number = "1",

}

A Cognitive and Neural Model for Adaptive Emotion Reading by Mirroring Preparation States and Hebbian Learning. / Bosse, T.; Memon, Z.A.; Treur, J.

In: Cognitive Systems Research, Vol. 13, No. 1, 2012, p. 39-58.

Research output: Contribution to JournalArticleAcademicpeer-review

TY - JOUR

T1 - A Cognitive and Neural Model for Adaptive Emotion Reading by Mirroring Preparation States and Hebbian Learning

AU - Bosse, T.

AU - Memon, Z.A.

AU - Treur, J.

PY - 2012

Y1 - 2012

N2 - Two types of modelling approaches exist to reading an observed person's emotions: with or without making use of the observing person's own emotions. This paper focuses on an integrated approach that combines both types of approaches in an adaptive manner. The proposed models were inspired by recent advances in neurological context. Both a neural model and a more abstracted cognitive model are presented. In the first place emotion reading is modelled involving (preparatory) mirroring of body states of the observed person within the observing person. This involves a recursive body loop: a converging positive feedback loop based on reciprocal causation between preparations for body states and emotions felt. Here emotion reading involves the person's own body states and emotions in reading somebody else's emotions: first the same feeling is developed by mirroring, and after feeling the emotion, it is imputed to the other person. In the second place, as an extension an adaptive process is modelled based on Hebbian learning of a direct connection between a sensed stimulus concerning another agent's body state (e.g., face expression) and an emotion imputation state. After this Hebbian learning process the emotion is imputed to the other agent before it is actually felt, or even without it is felt. Both the mirroring and Hebbian learning processes first have been modelled at a neural level, and next, in a more abstracted form at a cognitive level. By means of an interpretation mapping the paper shows the relation between the obtained cognitive model and the neurological model. In addition to specifications of both models and the interpretation mapping, simulation results are shown, and automated verification of relevant emerging properties is discussed. © 2010 Elsevier B.V.

AB - Two types of modelling approaches exist to reading an observed person's emotions: with or without making use of the observing person's own emotions. This paper focuses on an integrated approach that combines both types of approaches in an adaptive manner. The proposed models were inspired by recent advances in neurological context. Both a neural model and a more abstracted cognitive model are presented. In the first place emotion reading is modelled involving (preparatory) mirroring of body states of the observed person within the observing person. This involves a recursive body loop: a converging positive feedback loop based on reciprocal causation between preparations for body states and emotions felt. Here emotion reading involves the person's own body states and emotions in reading somebody else's emotions: first the same feeling is developed by mirroring, and after feeling the emotion, it is imputed to the other person. In the second place, as an extension an adaptive process is modelled based on Hebbian learning of a direct connection between a sensed stimulus concerning another agent's body state (e.g., face expression) and an emotion imputation state. After this Hebbian learning process the emotion is imputed to the other agent before it is actually felt, or even without it is felt. Both the mirroring and Hebbian learning processes first have been modelled at a neural level, and next, in a more abstracted form at a cognitive level. By means of an interpretation mapping the paper shows the relation between the obtained cognitive model and the neurological model. In addition to specifications of both models and the interpretation mapping, simulation results are shown, and automated verification of relevant emerging properties is discussed. © 2010 Elsevier B.V.

U2 - 10.1016/j.cogsys.2010.10.003

DO - 10.1016/j.cogsys.2010.10.003

M3 - Article

VL - 13

SP - 39

EP - 58

JO - Cognitive Systems Research

T2 - Cognitive Systems Research

JF - Cognitive Systems Research

SN - 1389-0417

IS - 1

ER -