Contactless approach for heart rate estimation for QoE assessment

Mattia Bonomi; Federica Battisti; Giulia Boato; Miguel Barreda-Ángeles; M. Carli; Patrick Le Callet

doi:10.1016/j.image.2019.07.004

Contactless approach for heart rate estimation for QoE assessment

Mattia Bonomi^*, Federica Battisti, Giulia Boato, Miguel Barreda-Ángeles, M. Carli, Patrick Le Callet

^*Corresponding author for this work

Research output: Contribution to Journal › Article › Academic › peer-review

Abstract

Quality of Experience of multimedia content is investigated to understand the overall acceptability of the content as perceived by the end user. Recent perspectives stress the need to focus not only on perceptual aspects of the content but also on the interaction between perception and cognitive–emotional aspects. Our contribution lies on this direction by presenting a contactless approach to estimate heart rate variability by evaluating face skin color variations in a video sequence. The proposed framework allows to analyze long video sequences depicting a subject and it is robust with respect to small movements and illumination changes. The system is validated on a dataset of 64 sequences where users observe 3D movies selected to induce heart rate variations.

Original language	English
Pages (from-to)	223-235
Number of pages	13
Journal	Signal Processing: Image Communication
Volume	78
DOIs	https://doi.org/10.1016/j.image.2019.07.004
Publication status	Published - 1 Oct 2019
Externally published	Yes

Keywords

3D video
Heart rate estimation
Heart rate variability
Quality of experience

Access to Document

10.1016/j.image.2019.07.004

Fingerprint Dive into the research topics of 'Contactless approach for heart rate estimation for QoE assessment'. Together they form a unique fingerprint.

Cite this

Bonomi, M., Battisti, F., Boato, G., Barreda-Ángeles, M., Carli, M., & Le Callet, P. (2019). Contactless approach for heart rate estimation for QoE assessment. Signal Processing: Image Communication, 78, 223-235. https://doi.org/10.1016/j.image.2019.07.004

@article{a620e29835634784b3807e3efbfb066e,

title = "Contactless approach for heart rate estimation for QoE assessment",

abstract = "Quality of Experience of multimedia content is investigated to understand the overall acceptability of the content as perceived by the end user. Recent perspectives stress the need to focus not only on perceptual aspects of the content but also on the interaction between perception and cognitive–emotional aspects. Our contribution lies on this direction by presenting a contactless approach to estimate heart rate variability by evaluating face skin color variations in a video sequence. The proposed framework allows to analyze long video sequences depicting a subject and it is robust with respect to small movements and illumination changes. The system is validated on a dataset of 64 sequences where users observe 3D movies selected to induce heart rate variations.",

keywords = "3D video, Heart rate estimation, Heart rate variability, Quality of experience",

author = "Mattia Bonomi and Federica Battisti and Giulia Boato and Miguel Barreda-{\'A}ngeles and M. Carli and {Le Callet}, Patrick",

year = "2019",

month = "10",

day = "1",

doi = "10.1016/j.image.2019.07.004",

language = "English",

volume = "78",

pages = "223--235",

journal = "Signal Processing: Image Communication",

issn = "0923-5965",

publisher = "Elsevier",

}

TY - JOUR

T1 - Contactless approach for heart rate estimation for QoE assessment

AU - Bonomi, Mattia

AU - Battisti, Federica

AU - Boato, Giulia

AU - Barreda-Ángeles, Miguel

AU - Carli, M.

AU - Le Callet, Patrick

PY - 2019/10/1

Y1 - 2019/10/1

N2 - Quality of Experience of multimedia content is investigated to understand the overall acceptability of the content as perceived by the end user. Recent perspectives stress the need to focus not only on perceptual aspects of the content but also on the interaction between perception and cognitive–emotional aspects. Our contribution lies on this direction by presenting a contactless approach to estimate heart rate variability by evaluating face skin color variations in a video sequence. The proposed framework allows to analyze long video sequences depicting a subject and it is robust with respect to small movements and illumination changes. The system is validated on a dataset of 64 sequences where users observe 3D movies selected to induce heart rate variations.

AB - Quality of Experience of multimedia content is investigated to understand the overall acceptability of the content as perceived by the end user. Recent perspectives stress the need to focus not only on perceptual aspects of the content but also on the interaction between perception and cognitive–emotional aspects. Our contribution lies on this direction by presenting a contactless approach to estimate heart rate variability by evaluating face skin color variations in a video sequence. The proposed framework allows to analyze long video sequences depicting a subject and it is robust with respect to small movements and illumination changes. The system is validated on a dataset of 64 sequences where users observe 3D movies selected to induce heart rate variations.

KW - 3D video

KW - Heart rate estimation

KW - Heart rate variability

KW - Quality of experience

UR - http://www.scopus.com/inward/record.url?scp=85069590397&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85069590397&partnerID=8YFLogxK

U2 - 10.1016/j.image.2019.07.004

DO - 10.1016/j.image.2019.07.004

M3 - Article

AN - SCOPUS:85069590397

VL - 78

SP - 223

EP - 235

JO - Signal Processing: Image Communication

JF - Signal Processing: Image Communication

SN - 0923-5965

ER -