The Video Engagement Scale (VES): measurement properties of the full and shortened VES across studies

Vicky Lehmann; Marij A. Hillen; Mathilde G.E. Verdam; Arwen H. Pieterse; Nanon H.M. Labrie; Agnetha D. Fruijtier; Tom H. Oreel; Ellen M.A. Smets; Leonie N.C. Visser

doi:10.1080/13645579.2022.2052697

The Video Engagement Scale (VES): measurement properties of the full and shortened VES across studies

Vicky Lehmann
, Marij A. Hillen
, Mathilde G.E. Verdam
, Arwen H. Pieterse
, Nanon H.M. Labrie
, Agnetha D. Fruijtier
, Tom H. Oreel
, Ellen M.A. Smets^*
, Leonie N.C. Visser

^*Corresponding author for this work

Research output: Contribution to Journal › Article › Academic › peer-review

Abstract

The Video Engagement Scale (VES) is a quality indicator to assess engagement in experimental video-vignette studies, but its measurement properties warrant improvement. Data from previous studies were combined (N = 2676) and split into three subsamples for a stepped analytical approach. We tested construct validity, criterion validity, reliability, and measurement invariance. Confirmatory factor analysis (CFA) reiterated poor fit of the previously suggested subscales. An alternative 2-factor structure is presented, which was cross-validated and further shortened (VES-sf). Reliability of both subscales (Immersion, Emotional Impact) was very high (α > .86). Multi-group CFAs demonstrated partial and complete measurement invariance among male/female and differently educated participants respectively. Invariance between healthy versus ill participants was not established, but CFAs supported the VES-sf structure in both groups separately. To conclude, we provide the VES-sf with sound measurement properties and demonstrated the appropriateness of comparing certain subgroups. Overall, we recommend the VES-sf to assess engagement/ecological validity in video-vignette research.

Original language	English
Pages (from-to)	305-318
Number of pages	14
Journal	International Journal of Social Research Methodology
Volume	26
Issue number	3
Early online date	21 Mar 2022
DOIs	https://doi.org/10.1080/13645579.2022.2052697
Publication status	Published - 2023

Bibliographical note

Publisher Copyright:
© 2022 Informa UK Limited, trading as Taylor & Francis Group.

Funding

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors to complete the project.

Keywords

experimental study design
Measurement properties
validity
video engagement
video-vignette

Access to Document

10.1080/13645579.2022.2052697

Persistent URL (handle)

Persistent link

Cite this

Lehmann, V., Hillen, M. A., Verdam, M. G. E., Pieterse, A. H., Labrie, N. H. M., Fruijtier, A. D., Oreel, T. H., Smets, E. M. A., & Visser, L. N. C. (2023). The Video Engagement Scale (VES): measurement properties of the full and shortened VES across studies. International Journal of Social Research Methodology, 26(3), 305-318. https://doi.org/10.1080/13645579.2022.2052697

@article{49ff5c59d0be4b65932745aefbb7b7d0,

title = "The Video Engagement Scale (VES): measurement properties of the full and shortened VES across studies",

abstract = "The Video Engagement Scale (VES) is a quality indicator to assess engagement in experimental video-vignette studies, but its measurement properties warrant improvement. Data from previous studies were combined (N = 2676) and split into three subsamples for a stepped analytical approach. We tested construct validity, criterion validity, reliability, and measurement invariance. Confirmatory factor analysis (CFA) reiterated poor fit of the previously suggested subscales. An alternative 2-factor structure is presented, which was cross-validated and further shortened (VES-sf). Reliability of both subscales (Immersion, Emotional Impact) was very high (α > .86). Multi-group CFAs demonstrated partial and complete measurement invariance among male/female and differently educated participants respectively. Invariance between healthy versus ill participants was not established, but CFAs supported the VES-sf structure in both groups separately. To conclude, we provide the VES-sf with sound measurement properties and demonstrated the appropriateness of comparing certain subgroups. Overall, we recommend the VES-sf to assess engagement/ecological validity in video-vignette research.",

keywords = "experimental study design, Measurement properties, validity, video engagement, video-vignette",

author = "Vicky Lehmann and Hillen, \{Marij A.\} and Verdam, \{Mathilde G.E.\} and Pieterse, \{Arwen H.\} and Labrie, \{Nanon H.M.\} and Fruijtier, \{Agnetha D.\} and Oreel, \{Tom H.\} and Smets, \{Ellen M.A.\} and Visser, \{Leonie N.C.\}",

note = "Publisher Copyright: {\textcopyright} 2022 Informa UK Limited, trading as Taylor \& Francis Group.",

year = "2023",

doi = "10.1080/13645579.2022.2052697",

language = "English",

volume = "26",

pages = "305--318",

journal = "International Journal of Social Research Methodology",

issn = "1364-5579",

publisher = "Taylor and Francis Ltd.",

number = "3",

}

TY - JOUR

T1 - The Video Engagement Scale (VES)

T2 - measurement properties of the full and shortened VES across studies

AU - Lehmann, Vicky

AU - Hillen, Marij A.

AU - Verdam, Mathilde G.E.

AU - Pieterse, Arwen H.

AU - Labrie, Nanon H.M.

AU - Fruijtier, Agnetha D.

AU - Oreel, Tom H.

AU - Smets, Ellen M.A.

AU - Visser, Leonie N.C.

PY - 2023

Y1 - 2023

N2 - The Video Engagement Scale (VES) is a quality indicator to assess engagement in experimental video-vignette studies, but its measurement properties warrant improvement. Data from previous studies were combined (N = 2676) and split into three subsamples for a stepped analytical approach. We tested construct validity, criterion validity, reliability, and measurement invariance. Confirmatory factor analysis (CFA) reiterated poor fit of the previously suggested subscales. An alternative 2-factor structure is presented, which was cross-validated and further shortened (VES-sf). Reliability of both subscales (Immersion, Emotional Impact) was very high (α > .86). Multi-group CFAs demonstrated partial and complete measurement invariance among male/female and differently educated participants respectively. Invariance between healthy versus ill participants was not established, but CFAs supported the VES-sf structure in both groups separately. To conclude, we provide the VES-sf with sound measurement properties and demonstrated the appropriateness of comparing certain subgroups. Overall, we recommend the VES-sf to assess engagement/ecological validity in video-vignette research.

AB - The Video Engagement Scale (VES) is a quality indicator to assess engagement in experimental video-vignette studies, but its measurement properties warrant improvement. Data from previous studies were combined (N = 2676) and split into three subsamples for a stepped analytical approach. We tested construct validity, criterion validity, reliability, and measurement invariance. Confirmatory factor analysis (CFA) reiterated poor fit of the previously suggested subscales. An alternative 2-factor structure is presented, which was cross-validated and further shortened (VES-sf). Reliability of both subscales (Immersion, Emotional Impact) was very high (α > .86). Multi-group CFAs demonstrated partial and complete measurement invariance among male/female and differently educated participants respectively. Invariance between healthy versus ill participants was not established, but CFAs supported the VES-sf structure in both groups separately. To conclude, we provide the VES-sf with sound measurement properties and demonstrated the appropriateness of comparing certain subgroups. Overall, we recommend the VES-sf to assess engagement/ecological validity in video-vignette research.

KW - experimental study design

KW - Measurement properties

KW - validity

KW - video engagement

KW - video-vignette

UR - https://www.scopus.com/pages/publications/85126784710

UR - https://www.scopus.com/pages/publications/85126784710#tab=citedBy

U2 - 10.1080/13645579.2022.2052697

DO - 10.1080/13645579.2022.2052697

M3 - Article

AN - SCOPUS:85126784710

SN - 1364-5579

VL - 26

SP - 305

EP - 318

JO - International Journal of Social Research Methodology

JF - International Journal of Social Research Methodology

IS - 3

ER -

The Video Engagement Scale (VES): measurement properties of the full and shortened VES across studies

Abstract

Bibliographical note

Funding

Keywords

Access to Document

Persistent URL (handle)

Other files and links

Fingerprint

Cite this