Assessing the Degree of Ecological Validity of Your Study: Introducing the Multidimensional Assessment of Research in Context (MARC) Tool

Sandra Naumann, Michelle L. Byrne, Alethia de la Fuente, Anita Harrewijn, Tehila Nugiel, Maya Rosen, Nienke van Atteveldt, Pawel J. Matusz*

*Corresponding author for this work

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

In cognitive neurosciences, fundamental principles of mental processes and functional brain organization have been established with highly controlled tasks and testing environments. Recent technical advances allowed the investigation of these functions and their brain mechanisms in naturalistic settings. The diversity in those approaches have been recently (Matusz, P. J., Dikker, S., Huth, A. G., & Perrodin, C. (2019). Are we ready for real-world neuroscience? Journal of Cognitive Neuroscience, 31(3), 327–338. doi:10.1162/jocn_e_01276) classified via a three-category cycle, including controlled laboratory, partially naturalistic laboratory, and naturalistic real-world research. Based on this model, we developed the Multidimensional Assessment of Research in Context (MARC) tool to easily delineate the approach researchers have taken in their study. MARC provides means to describe the degree of ecological validity for each component of a study (e.g., sample, stimuli, measures, etc.), and the study's location on the cycle. The tool comprises seven questions concerning a study's characteristics. It outputs a summary of those and a compass plot, which can be used for presentations, preregistration, grant proposals, and papers. It aims to improve drawing conclusions across studies and raise awareness about the generalizability of research findings.

Original languageEnglish
Pages (from-to)228-238
Number of pages11
JournalMind, Brain, and Education
Volume16
Issue number3
Early online date18 Mar 2022
DOIs
Publication statusPublished - Aug 2022

Bibliographical note

Funding Information:
This work was the result of the 2019 Flux Society Annual Meeting's Pre-Conference workshop “Beyond the lab: Translating developmental neuroscience” organized by Lucia Magis Weinberg, & Natasha Duell & Jennifer Pfeifer, funded by HopeLab, Bezos Family Foundation & Center for Translational Neuroscience (University of Oregon). This work was supported by the Swiss National Science Foundation grant (no. PZ00P1_174150). We thank Isabel Dziobek for her extensive comments on the original version of this manuscript. Open access funding provided by Haute Ecole Specialisee de la Suisse Occidentale. The authors have stated explicitly that there are no conflicts of interest in connection with this article.

Publisher Copyright:
© 2022 The Authors. Mind, Brain, and Education published by International Mind, Brain, and Education Society and Wiley Periodicals LLC.

Fingerprint

Dive into the research topics of 'Assessing the Degree of Ecological Validity of Your Study: Introducing the Multidimensional Assessment of Research in Context (MARC) Tool'. Together they form a unique fingerprint.

Cite this