TY - JOUR
T1 - The effect of horizontal eye movements on free recall
T2 - A preregistered adversarial collaboration
AU - Matzke, Dora
AU - Nieuwenhuis, Sander
AU - van Rijn, Hedderik
AU - Slagter, Heleen A.
AU - van der Molen, Maurits W.
AU - Wagenmakers, J.
PY - 2015/1/1
Y1 - 2015/1/1
N2 - A growing body of research has suggested that horizontal saccadic eye movements facilitate the retrieval of episodic memories in free recall and recognition memory tasks. Nevertheless, a minority of studies have failed to replicate this effect. This article attempts to resolve the inconsistent results by introducing a novel variant of proponent-skeptic collaboration. The proposed approach combines the features of adversarial collaboration and purely confirmatory preregistered research. Prior to data collection, the adversaries reached consensus on an optimal research design, formulated their expectations, and agreed to submit the findings to an academic journal regardless of the outcome. To increase transparency and secure the purely confirmatory nature of the investigation, the 2 parties set up a publicly available adversarial collaboration agreement that detailed the proposed design and all foreseeable aspects of the data analysis. As anticipated by the skeptics, a series of Bayesian hypothesis tests indicated that horizontal eye movements did not improve free recall performance. The skeptics suggested that the nonreplication may partly reflect the use of suboptimal and questionable research practices in earlier eye movement studies. The proponents countered this suggestion and used a p curve analysis to argue that the effect of horizontal eye movements on explicit memory did not merely reflect selective reporting.
AB - A growing body of research has suggested that horizontal saccadic eye movements facilitate the retrieval of episodic memories in free recall and recognition memory tasks. Nevertheless, a minority of studies have failed to replicate this effect. This article attempts to resolve the inconsistent results by introducing a novel variant of proponent-skeptic collaboration. The proposed approach combines the features of adversarial collaboration and purely confirmatory preregistered research. Prior to data collection, the adversaries reached consensus on an optimal research design, formulated their expectations, and agreed to submit the findings to an academic journal regardless of the outcome. To increase transparency and secure the purely confirmatory nature of the investigation, the 2 parties set up a publicly available adversarial collaboration agreement that detailed the proposed design and all foreseeable aspects of the data analysis. As anticipated by the skeptics, a series of Bayesian hypothesis tests indicated that horizontal eye movements did not improve free recall performance. The skeptics suggested that the nonreplication may partly reflect the use of suboptimal and questionable research practices in earlier eye movement studies. The proponents countered this suggestion and used a p curve analysis to argue that the effect of horizontal eye movements on explicit memory did not merely reflect selective reporting.
KW - Adversarial collaboration
KW - Bayes factor
KW - Horizontal eye movements
KW - Preregistration
KW - Replication
UR - http://www.scopus.com/inward/record.url?scp=84925666673&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84925666673&partnerID=8YFLogxK
U2 - 10.1037/xge0000038
DO - 10.1037/xge0000038
M3 - Article
C2 - 25621378
AN - SCOPUS:84925666673
SN - 0096-3445
VL - 144
SP - e1-e15
JO - Journal of Experimental Psychology: General
JF - Journal of Experimental Psychology: General
IS - 1
ER -