TY - JOUR
T1 - Methodological and reporting errors in meta-analytic reviews make other meta-analysts angry: A commentary on Ferguson
AU - Rothstein, H.R.
AU - Bushman, B.J.
PY - 2015
Y1 - 2015
N2 - Although Ferguson’s (2015, this issue) meta-analysis addresses an important topic, we have serious concerns about how it was conducted. Because there was only one coder, we have no confidence in the reliability or validity of the coded variables. Two independent raters should have coded the studies. Ferguson synthesized partial correlations as if they were zero-order correlations, which can increase or decrease (sometimes substantially) the variance of the partial correlation. Moreover, he partialled different numbers of variables from different effects, partialled different variables from different studies, and did not report what was partialled from each study. Ferguson used an idiosyncratic “tandem procedure” for detecting publication bias. He also “corrected” his results for publication bias, even though there is no such thing as a “correction” for publication bias. Thus, we believe that Ferguson’s meta-analysis is fatally flawed and should not have been accepted for publication in Perspective on Psychological Science (or any other journal).
AB - Although Ferguson’s (2015, this issue) meta-analysis addresses an important topic, we have serious concerns about how it was conducted. Because there was only one coder, we have no confidence in the reliability or validity of the coded variables. Two independent raters should have coded the studies. Ferguson synthesized partial correlations as if they were zero-order correlations, which can increase or decrease (sometimes substantially) the variance of the partial correlation. Moreover, he partialled different numbers of variables from different effects, partialled different variables from different studies, and did not report what was partialled from each study. Ferguson used an idiosyncratic “tandem procedure” for detecting publication bias. He also “corrected” his results for publication bias, even though there is no such thing as a “correction” for publication bias. Thus, we believe that Ferguson’s meta-analysis is fatally flawed and should not have been accepted for publication in Perspective on Psychological Science (or any other journal).
U2 - 10.1177/1745691615592235
DO - 10.1177/1745691615592235
M3 - Article
SN - 1745-6916
VL - 10
SP - 677
EP - 679
JO - Perspectives on Psychological Science
JF - Perspectives on Psychological Science
IS - 5
ER -