TY - JOUR
T1 - Determinants of selective reporting
T2 - A taxonomy based on content analysis of a random selection of the literature
AU - van der Steen, Jenny T
AU - van den Bogert, Cornelis A
AU - van Soest-Poortvliet, Mirjam C
AU - Fazeli Farsani, Soulmaz
AU - Otten, René H J
AU - Ter Riet, Gerben
AU - Bouter, Lex M
PY - 2018
Y1 - 2018
N2 - BACKGROUND: Selective reporting is wasteful, leads to bias in the published record and harms the credibility of science. Studies on potential determinants of selective reporting currently lack a shared taxonomy and a causal framework.OBJECTIVE: To develop a taxonomy of determinants of selective reporting in science.DESIGN: Inductive qualitative content analysis of a random selection of the pertinent literature including empirical research and theoretical reflections.METHODS: Using search terms for bias and selection combined with terms for reporting and publication, we systematically searched the PubMed, Embase, PsycINFO and Web of Science databases up to January 8, 2015. Of the 918 articles identified, we screened a 25 percent random selection. From eligible articles, we extracted phrases that mentioned putative or possible determinants of selective reporting, which we used to create meaningful categories. We stopped when no new categories emerged in the most recently analyzed articles (saturation).RESULTS: Saturation was reached after analyzing 64 articles. We identified 497 putative determinants, of which 145 (29%) were supported by empirical findings. The determinants represented 12 categories (leaving 3% unspecified): focus on preferred findings (36%), poor or overly flexible research design (22%), high-risk area and its development (8%), dependence upon sponsors (8%), prejudice (7%), lack of resources including time (3%), doubts about reporting being worth the effort (3%), limitations in reporting and editorial practices (3%), academic publication system hurdles (3%), unfavorable geographical and regulatory environment (2%), relationship and collaboration issues (2%), and potential harm (0.4%).CONCLUSIONS: We designed a taxonomy of putative determinants of selective reporting consisting of 12 categories. The taxonomy may help develop theory about causes of selection bias and guide policies to prevent selective reporting.
AB - BACKGROUND: Selective reporting is wasteful, leads to bias in the published record and harms the credibility of science. Studies on potential determinants of selective reporting currently lack a shared taxonomy and a causal framework.OBJECTIVE: To develop a taxonomy of determinants of selective reporting in science.DESIGN: Inductive qualitative content analysis of a random selection of the pertinent literature including empirical research and theoretical reflections.METHODS: Using search terms for bias and selection combined with terms for reporting and publication, we systematically searched the PubMed, Embase, PsycINFO and Web of Science databases up to January 8, 2015. Of the 918 articles identified, we screened a 25 percent random selection. From eligible articles, we extracted phrases that mentioned putative or possible determinants of selective reporting, which we used to create meaningful categories. We stopped when no new categories emerged in the most recently analyzed articles (saturation).RESULTS: Saturation was reached after analyzing 64 articles. We identified 497 putative determinants, of which 145 (29%) were supported by empirical findings. The determinants represented 12 categories (leaving 3% unspecified): focus on preferred findings (36%), poor or overly flexible research design (22%), high-risk area and its development (8%), dependence upon sponsors (8%), prejudice (7%), lack of resources including time (3%), doubts about reporting being worth the effort (3%), limitations in reporting and editorial practices (3%), academic publication system hurdles (3%), unfavorable geographical and regulatory environment (2%), relationship and collaboration issues (2%), and potential harm (0.4%).CONCLUSIONS: We designed a taxonomy of putative determinants of selective reporting consisting of 12 categories. The taxonomy may help develop theory about causes of selection bias and guide policies to prevent selective reporting.
KW - Journal Article
UR - http://www.scopus.com/inward/record.url?scp=85041489854&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85041489854&partnerID=8YFLogxK
U2 - 10.1371/journal.pone.0188247
DO - 10.1371/journal.pone.0188247
M3 - Article
C2 - 29401492
SN - 1932-6203
VL - 13
SP - e0188247
JO - PLoS ONE
JF - PLoS ONE
IS - 2
M1 - e0188247
ER -
