Significance chasing in research practice: causes, consequences and possible solutions

作者: Jennifer J. Ware , Marcus R. Munafò

DOI: 10.1111/ADD.12673

关键词: Research designFalse positive paradoxPublic economicsPublicationPublish or perishNoveltyScientific literaturePsychologySocial psychologyResearch questionIncentiveMedicine (miscellaneous)Psychiatry and Mental health

摘要: Background and Aims The low reproducibility of findings within the scientific literature is a growing concern. This may be due to many being false positives which, in turn, can misdirect research effort waste money. Methods We review factors that contribute poor study an excess ‘significant’ published literature. Specifically, we consider influence current incentive structures impact these on practices. Results The prevalence attributable number questionable practices, ranging from relatively innocent minor (e.g. unplanned post-hoc tests) calculated serious fabrication data). These practices driven by pressure publish), alongside preferential emphasis placed journals novelty over veracity. There are potential solutions reproducibility, such as new publishing formats emphasize question design, rather than results obtained. has minimize significance chasing non-publication null findings. Conclusions Significance chasing, unfortunate consequence ‘publish or perish’ culture preference among for novel findings. It likely top–down change implemented those with ability modify structure funders journals) will required address problems reproducibility.

参考文章(38)
MARCUS R. MUNAFÒ, ANGELA S. ATTWOOD, JONATHAN FLINT, Bias in genetic association studies: effects of research location and resources. Psychological Medicine. ,vol. 38, pp. 1213- 1214 ,(2008) , 10.1017/S003329170800353X
C. Franzoni, G. Scellato, P. Stephan, Changing Incentives to Publish Science. ,vol. 333, pp. 702- 703 ,(2011) , 10.1126/SCIENCE.1197286
Ed Yong, Replication studies: Bad copy Nature. ,vol. 485, pp. 298- 300 ,(2012) , 10.1038/485298A
Zhenglun Pan, Thomas A Trikalinos, Fotini K Kavvoura, Joseph Lau, John P.A Ioannidis, Local literature bias in genetic epidemiology: an empirical evaluation of the Chinese literature. PLOS Medicine. ,vol. 2, ,(2005) , 10.1371/JOURNAL.PMED.0020334
M R Munafò, G Stothart, J Flint, Bias in genetic association studies and impact factor. Molecular Psychiatry. ,vol. 14, pp. 119- 120 ,(2009) , 10.1038/MP.2008.77
Christopher D. Chambers, Registered reports: a new publishing initiative at Cortex. Cortex. ,vol. 49, pp. 609- 610 ,(2013) , 10.1016/J.CORTEX.2012.12.016
Kerry Dwan, Carrol Gamble, Paula R Williamson, Jamie J Kirkham, Reporting Bias Group, None, Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias — An Updated Review PLoS ONE. ,vol. 8, pp. e66844- ,(2013) , 10.1371/JOURNAL.PONE.0066844
Ivan Vankov, Jeffrey Bowers, Marcus R. Munafò, On the persistence of low power in psychological science. Quarterly Journal of Experimental Psychology. ,vol. 67, pp. 1037- 1040 ,(2014) , 10.1080/17470218.2014.885986