Deep Impact: Unintended consequences of journal rank

作者: Björn Brembs , Katherine Button , Marcus Munafò

DOI: 10.3389/FNHUM.2013.00291

关键词: Unintended consequencesJournal rankingPsychologyScholarly communicationFilter (software)Rank (computer programming)Information technologyImpact factorPositive economicsData scienceImpact assessment

摘要: Most researchers acknowledge an intrinsic hierarchy in the scholarly journals (“journal rank”) that they submit their work to, and adjust not only submission but also reading strategies accordingly. On other hand, much has been written about negative effects of institutionalizing journal rank as impact measure. So far, contributions to debate concerning limitations a scientific assessment tool have either lacked data, or relied on few studies. In this review, we present most recent pertinent data consequences our current communication system with respect various measures quality (such utility/citations, methodological soundness, expert ratings retractions). These corroborate previous hypotheses: using is bad practice. Moreover, lead us argue any (not currently-favored Impact Factor) would impact. Therefore, suggest abandoning altogether, favor library-based system, will ultimately be necessary. This new use modern information technology vastly improve filter, sort discovery functions system.

参考文章(127)
C. R. Bain, P. S. Myles, Relationship between journal impact factor and levels of evidence in anaesthesia. Anaesthesia and Intensive Care. ,vol. 33, pp. 567- 570 ,(2005) , 10.1177/0310057X0503300503
Weiping Yue, Concepción S. Wilson, Francois Boller, Peer Assessment of Journal Quality in Clinical Neurology Journal of The Medical Library Association. ,vol. 95, pp. 70- 76 ,(2007)
慶應義塾大学工学部, Keio science and technology reports Faculty of Science and Technology, Keio University. ,(1981)
H. Nowotny, High- and low-cost realities for science and society Science. ,vol. 308, pp. 1117- 1118 ,(2005) , 10.1126/SCIENCE.1113825
Bradley M. Hemminger, Heather A. Piwowar, Jason Priem, Altmetrics in the wild: Using social media to explore scholarly impact arXiv: Digital Libraries. ,(2012)
Sanjay Saint, Somnath Saha, Dimitri A. Christakis, Impact factor: a valid measure of journal quality? Journal of The Medical Library Association. ,vol. 91, pp. 42- 46 ,(2003)
Open Science Collaboration, None, An open, large-scale, collaborative effort to estimate the reproducibility of psychological science Perspectives on Psychological Science. ,vol. 7, pp. 657- 660 ,(2012) , 10.1177/1745691612462588
Jay A. Labinger, The scientific life : a moral history of a late modern vocation Physics Today. ,vol. 62, pp. 54- 54 ,(2008) , 10.1063/1.3099581
BERNHARD STATZNER, VINCENT H. RESH, Negative changes in the scientific publication process in ecology: potential causes and consequences Freshwater Biology. ,vol. 55, pp. 2639- 2653 ,(2010) , 10.1111/J.1365-2427.2010.02484.X