Convergent validation of peer review decisions using the h index: Extent of and reasons for type I and type II errors

作者: L BORNMANN , H DANIEL

DOI: 10.1016/J.JOI.2007.01.002

关键词:

摘要: Hirsch [Hirsch, J. E. (2005). An index to quantify an individual's scientific research output. Proceedings of the National Academy Sciences United States America, 102(46), 16569–16572] has proposed h as a single-number criterion evaluate output researcher. We investigated convergent validity decisions for awarding long-term fellowships post-doctoral researchers practiced by Boehringer Ingelheim Fonds (B.I.F.) using index. Our study examined 414 B.I.F. applicants (64 approved and 350 rejected) with total 1586 papers. The results our show that applicants’ indices correlate substantially standard bibliometric indicators. Even though on average (arithmetic mean median) are higher than those rejected (and this, fundamentally confirm funding decisions), distributions in part overlaps we categorized type I error (falsely drawn approval) or II rejection). Approximately, one-third award fellowship applicant error, about not error. analyses possible reasons these errors applicant's field but personal ties between can increase decrease risks errors.

参考文章(38)
Wolfgang Glänzel, On the Opportunities and Limitations of the H-index Science Focus/Kexue Guancha. ,vol. 1, pp. 10- 11 ,(2006)
Patrick Royston, Comment on sg3.4 and an Improved D'Agostino Test Stata Technical Bulletin. ,vol. 1, ,(1992)
Jerome K. Vanclay, Refining the H-Index The Scientist. ,vol. 20, pp. 14- 15 ,(2006)
Lutz Bornmann, Hans-Dieter Daniel, What do we know about the h index Journal of the Association for Information Science and Technology. ,vol. 58, pp. 1381- 1385 ,(2007) , 10.1002/ASI.20609
Leo Egghe, Dynamich-index: The Hirsch index in function of time Journal of the American Society for Information Science and Technology. ,vol. 58, pp. 452- 454 ,(2007) , 10.1002/ASI.20473
C KELLY, M JENNIONS, The h index and career assessment by numbers Trends in Ecology and Evolution. ,vol. 21, pp. 167- 170 ,(2006) , 10.1016/J.TREE.2006.01.005