Committee peer review at an international research foundation: predictive validity and fairness of selection decisions on post-graduate fellowship applications

作者: Lutz Bornmann , Hans-Dieter Daniel

DOI: 10.3152/147154405781776283

关键词:

摘要: We investigated committee peer review for awarding long-term fellowships to post-graduate researchers as practised by the Boehringer Ingelheim Fonds (BIF) — a foundation promotion of basic research in biomedicine. The most important aspect our study was investigate predictive validity procedure, i.e. whether achieves its aim select fellowship recipients best junior scientists. Our bibliometric analysis shows that this is indeed case and selection procedure thus highly valid. With regard fairness we analysed extent which foundation's Board Trustees' practice reviewing applications alphabetic order when making final decisions has an influence on they make. A statistically significant postulated bias variable could be observed, but effect size small. Copyright , Beech Tree Publishing.

参考文章(9)
A.J. Nederhof, THE VALIDITY AND RELIABILITY OF EVALUATION OF SCHOLARLY PERFORMANCE Handbook of Quantitative Studies of Science and Technology. pp. 193- 228 ,(1988) , 10.1016/B978-0-444-70537-2.50012-X
David F Horrobin, Something rotten at the core of science? Trends in Pharmacological Sciences. ,vol. 22, pp. 51- 52 ,(2001) , 10.1016/S0165-6147(00)01618-7
Steven N Goodman, Jesse Berlin, Suzanne W Fletcher, Robert H Fletcher, Manuscript Quality before and after Peer Review and Editing at Annals of Internal Medicine Annals of Internal Medicine. ,vol. 121, pp. 11- 21 ,(1994) , 10.7326/0003-4819-121-1-199407010-00003
Tom Tregenza, Gender bias in the refereeing process Trends in Ecology and Evolution. ,vol. 17, pp. 349- 350 ,(2002) , 10.1016/S0169-5347(02)02545-4
William H. Kruskal, W. Allen Wallis, Use of Ranks in One-Criterion Variance Analysis Journal of the American Statistical Association. ,vol. 47, pp. 583- 621 ,(1952) , 10.1080/01621459.1952.10483441
T. N. van Leeuwen, H. F. Moed, R. J. W. Tijssen, M. S. Visser, A. F. J. van Raan, First evidence of serious language-bias in the use of citation analysis for the evaluation of national science systems Research Evaluation. ,vol. 9, pp. 155- 156 ,(2000) , 10.3152/147154400781777359
Anthony F.J. van Raan, Measuring Science: Capita Selecta of Current Main Issues Springer Netherlands. pp. 19- 50 ,(2004) , 10.1007/1-4020-2755-9_2