A comparison of two ways of evaluating research units working in different scientific fields

作者: Antonio Perianes-Rodriguez , Javier Ruiz-Castillo

DOI: 10.1007/S11192-015-1801-5

关键词:

摘要: This paper studies the evaluation of research units that publish their output in several scientific fields. A possible solution relies on prior normalization raw citations received by publications all In a second step, citation indicator is applied to units' field-normalized distributions. this paper, we also study an alternative begins applying size- and scale-independent impact distributions any unit calculated as average (weighted publication output) achieves each field. The two alternatives are confronted using 500 universities 2013 edition CWTS Leiden Ranking, whose evaluated according indicators with very different properties. We use large Web Science dataset consisting 3.6 million articles published 2005---2008 period, classification system distinguishing between 5119 clusters. main findings follows. Firstly, differences production practices 3332 clusters more than 250 account for 22.5 % overall inequality. After standard field-normalization procedure, where cluster mean used factors, quantity reduced 4.3 %. Secondly, university rankings solutions all-sciences aggregation problem small order magnitude both indicators.

参考文章(28)
F. Radicchi, S. Fortunato, C. Castellano, Universality of citation distributions: Toward an objective measure of scientific impact Proceedings of the National Academy of Sciences of the United States of America. ,vol. 105, pp. 17268- 17272 ,(2008) , 10.1073/PNAS.0806977105
Ludo Waltman, Clara Calero-Medina, Joost Kosten, Ed C.M. Noyons, Robert J.W. Tijssen, Nees Jan van Eck, Thed N. van Leeuwen, Anthony F.J. van Raan, Martijn S. Visser, Paul Wouters, The Leiden ranking 2011/2012: Data collection, indicators, and interpretation Journal of the Association for Information Science and Technology. ,vol. 63, pp. 2419- 2432 ,(2012) , 10.1002/ASI.22708
Michal Brzezinski, Power laws in citation distributions: evidence from Scopus Scientometrics. ,vol. 103, pp. 213- 228 ,(2015) , 10.1007/S11192-014-1524-Z
Javier Ruiz-Castillo, Antonio Perianes-Rodríguez, An alternative to field-normalization in the aggregation of heterogeneous scientific fields Research Papers in Economics. ,(2015)
Mike Thelwall, Paul Wilson, Distributions for cited articles from individual subjects and years Journal of Informetrics. ,vol. 8, pp. 824- 839 ,(2014) , 10.1016/J.JOI.2014.08.001
Javier Ruiz-Castillo, Antonio Perianes-Rodríguez, University citation distributions Research Papers in Economics. ,(2015)
F.A. Cowell, Chapter 2 Measurement of inequality Handbook of Income Distribution. ,vol. 1, pp. 87- 166 ,(2000) , 10.1016/S1574-0056(00)80005-6
Richard A. Groeneveld, Glen Meeden, Measuring Skewness and Kurtosis The Statistician. ,vol. 33, pp. 391- 399 ,(1984) , 10.2307/2987742
Antonio Perianes-Rodriguez, Javier Ruiz-Castillo, Multiplicative versus fractional counting methods for co-authored publications. The case of the 500 universities in the Leiden Ranking Journal of Informetrics. ,vol. 9, pp. 974- 989 ,(2015) , 10.1016/J.JOI.2015.10.002