On Agreement Indices for Nominal Data

作者: R. Popping

DOI: 10.1007/978-1-349-19051-5_6

关键词: Empirical researchBehavioral assessmentJudgementLevel of measurementAgreementProperty (programming)Interval (mathematics)StatisticsTask (project management)

摘要: In empirical research certain measurements are frequently performed. Measurement is the assigning of numbers to subjects denote a property. These take place at level measurement: nominal, ordinal, interval or higher. Especially in social sciences, assignment category very often based on judgement an expert and not objective clear criterium. Still it desirable that ‘scientists agree’, i.e. will scarcely differ if another rater had performed task. So importance there agreement among raters. There when raters assign entity same category. Agreement only investigated within but general also fields biology medicine.

参考文章(31)
B. L. Hopkins, Jaime A. Hermann, Evaluating interobserver reliability of interval data. Journal of Applied Behavior Analysis. ,vol. 10, pp. 121- 126 ,(1977) , 10.1901/JABA.1977.10-121
JOHN J. BARTKO, WILLIAM T. CARPENTER, On the methods and theory of reliability. Journal of Nervous and Mental Disease. ,vol. 163, pp. 307- 317 ,(1976) , 10.1097/00005053-197611000-00003
Joseph L. Fleiss, Measuring nominal scale agreement among many raters. Psychological Bulletin. ,vol. 76, pp. 378- 382 ,(1971) , 10.1037/H0031619
Lee R. Dice, Measures of the Amount of Ecologic Association Between Species Ecology. ,vol. 26, pp. 297- 302 ,(1945) , 10.2307/1932409
Lawrence Hubert, Nominal scale response agreement as a generalized correlation British Journal of Mathematical and Statistical Psychology. ,vol. 30, pp. 98- 103 ,(1977) , 10.1111/J.2044-8317.1977.TB00728.X
A. E. Maxwell, A. E. G. Pilliner, DERIVING COEFFICIENTS OF RELIABILITY AND AGREEMENT FOR RATINGS British Journal of Mathematical and Statistical Psychology. ,vol. 21, pp. 105- 116 ,(1968) , 10.1111/J.2044-8317.1968.TB00401.X
Cynthia L. Janes, An extension of the Random Error Coefficient of Agreement to N x N tables. British Journal of Psychiatry. ,vol. 134, pp. 617- 619 ,(1979) , 10.1192/BJP.134.6.617
Robert L. Brennan, Richard J. Light, MEASURING AGREEMENT WHEN TWO OBSERVERS CLASSIFY PEOPLE INTO CATEGORIES NOT DEFINED IN ADVANCE British Journal of Mathematical and Statistical Psychology. ,vol. 27, pp. 154- 163 ,(1974) , 10.1111/J.2044-8317.1974.TB00535.X
J.W. Holley, J.P. Guilford, A Note on the G Index of Agreement Educational and Psychological Measurement. ,vol. 24, pp. 749- 753 ,(1964) , 10.1177/001316446402400402