Measures of response agreement for qualitative data: Some generalizations and alternatives.

作者: Richard J. Light

DOI: 10.1037/H0031643

关键词: AgreementStatistical analysisQualitative propertyStatisticsEconometricsObservation methodMathematics

摘要: … measures. Using the general model of a contingency table with fixed margins, this study suggests a measure … "internally"; a conditional measure of agreement for several observers …

参考文章(17)
Joseph L. Fleiss, Jacob Cohen, B. S. Everitt, Large sample standard errors of kappa and weighted kappa. Psychological Bulletin. ,vol. 72, pp. 323- 327 ,(1969) , 10.1037/H0028106
EUGENE I. BURDOCK, JOSEPH L. FLEISS, ANNE S. HARDESTY, A NEW VIEW OF INTER‐OBSERVER AGREEMENT Personnel Psychology. ,vol. 16, pp. 373- 384 ,(1963) , 10.1111/J.1744-6570.1963.TB01283.X
B. S. Everitt, MOMENTS OF THE STATISTICS KAPPA AND WEIGHTED KAPPA British Journal of Mathematical and Statistical Psychology. ,vol. 21, pp. 97- 103 ,(1968) , 10.1111/J.2044-8317.1968.TB00400.X
Jacob Cohen, A Coefficient of agreement for nominal Scales Educational and Psychological Measurement. ,vol. 20, pp. 37- 46 ,(1960) , 10.1177/001316446002000104
Robert L. Ebel, Estimation of the reliability of ratings Psychometrika. ,vol. 16, pp. 407- 424 ,(1951) , 10.1007/BF02288803
Joseph L. Fleiss, Estimating the accuracy of dichotomous judgments Psychometrika. ,vol. 30, pp. 469- 479 ,(1965) , 10.1007/BF02289537
Desmond S. Cartwright, A rapid non-parametric estimate of multi-judge reliability Psychometrika. ,vol. 21, pp. 17- 29 ,(1956) , 10.1007/BF02289084