Kappa and Its Dependence on Marginal Rates

作者: Richard J. Cook

DOI: 10.1002/9781118445112.STAT05243

关键词:

摘要: The kappa statistic is a widely used measure for quantifying agreement between raters using nominal scales. It advocated on the grounds that it “corrects” level of would be expected by chance alone based marginal rates. operating characteristics kappa, however, show responds in complicated and unintuitive way to subject-specific agreement. Modifications supplementary statistics, which have been proposed help interpret are discussed. Remarks made as why has such problematic features. Keywords: agreement; association; contingency table; kappa; margins; reliability

参考文章(14)
Alvan R. Feinstein, Domenic V. Cicchetti, High agreement but low kappa: I. The problems of two paradoxes. Journal of Clinical Epidemiology. ,vol. 43, pp. 543- 549 ,(1990) , 10.1016/0895-4356(90)90158-L
V. T. Farewell, D. A. Sprott, Conditional inference for predictive agreement. Statistics in Medicine. ,vol. 18, pp. 1435- 1449 ,(1999) , 10.1002/(SICI)1097-0258(19990630)18:12<1435::AID-SIM150>3.0.CO;2-F
W.Douglas Thompson, Stephen D. Walter, Response Kappa and the concept of independent errors Journal of Clinical Epidemiology. ,vol. 41, pp. 969- 970 ,(1988) , 10.1016/0895-4356(88)90033-9
Charles A. Lantz, Elliott Nebenzahl, Behavior and interpretation of the κ statistic: Resolution of the two paradoxes Journal of Clinical Epidemiology. ,vol. 49, pp. 431- 434 ,(1996) , 10.1016/0895-4356(95)00571-4
Jacob Cohen, A Coefficient of agreement for nominal Scales Educational and Psychological Measurement. ,vol. 20, pp. 37- 46 ,(1960) , 10.1177/001316446002000104
Helena Chmura Kraemer, Ramifications of a population model for κ as a coefficient of reliability Psychometrika. ,vol. 44, pp. 461- 472 ,(1979) , 10.1007/BF02296208
Ted Byrt, Janet Bishop, John B. Carlin, Bias, prevalence and kappa Journal of Clinical Epidemiology. ,vol. 46, pp. 423- 429 ,(1993) , 10.1016/0895-4356(93)90018-V
Domenic V. Cicchetti, Alvan R. Feinstein, High agreement but low kappa: II. Resolving the paradoxes. Journal of Clinical Epidemiology. ,vol. 43, pp. 551- 558 ,(1990) , 10.1016/0895-4356(90)90159-M
S.R. Chamberlin, D.A. Sprott, On a discrete distribution associated with the statistical assessment of nominal scale agreement Discrete Mathematics. ,vol. 92, pp. 39- 47 ,(1991) , 10.1016/0012-365X(91)90265-4
Richard J. Cook, Vern T. Farewell, Conditional inference for subject-specific and marginal agreement: Two families of agreement measures† Canadian Journal of Statistics-revue Canadienne De Statistique. ,vol. 23, pp. 333- 344 ,(1995) , 10.2307/3315378