Nominal scale agreement among observers

作者: Hubert J. A. Schouten

DOI: 10.1007/BF02294066

关键词:

摘要: Experiments are considered where each of a sample subjects is assigned to one C categories separately by fixed or varying group observers. Building on earlier publications, general procedures proposed analyze agreements and disagreements among In the case observers, it shown that not necessary demand constant number observers per subject. problem missing data considered. The illustrated within context two clinical diagnosis examples. first example investigated which relatively hard distinguish from another; new theorem applied shows useful property statistic kappa. second if subgroup can be found with significantly higher degree interobserver agreement.

参考文章(15)
Joseph L. Fleiss, Measuring nominal scale agreement among many raters. Psychological Bulletin. ,vol. 76, pp. 378- 382 ,(1971) , 10.1037/H0031619
Bradley Efron, Gail Gong, A Leisurely Look at the Bootstrap, the Jackknife, and Cross-Validation The American Statistician. ,vol. 37, pp. 36- 48 ,(1983) , 10.1080/00031305.1983.10483087
Anthony J. Conger, Integration and generalization of kappas for multiple raters. Psychological Bulletin. ,vol. 88, pp. 322- 328 ,(1980) , 10.1037/0033-2909.88.2.322
H. J. A. Schouten, Measuring Pairwise Agreement Among Many Observers. II. Some Improvements and Additions Biometrical Journal. ,vol. 24, pp. 431- 435 ,(1982) , 10.1002/BIMJ.4710240502
Jacob Cohen, A Coefficient of agreement for nominal Scales Educational and Psychological Measurement. ,vol. 20, pp. 37- 46 ,(1960) , 10.1177/001316446002000104
William C. Parr, H. Dennis Tolley, Jackknifing in Categorical Data Analysis Australian & New Zealand Journal of Statistics. ,vol. 24, pp. 67- 79 ,(1982) , 10.1111/J.1467-842X.1982.TB00808.X
H. J. A. Schouten, Measuring pairwise agreement among many observers Biometrical Journal. ,vol. 22, pp. 497- 504 ,(1980) , 10.1002/BIMJ.4710220605
J H van den Berge, H J Schouten, S Boomstra, S van Drunen Littel, R Braakman, Interobserver agreement in assessment of ocular signs in coma. Journal of Neurology, Neurosurgery, and Psychiatry. ,vol. 42, pp. 1163- 1168 ,(1979) , 10.1136/JNNP.42.12.1163