Recent Developments in the Dorfman-Berbaum-Metz Procedure for Multireader ROC Study Analysis
作者： Stephen L. Hillis , Kevin S. Berbaum , Charles E. Metz
DOI: 10.1016/J.ACRA.2007.12.015
关键词:
摘要: Rationale and objectives The Dorfman-Berbaum-Metz (DBM) method has been one of the most popular methods for analyzing multireader receiver-operating characteristic (ROC) studies since it was proposed in 1992. Despite its popularity, original procedure several drawbacks: is limited to jackknife accuracy estimates, substantially conservative, not based on a satisfactory conceptual or theoretical model. Recently, solutions these problems have presented three papers. Our purpose summarize provide an overview recent developments. Materials Methods We present discuss recently various drawbacks DBM method. Results compare simulation study find that they result improved performance procedure. also using two real data modified incorporates yields more significant results clearer interpretations variance component parameters than Conclusions recommend
elsevier.com
sci-hub.se 参考文章(18)
Nancy A Obuchowski, Multireader, multimodality receiver operating characteristic curve studies: hypothesis testing and sample size estimation using an analysis of variance approach with dependent observations. Academic Radiology. ,(1995)
John Arthur Swets, Ronald M. Pickett, Evaluation of diagnostic systems : methods from signal detection theory Academic Press. ,(1982)
Kevin S. Berbaum, God, Like the Devil, is in the Details Academic Radiology. ,vol. 13, pp. 1311- 1316 ,(2006) , 10.1016/J.ACRA.2006.09.053
Russell V. Lenth, Yeh-Fong Chen, Brenda A. Donaghy, Donald D. Dorfman, Kevin S. Berbaum, Monte Carlo validation of a multireader method for receiver operating characteristic discrete rating data: Factorial experimental design Academic Radiology. ,vol. 5, pp. 591- 602 ,(1998) , 10.1016/S1076-6332(98)80294-8
EDMUND A. FRANKEN, KEVIN S. BERBAUM, SUSAN M. MARLEY, WILBUR L. SMITH, YUTAKA SATO, SIMON C. S. KAO, STEVEN G. MILAM, Evaluation of a digital workstation for interpreting neonatal examinations. A receiver operating characteristic study. Investigative Radiology. ,vol. 27, pp. 732- 737 ,(1992) , 10.1097/00004424-199209000-00016
Stephen L. Hillis, A comparison of denominator degrees of freedom methods for multiple observer ROC analysis. Statistics in Medicine. ,vol. 26, pp. 596- 619 ,(2007) , 10.1002/SIM.2532
Stephen L. Hillis, Kevin S. Berbaum, Monte Carlo Validation of the Dorfman-Berbaum-Metz Method Using Normalized Pseudovalues and Less Data-Based Model Simplification1 Academic Radiology. ,vol. 12, pp. 1534- 1541 ,(2005) , 10.1016/J.ACRA.2005.07.012
Nancy A. Obuchowski, Howard E. Rockette, Hypothesis testing of diagnostic accuracy for multiple readers and multiple tests: An anova approach with dependent observations Communications in Statistics - Simulation and Computation. ,vol. 24, pp. 285- 308 ,(1995) , 10.1080/03610919508813243
Donald D. Dorfman, Edward Alf, Maximum-likelihood estimation of parameters of signal-detection theory and determination of confidence intervals—Rating-method data Journal of Mathematical Psychology. ,vol. 6, pp. 487- 496 ,(1969) , 10.1016/0022-2496(69)90019-4
M. H. QUENOUILLE, NOTES ON BIAS IN ESTIMATION Biometrika. ,vol. 43, pp. 353- 360 ,(1956) , 10.1093/BIOMET/43.3-4.353