Reliable and computationally efficient maximum-likelihood estimation of "proper" binormal ROC curves.

作者: Lorenzo L. Pesce , Charles E. Metz

DOI: 10.1016/J.ACRA.2007.03.012

关键词:

摘要: Rationale and Objectives Estimation of ROC curves their associated indices from experimental data can be problematic, especially in multireader, multicase (MRMC) observer studies. Wilcoxon estimates area under the curve (AUC) strongly biased with categorical data, whereas conventional binormal curve-fitting model may produce unrealistic fits. The “proper” (PBM) was introduced by Metz Pan to provide acceptable fits for both sturdy problematic datasets, but other investigators found that its first software implementation numerically unstable some situations. Therefore, we created an entirely new algorithm implement PBM. Materials Methods This paper describes detail PBM algorithm, which designed perform successfully all situations encountered previously. Extensive testing conducted also on a broad variety simulated real datasets. Windows, Linux, Apple Macintosh OS X versions are available online at http://xray.bsd.uchicago.edu/krl/ . Results Plots fitted as well summaries AUC standard errors reported. never failed converge produced good several million datasets it tested. For most very error. compared continuously distributed expected superior data. Conclusion is reliable wide tasks.

参考文章(38)
Hanley Ja, Receiver operating characteristic (ROC) methodology: the state of the art. Critical Reviews in Diagnostic Imaging. ,vol. 29, pp. 307- 335 ,(1989)
Donald D. Dorfman, Kevin S. Berbaum, A contaminated binormal model for ROC data: Part III. Initial evaluation with detection ROC data. Academic Radiology. ,vol. 7, pp. 438- 447 ,(2000) , 10.1016/S1076-6332(00)80384-0
Stanton A. Glantz, Primer of biostatistics ,(1981)
Charles E. Metz, Xiaochuan Pan, ”Proper” binormal ROC curves: theory and maximum-likelihood estimation Journal of Mathematical Psychology. ,vol. 43, pp. 1- 33 ,(1999) , 10.1006/JMPS.1998.1218
Charles E. Metz, Basic principles of ROC analysis Seminars in Nuclear Medicine. ,vol. 8, pp. 283- 298 ,(1978) , 10.1016/S0001-2998(78)80014-2
Robert F. Wagner, Sergey V. Beiden, Gregory Campbell, Charles E. Metz, William M. Sacks, Assessment of medical imaging and computer-assist systems: lessons from recent experience. Academic Radiology. ,vol. 9, pp. 1264- 1277 ,(2002) , 10.1016/S1076-6332(03)80560-3
ALICIA Y. TOLEDANO, CONSTANTINE GATSONIS, Ordinal regression methodology for ROC curves derived from correlated data Statistics in Medicine. ,vol. 15, pp. 1807- 1826 ,(1996) , 10.1002/(SICI)1097-0258(19960830)15:16<1807::AID-SIM333>3.0.CO;2-U