Multireader multicase reader studies with binary agreement data: simulation, analysis, validation, and sizing

作者: Weijie Chen , Adam Wunderlich , Nicholas Petrick , Brandon D. Gallas

DOI: 10.1117/1.JMI.1.3.031011

关键词: SizingStatistical hypothesis testingData modelingMonte Carlo methodBinary numberAlgorithmType I and type II errorsState (computer science)Binary dataMedicine

摘要: We treat multireader multicase (MRMC) reader studies for which a reader’s diagnostic assessment is converted to binary agreement (1: agree with the truth state, 0: disagree state). present mathematical model simulating MRMC data desired correlation structure across readers, cases, and two modalities, assuming expected probability of equal modalities (P1=P2). This can be used validate coverage probabilities 95% confidence intervals (of P1, P2, or P1−P2 when P1−P2=0), type I error superiority hypothesis test, size noninferiority test (which assumes P1=P2). To illustrate utility our simulation model, we adapt Obuchowski–Rockette–Hillis (ORH) method analysis data. Moreover, use ORH sizing in setting. Our software package publicly available on Google code project hosting site simulation, analysis, validation,

参考文章(32)
Nancy A. Obuchowski, Brandon D. Gallas, Stephen L. Hillis, Multi-reader ROC Studies with Split-plot Designs: A Comparison of Statistical Methods Academic Radiology. ,vol. 19, pp. 1508- 1517 ,(2012) , 10.1016/J.ACRA.2012.09.012
Stephen L. Hillis, Nancy A. Obuchowski, Kevin S. Berbaum, Power Estimation for Multireader ROC Methods Academic Radiology. ,vol. 18, pp. 129- 142 ,(2011) , 10.1016/J.ACRA.2010.09.007
John R Gilbertson, Jonhan Ho, Leslie Anthony, Drazen M Jukic, Yukako Yagi, Anil V Parwani, Primary histologic diagnosis using automated whole slide imaging: a validation study BMC Clinical Pathology. ,vol. 6, pp. 4- 4 ,(2006) , 10.1186/1472-6890-6-4
John Arthur Swets, Ronald M. Pickett, Evaluation of diagnostic systems : methods from signal detection theory Academic Press. ,(1982)
Charles E McCulloch, Shayle R Searle, John M Neuhaus, Generalized, Linear, and Mixed Models ,(2001)
Charles E. Metz, Basic principles of ROC analysis Seminars in Nuclear Medicine. ,vol. 8, pp. 283- 298 ,(1978) , 10.1016/S0001-2998(78)80014-2
Brandon D. Gallas, Gene A. Pennello, Kyle J. Myers, Multireader multicase variance analysis for binary data Journal of The Optical Society of America A-optics Image Science and Vision. ,vol. 24, ,(2007) , 10.1364/JOSAA.24.000B70
Robert F. Wagner, Sergey V. Beiden, Gregory Campbell, Charles E. Metz, William M. Sacks, Assessment of medical imaging and computer-assist systems: lessons from recent experience. Academic Radiology. ,vol. 9, pp. 1264- 1277 ,(2002) , 10.1016/S1076-6332(03)80560-3
Weijie Chen, Nicholas A. Petrick, Berkman Sahiner, Hypothesis testing in noninferiority and equivalence MRMC ROC studies. Academic Radiology. ,vol. 19, pp. 1158- 1165 ,(2012) , 10.1016/J.ACRA.2012.04.011