Information Systems and Health Care IV: Real-Time ROC Analysis to Evaluate Radiologists' Performanceof Interpreting Mammograpny

作者: Min Wu , Etta Pisano , Yuanshui Zheng

DOI: 10.17705/1CAIS.01616

关键词: Predictive valueData miningReceiver operating characteristicRaw dataExperimental testingSensitivity (control systems)Computer scienceHealth careSet (abstract data type)Information system

摘要: This paper describes how to use Receiver Operator Characteristic (ROC) analysis evaluate radiologists’ performance of interpreting digital mammograms in real-time. We developed an experimental testing system, which implemented a set clinical lesion-matching rules prepare raw ROC data. The system can automatically provide detailed evaluations the performance, such as sensitivity, specificity, positive predictive value, negative diagnostic accuracy, curve, and area under curve (Az). Based on preliminary evaluation we found that is appropriate for real-time computer application, directly using data from database, radiology residents.

参考文章(26)
Stuart J. Starr, Charles E. Metz, Lee B. Lusted, David J. Goodenough, Visual Detection and Localization of Radiographic Images Radiology. ,vol. 116, pp. 533- 538 ,(1975) , 10.1148/116.3.533
Charles E. Metz, Xiaochuan Pan, ”Proper” binormal ROC curves: theory and maximum-likelihood estimation Journal of Mathematical Psychology. ,vol. 43, pp. 1- 33 ,(1999) , 10.1006/JMPS.1998.1218
Jyh-Shyan Lin, Akira Hasegawa, Matthew T. Freedman, Seong K. Mun, Differentiation Between Nodules and End-On Vessels Using A Convolution Neural Network Architecture Journal of Digital Imaging. ,vol. 8, pp. 132- 141 ,(1995) , 10.1007/BF03168087
Qiang Li, Shusuke Sone, Kunio Doi, Selective enhancement filters for nodules, vessels, and airway walls in two- and three-dimensional CT scans. Medical Physics. ,vol. 30, pp. 2040- 2051 ,(2003) , 10.1118/1.1581411
Robert F. Wagner, Sergey V. Beiden, Gregory Campbell, Charles E. Metz, William M. Sacks, Assessment of medical imaging and computer-assist systems: lessons from recent experience. Academic Radiology. ,vol. 9, pp. 1264- 1277 ,(2002) , 10.1016/S1076-6332(03)80560-3
Daniel B. Kopans, The Accuracy of Mammographic Interpretation The New England Journal of Medicine. ,vol. 331, pp. 1521- 1522 ,(1994) , 10.1056/NEJM199412013312213
Yuanshui Zheng, Min Wu, Elodia Cole, Etta D Pisano, Online annotation tool for digital mammography1 Academic Radiology. ,vol. 11, pp. 566- 572 ,(2004) , 10.1016/S1076-6332(03)00726-8
Robert M. Nishikawa, Maryellen L. Giger, Kunio Doi, Charles E. Metz, Fang-Fang Yin, Carl J. Vyborny, Robert A. Schmidt, Effect of case selection on the performance of computer-aided detection schemes. Medical Physics. ,vol. 21, pp. 265- 269 ,(1994) , 10.1118/1.597287