Teaching receiver operating characteristic analysis: an interactive laboratory exercise.

作者: John Eng

DOI: 10.1016/J.ACRA.2012.09.003

关键词:

摘要: Rationale and Objectives Despite its fundamental importance in the evaluation of diagnostic tests, receiver operating characteristic (ROC) analysis is not easily understood. The purpose this project was to create a learning experience that resulted an intuitive understanding basic principles ROC analysis. Materials Methods An interactive laboratory exercise developed for class about radiology testing taught within clinical epidemiology course between 2000 2009. physician students were fellows from various medical specialties who enrolled graduate degree program investigation. For exercise, divided into six groups. Each group interpreted radiographs set 50 exams peripheral skeleton determine presence or absence acute fracture. Data pooled given each student. Students calculated area under curve (AUC) corresponding overall performance. A binormal also fitted data year. Results conducted 8 years with approximately 20–30 per mean AUC over eight classes 0.72 standard deviation 0.08 (range, 0.60–0.85). Conclusion With some simplifications design, observer study can be classroom setting. Participatory collection promotes principles.

参考文章(20)
John Eng, William K. Mysko, Gregory E. R. Weller, Regis Renard, Joseph N. Gitlin, David A. Bluemke, Donna Magid, Gabor D. Kelen, William W. Scott, Interpretation of Emergency Department Radiographs American Journal of Roentgenology. ,vol. 175, pp. 1233- 1238 ,(2000) , 10.2214/AJR.175.5.1751233
Charles E. Metz, Basic principles of ROC analysis Seminars in Nuclear Medicine. ,vol. 8, pp. 283- 298 ,(1978) , 10.1016/S0001-2998(78)80014-2
Thomas K. P. Egglin, Context Bias JAMA. ,vol. 276, pp. 1752- 1755 ,(1996) , 10.1001/JAMA.1996.03540210060035
Stephen L. Hillis, Kevin S. Berbaum, Charles E. Metz, Recent Developments in the Dorfman-Berbaum-Metz Procedure for Multireader ROC Study Analysis Academic Radiology. ,vol. 15, pp. 647- 661 ,(2008) , 10.1016/J.ACRA.2007.12.015
John Eng, Receiver Operating Characteristic Analysis Academic Radiology. ,vol. 12, pp. 909- 916 ,(2005) , 10.1016/J.ACRA.2005.04.005
CHARLES E. METZ, ROC methodology in radiologic imaging Investigative Radiology. ,vol. 21, pp. 720- 733 ,(1986) , 10.1097/00004424-198609000-00009
David Gur, Andriy I. Bandos, Howard E. Rockette, Margarita L. Zuley, Christiane M. Hakim, Denise M. Chough, Marie A. Ganott, Jules H. Sumkin, Is an ROC-type Response Truly Always Better Than a Binary Response in Observer Performance Studies? Academic Radiology. ,vol. 17, pp. 639- 645 ,(2010) , 10.1016/J.ACRA.2009.12.012
Clement T. Loy, Les Irwig, Accuracy of Diagnostic Tests Read With and Without Clinical Information JAMA. ,vol. 292, pp. 1602- 1609 ,(2004) , 10.1001/JAMA.292.13.1602