Utility as a rationale for choosing observer performance assessment paradigms for detection tasks in medical imaging

作者: Adam Wunderlich , Craig K. Abbey

DOI: 10.1118/1.4823755

关键词:

摘要: Purpose: Studies of lesion detectability are often carried out to evaluate medical imaging technology. For such studies, several approaches have been proposed measure observer performance, as the receiver operating characteristic (ROC), localization ROC (LROC), free-response (FROC), alternative (AFROC), and exponentially transformed FROC (EFROC) paradigms. Therefore, an experimenter seeking carry a study is confronted with array choices. Traditionally, arguments for different made on basis practical considerations (statistical power, etc.) or gross level analysis (case-level lesion-level). This article contends that careful consideration utility should form rationale matching assessment paradigm clinical task interest. Methods: In theory, performance commonly evaluated total expected utility, which integrates various event utilities against probability each event. To formalize relationship between summary curve associated paradigm, concept “natural” structure proposed. A natural defined when variables axes sufficient computing assuming disease prevalence known. Results: Natural structures ROC, LROC, FROC, AFROC, EFROC curves introduced, clarifying how correct incorrect decisions aggregated by curves. Further, conditions given under general localization-based methodologies reduce case-based assessment. Conclusions: Overall, findings reveal correspond diagnostic tasks, suggesting motivating principle choosing paradigm.

参考文章(25)
Giovanni Parmigiani, Lurdes Y. T. Inoue, Decision theory : principles and approaches John Wiley & Sons. ,(2009) , 10.1002/9780470746684
Stuart J. Starr, Charles E. Metz, Lee B. Lusted, David J. Goodenough, Visual Detection and Localization of Radiographic Images Radiology. ,vol. 116, pp. 533- 538 ,(1975) , 10.1148/116.3.533
Charles E. Metz, Basic principles of ROC analysis Seminars in Nuclear Medicine. ,vol. 8, pp. 283- 298 ,(1978) , 10.1016/S0001-2998(78)80014-2
Lee B. Lusted, Decision-making studies in patient management. The New England Journal of Medicine. ,vol. 284, pp. 416- 424 ,(1971) , 10.1056/NEJM197102252840805
Craig K. Abbey, Miguel P. Eckstein, John M. Boone, An Equivalent Relative Utility Metric for Evaluating Screening Mammography Medical Decision Making. ,vol. 30, pp. 113- 122 ,(2010) , 10.1177/0272989X09341753
Robert F. Wagner, Craig A. Beam, Sergey V. Beiden, Reader variability in mammography and its implications for expected utility over the population of readers and cases. Medical Decision Making. ,vol. 24, pp. 561- 572 ,(2004) , 10.1177/0272989X04271043
Federica Zanca, Jurgen Jacobs, Chantal Van Ongeval, Filip Claus, Valerie Celis, Catherine Geniets, Veerle Provost, Herman Pauwels, Guy Marchal, Hilde Bosmans, Evaluation of clinical image processing algorithms used in digital mammography Medical Physics. ,vol. 36, pp. 765- 775 ,(2009) , 10.1118/1.3077121
Nancy A. Obuchowski, Michael L. Lieber, Kimerly A. Powell, Data analysis for detection and localization of multiple abnormalities with application to mammography Academic Radiology. ,vol. 7, pp. 516- 525 ,(2000) , 10.1016/S1076-6332(00)80324-4