High performance computing techniques for scaling image analysis workflows

作者: Patrick M. Widener , Tahsin Kurc , Wenjin Chen , Fusheng Wang , Lin Yang

DOI: 10.1007/978-3-642-28145-7_7

关键词: Data miningSupercomputerWorkflowModality (human–computer interaction)Image processingVirtual microscopyComputer scienceAlgorithm designSoftware frameworkDomain (software engineering)

摘要: Biomedical images are intrinsically complex with each domain and modality often requiring specialized knowledge to accurately render diagnosis plan treatment. A general software framework that provides access high-performance resources can make possible high-throughput investigations of micro-scale features as well algorithm design, development evaluation. In this paper we describe the requirements challenges supporting microscopy analyses large datasets high-resolution biomedical images. We present computing approaches for storage retrieval image data, processing, management analysis results additional explorations. Lastly, issues surrounding use high performance scaling workflows.

参考文章(24)
Rimm Dl, Costa J, Camp Rl, Charette La, Reiss M, Olsen Da, Tissue microarray: a new technology for amplification of tissue resources. Cancer Journal. ,vol. 7, pp. 24- 31 ,(2001)
Ewa Deelman, James Blythe, Yolanda Gil, Carl Kesselman, Gaurang Mehta, Sonal Patil, Mei-Hui Su, Karan Vahi, Miron Livny, Pegasus: Mapping Scientific Workflows onto the Grid Grid Computing. pp. 11- 20 ,(2004) , 10.1007/978-3-540-28642-4_2
Ilkay Altintas, Chad Berkley, Edward A. Lee, Efrat Jaeger, Bertram Ludäscher, Matthew Jones, Jing Tao, Yang Zhao, Dan Higgins, Scientific workflow management and the Kepler system: Research Articles Concurrency and Computation: Practice and Experience. ,vol. 18, pp. 1039- 1065 ,(2006) , 10.1002/CPE.V18:10
Christopher L Felten, Jonathan S Strauss, Darren H Okada, Alberto M Marchevsky, Virtual microscopy: High resolution digital photomicrography as a tool for light microscopy simulation Human Pathology. ,vol. 30, pp. 477- 483 ,(1999) , 10.1016/S0046-8177(99)90126-0
Maryann E. Martone, Joshua Tran, Willy W. Wong, Joy Sargis, Lisa Fong, Stephen Larson, Stephan P. Lamont, Amarnath Gupta, Mark H. Ellisman, The Cell Centered Database project: An update on building community resources for managing and sharing 3D imaging data Journal of Structural Biology. ,vol. 161, pp. 220- 231 ,(2008) , 10.1016/J.JSB.2007.10.003
Bertram Ludäscher, Ilkay Altintas, Chad Berkley, Dan Higgins, Efrat Jaeger, Matthew Jones, Edward A. Lee, Jing Tao, Yang Zhao, Scientific Workflow Management and the Kepler System Concurrency and Computation: Practice and Experience. ,vol. 18, pp. 1039- 1065 ,(2006) , 10.1002/CPE.994
Michael Beynon, Chialin Chang, Umit Catalyurek, Tahsin Kurc, Alan Sussman, Henrique Andrade, Renato Ferreira, Joel Saltz, Processing large-scale multi-dimensional data in parallel and distributed environments parallel computing. ,vol. 28, pp. 827- 859 ,(2002) , 10.1016/S0167-8191(02)00097-2
P. Cudre-Mauroux, H. Kimura, K.-T. Lim, J. Rogers, R. Simakov, E. Soroush, P. Velikhov, D. L. Wang, M. Balazinska, J. Becla, D. DeWitt, B. Heath, D. Maier, S. Madden, J. Patel, M. Stonebraker, S. Zdonik, A demonstration of SciDB: a science-oriented DBMS very large data bases. ,vol. 2, pp. 1534- 1537 ,(2009) , 10.14778/1687553.1687584
Henrique Andrade, Bugra Gedik, Kun-Lung Wu, Philip S. Yu, Scale-Up Strategies for Processing High-Rate Data Streams in System S international conference on data engineering. pp. 1375- 1378 ,(2009) , 10.1109/ICDE.2009.116
Xi Zhang, T. Pan, U. Catalyurek, T. Kure, J. Saltz, Serving queries to multi-resolution datasets on disk-based storage clusters cluster computing and the grid. pp. 490- 498 ,(2004) , 10.1109/CCGRID.2004.1336605