Efficient Convolutional Neural Networks for Pixelwise Classification on Heterogeneous Hardware Systems

作者: Fabian Tschopp

DOI:

关键词: Computer hardwareComputer scienceSet (abstract data type)Artificial intelligencePattern recognitionHistogramConvolutional neural networkInterface (computing)Artificial neural networkPipeline (computing)Softmax functionSliding window protocol

摘要: This work presents and analyzes three convolutional neural network (CNN) models for efficient pixelwise classification of images. When using networks to classify single pixels in patches a whole image, lot redundant computations are carried out when sliding window networks. set new architectures solve this issue by either removing or fully that inherently predict many at once. The implementations the accessible through utility on top Caffe library. The provides support wide range image input output formats, pre-processing parameters methods equalize label histogram during training. library has been extended layers backend availability wider hardware such as CPUs GPUs OpenCL. On AMD GPUs, speedups $54\times$ (SK-Net), $437\times$ (U-Net) $320\times$ (USK-Net) have observed, taking SK equivalent SW (sliding window) baseline. throughput is up one megapixel per second. analyzed distinctive characteristics apply training processing, not every data suitable architecture. quality predictions assessed two tissue sets, which ISBI 2012 challenge set. Two different loss functions, Malis Softmax loss, were used pipeline, consisting models, interface modified library, available Open Source software under working title Project Greentea.

参考文章(9)
Hongsheng Li, Xiaogang Wang, Rui Zhao, Highly Efficient Forward and Backward Propagation of Convolutional Neural Networks for Pixelwise Classification arXiv: Computer Vision and Pattern Recognition. ,(2014)
Evan Shelhamer, John Tran, Jonathan Cohen, Sharan Chetlur, Philippe Vandermersch, Cliff Woolley, Bryan Catanzaro, cuDNN: Efficient Primitives for Deep Learning arXiv: Neural and Evolutionary Computing. ,(2014)
Srinivas C. Turaga, Kevin L. Briggman, Winfried Denk, Moritz Helmstaedter, H. Sebastian Seung, Maximin affinity learning of image segmentation arXiv: Computer Vision and Pattern Recognition. ,(2009)
Serkan Piantino, Nicolas Vasilache, Yann LeCun, Jeff Johnson, Soumith Chintala, Michael Mathieu, Fast Convolutional Nets With fbfft: A GPU Performance Evaluation arXiv: Learning. ,(2014)
Philipp Fischer, Thomas Brox, None, U-Net: Convolutional Networks for Biomedical Image Segmentation medical image computing and computer assisted intervention. pp. 234- 241 ,(2015) , 10.1007/978-3-319-24574-4_28
Albert Cardona, Stephan Saalfeld, Stephan Preibisch, Benjamin Schmid, Anchi Cheng, Jim Pulokas, Pavel Tomancak, Volker Hartenstein, An Integrated Micro- and Macroarchitectural Analysis of the Drosophila Brain by Computer-Assisted Serial Section Electron Microscopy PLoS Biology. ,vol. 8, pp. e1000502- ,(2010) , 10.1371/JOURNAL.PBIO.1000502
Viren Jain, Benjamin Bollmann, Mark Richardson, Daniel R Berger, Moritz N Helmstaedter, Kevin L Briggman, Winfried Denk, Jared B Bowden, John M Mendenhall, Wickliffe C Abraham, Kristen M Harris, Narayanan Kasthuri, Ken J Hayworth, Richard Schalek, Juan Carlos Tapia, Jeff W Lichtman, H Sebastian Seung, None, Boundary Learning by Optimization with Topological Constraints computer vision and pattern recognition. pp. 2488- 2495 ,(2010) , 10.1109/CVPR.2010.5539950
Martel Julien, Gerhard Stephan, Funke Jan, Fetter Richard, Cardona Albert, Segmented anisotropic ssTEM dataset of neural tissue figshare. pp. 0- 0 ,(2013) , 10.6084/M9.FIGSHARE.856713.V1
Evan Shelhamer, Sergey Karayev, Yangqing Jia, Jonathan Long, Jeff Donahue, Sergio Guadarrama, Trevor Darrell, Ross Girshick, Caffe: Convolutional Architecture for Fast Feature Embedding arXiv: Computer Vision and Pattern Recognition. ,(2014)