nips nips2012 nips2012-91 nips2012-91-reference knowledge-graph by maker-knowledge-mining

91 nips-2012-Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images


Source: pdf

Author: Dan Ciresan, Alessandro Giusti, Luca M. Gambardella, Jürgen Schmidhuber

Abstract: We address a central problem of neuroanatomy, namely, the automatic segmentation of neuronal structures depicted in stacks of electron microscopy (EM) images. This is necessary to efficiently map 3D brain structure and connectivity. To segment biological neuron membranes, we use a special type of deep artificial neural network as a pixel classifier. The label of each pixel (membrane or nonmembrane) is predicted from raw pixel values in a square window centered on it. The input layer maps each window pixel to a neuron. It is followed by a succession of convolutional and max-pooling layers which preserve 2D information and extract features with increasing levels of abstraction. The output layer produces a calibrated probability for each class. The classifier is trained by plain gradient descent on a 512 × 512 × 30 stack with known ground truth, and tested on a stack of the same size (ground truth unknown to the authors) by the organizers of the ISBI 2012 EM Segmentation Challenge. Even without problem-specific postprocessing, our approach outperforms competing techniques by a large margin in all three considered metrics, i.e. rand error, warping error and pixel error. For pixel error, our approach is the only one outperforming a second human observer. 1


reference text

[1] Segmentation of neuronal structures in EM stacks challenge - ISBI 2012. http://tinyurl.com/ d2fgh7g.

[2] The Open Connectome Project. http://openconnectomeproject.org.

[3] R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. S¨ sstrunk. Slic superpixels. Technical Report u 149300 EPFL, (June), 2010.

[4] Erhan Bas, Mustafa G. Uzunbas, Dimitris Metaxas, and Eugene Myers. Contextual grouping in a concept: a multistage decision strategy for EM segmentation. In Proc. of ISBI 2012 EM Segmentation Challenge.

[5] Sven Behnke. Hierarchical Neural Networks for Image Interpretation, volume 2766 of Lecture Notes in Computer Science. Springer, 2003.

[6] Davi D. Bock, Wei-Chung A. Lee, Aaron M. Kerlin, Mark L. Andermann, Greg Hood, Arthur W. Wetzel, Sergey Yurgenson, Edward R. Soucy, Hyon S. Kim, and R. Clay Reid. Network anatomy and in vivo physiology of visual cortical neurons. Nature, 471(7337):177–182, 2011.

[7] Y. Boykov, O. Veksler, and R. Zabih. Fast approximate energy minimization via graph cuts. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 23(11):1222–1239, 2001.

[8] Radim Burget, Vaclav Uher, and Jan Masek. Trainable Segmentation Based on Local-level and Segmentlevel Feature Extraction. In Proc. of ISBI 2012 EM Segmentation Challenge.

[9] Albert Cardona, Stephan Saalfeld, Stephan Preibisch, Benjamin Schmid, Anchi Cheng, Jim Pulokas, Pavel Tomancak, and Volker Hartenstein. An integrated micro- and macroarchitectural analysis of the drosophila brain by computer-assisted serial section electron microscopy. PLoS Biol, 8(10):e1000502, 10 2010.

[10] Dan Claudiu Ciresan, Ueli Meier, Luca Maria Gambardella, and J¨ rgen Schmidhuber. Deep, big, simple u neural nets for handwritten digit recognition. Neural Computation, 22(12):3207–3220, 2010.

[11] Dan Claudiu Ciresan, Ueli Meier, Luca Maria Gambardella, and J¨ rgen Schmidhuber. Convolutional u neural network committees for handwritten character classification. In International Conference on Document Analysis and Recognition, pages 1250–1254, 2011.

[12] Dan Claudiu Ciresan, Ueli Meier, Jonathan Masci, Luca Maria Gambardella, and J¨ rgen Schmidhuber. u Flexible, high performance convolutional neural networks for image classification. In International Joint Conference on Artificial Intelligence, pages 1237–1242, 2011.

[13] Dan Claudiu Ciresan, Ueli Meier, and J¨ rgen Schmidhuber. Multi-column deep neural networks for image u classification. In Computer Vision and Pattern Recognition, pages 3642–3649, 2012.

[14] C.A. Curcio, K.R. Sloan, R.E. Kalina, and A.E. Hendrickson. Human photoreceptor topography. The Journal of comparative neurology, 292(4):497–523, 1990.

[15] A. Foi and G. Boracchi. Foveated self-similarity in nonlocal image filtering. In Proceedings of SPIE, volume 8291, page 829110, 2012.

[16] Kunihiko Fukushima. Neocognitron: A self-organizing neural network for a mechanism of pattern recognition unaffected by shift in position. Biological Cybernetics, 36(4):193–202, 1980.

[17] G. Gonz´ lez, F. Fleurety, and P. Fua. Learning rotational features for filament detection. In Computer a Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 1582–1589. IEEE, 2009.

[18] Saadia Iftikhar and Afzal Godil. The Detection of Neuronal Structures using a Patch-based Multi-features and Support Vector Machines Learning Algorithm. In Proc. of ISBI 2012 EM Segmentation Challenge.

[19] Viren Jain, Benjamin Bollmann, Mark Richardson, Daniel R. Berger, Moritz Helmstaedter, Kevin L. Briggman, Winfried Denk, Jared B. Bowden, John M. Mendenhall, Wickliffe C. Abraham, Kristen M. Harris, N. Kasthuri, Ken J. Hayworth, Richard Schalek, Juan Carlos Tapia, Jeff W. Lichtman, and H. Sebastian Seung. Boundary Learning by Optimization with Topological Constraints. In CVPR, pages 2488–2495. IEEE, 2010. 8

[20] Lee Kamentsky. Segmentation of EM images of neuronal structures using CellProfiler. In Proc. of ISBI 2012 EM Segmentation Challenge.

[21] Bobby Kasthuri. Mouse Visual Cortex Dataset in the Open Connectome Project. openconnectomeproject.org/Kasthuri11/. http://

[22] V. Kaynig, T. Fuchs, and J. Buhmann. Geometrical consistent 3D tracing of neuronal processes in ssTEM data. Medical Image Computing and Computer-Assisted Intervention–MICCAI 2010, pages 209–216, 2010.

[23] V. Kaynig, T. Fuchs, and J.M. Buhmann. Neuron geometry extraction by perceptual grouping in sstem images. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 2902– 2909. IEEE, 2010.

[24] Dmitry Laptev, Alexander Vezhnevets, Sarvesh Dwivedi, and Joachim Buhmann. Segmentation of Neuronal Structures in EM stacks. In Proc. of ISBI 2012 EM Segmentation Challenge.

[25] Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278–2324, November 1998.

[26] Ting Liu, Mojtaba Seyedhosseini, Elizabeth Jurrus, and Tolga Tasdizen. Neuron Segmentation in EM Images using Series of Classifiers and Watershed Tree. In Proc. of ISBI 2012 EM Segmentation Challenge.

[27] A. Lucchi, K. Smith, R. Achanta, G. Knott, and P. Fua. Supervoxel-Based Segmentation of Mitochondria in EM Image Stacks With Learned Shape Features. Medical Imaging, IEEE Transactions on, (99):1–1, 2012.

[28] A. Lucchi, K. Smith, R. Achanta, V. Lepetit, and P. Fua. A fully automated approach to segmentation of irregularly shaped cellular structures in EM images. Medical Image Computing and Computer-Assisted Intervention–MICCAI 2010, pages 463–471, 2010.

[29] W.M. Rand. Objective criteria for the evaluation of clustering methods. Journal of the American Statistical association, 66(336):846–850, 1971.

[30] Maximiliam Riesenhuber and Tomaso Poggio. Hierarchical models of object recognition in cortex. Nat. Neurosci., 2(11):1019–1025, 1999.

[31] Dominik Scherer, Adreas M¨ ller, and Sven Behnke. Evaluation of pooling operations in convolutional u architectures for object recognition. In International Conference on Artificial Neural Networks, 2010.

[32] Thomas Serre, Lior Wolf, and Tomaso Poggio. Object recognition with features inspired by visual cortex. In Proc. of Computer Vision and Pattern Recognition Conference, 2005.

[33] Patrice Y. Simard, Dave. Steinkraus, and John C. Platt. Best practices for convolutional neural networks applied to visual document analysis. In Seventh International Conference on Document Analysis and Recognition, pages 958–963, 2003.

[34] K. Smith, A. Carleton, and V. Lepetit. Fast ray features for learning irregular shapes. In Computer Vision, 2009 IEEE 12th International Conference on, pages 397–404. IEEE, 2009.

[35] Daniel Strigl, Klaus Kofler, and Stefan Podlipnig. Performance and scalability of GPU-based convolutional neural networks. In 18th Euromicro Conference on Parallel, Distributed, and Network-Based Processing, 2010.

[36] Xiao Tan and Changming Sun. Membrane extraction using two-step classification and post-processing. In Proc. of ISBI 2012 EM Segmentation Challenge. 9