cvpr cvpr2013 cvpr2013-255 cvpr2013-255-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Roberto Rigamonti, Amos Sironi, Vincent Lepetit, Pascal Fua
Abstract: Learning filters to produce sparse image representations in terms of overcomplete dictionaries has emerged as a powerful way to create image features for many different purposes. Unfortunately, these filters are usually both numerous and non-separable, making their use computationally expensive. In this paper, we show that such filters can be computed as linear combinations of a smaller number of separable ones, thus greatly reducing the computational complexity at no cost in terms of performance. This makes filter learning approaches practical even for large images or 3D volumes, and we show that we significantly outperform state-of-theart methods on the linear structure extraction task, in terms ofboth accuracy and speed. Moreover, our approach is general and can be used on generic filter banks to reduce the complexity of the convolutions.
[1] E. Acar, D. M. Dunlavy, and T. G. Kolda. A Scalable Optimization Approach for Fitting Canonical Tensor Decompositions. Journal of Chemometrics, 2011.
[2] G. Ascoli, K. Svoboda, and Y. Liu. Digital Reconstruction of Axonal and Dendritic Morphology DIADEM Challenge, 2010.
[3] F. Bach, R. Jenatton, J. Mairal, and G. Obozienski. Optimization with Sparsity-Inducing Penalties. Technical report, INRIA, 2011.
[4] G. Ben-Artzi, H. Hel-Or, and Y. Hel-Or. The Gray-Code Filter Ker-
[5]
[6]
[7]
[8]
[9]
[10]
[11]
[12]
[13]
[14]
[15]
[16]
[17]
[18]
[19]
[20] nels. PAMI, 2007. Y. Bengio. Learning Deep Architectures for AI. Now Publishers, 2009. C. Bishop. Pattern Recognition and Machine Learning. Springer, 2006. L. Breiman. Random Forests. Machine Learning, 2001. A. Coates and A. Ng. The Importance of Encoding Versus Training with Sparse Coding and Vector Quantization. In ICML, 2011. M. Elad and M. Aharon. Image Denoising via Sparse and Redundant Representations Over Learned Dictionaries. TIP, 2006. C. Farabet, B. Martini, P. Akselrod, S. Talay, Y. LeCun, and E. Culurciello. Hardware Accelerated Convolutional Neural Networks for Synthetic Vision Systems. In International Symposium on Circuits and Systems, 2010. M. Fazel, H. Hindi, and S. Boyd. A Rank Minimization Heuristic with Application to Minimum Order System Approximation. In ACC, 2001. W. Freeman and E. Adelson. The Design and Use of Steerable Filters. PAMI, 1991 . G. Gonzalez, F. Fleuret, and P. Fua. Learning Rotational Features for Filament Detection. In CVPR, 2009. C. Gotsman. ConstantTime Filtering by Singular Value Decomposition. Computer Graphics Forum, 1994. T. Hazan, S. Polak, and A. Shashua. Sparse Image Coding Using a 3D Non-Negative Tensor Factorization. In ICCV, 2005. G. Hinton. Learning to Represent Visual Input. Philosophical Transactions of the Royal Society, 2010. A. Hoover, V. Kouznetsova, and M. Goldbaum. Location Blood Vessels in Retinal Images by Piecewise Threshold Probing of a Matched Filter Response. TMI, 2000. K. Kavukcuoglu, P. Sermanet, Y.-L. Boureau, K. Gregor, M. Mathieu, and Y. LeCun. Learning Convolutional Feature Hierarchies for Visual Recognition. In NIPS, 2010. T. G. Kolda and B. W. Bader. Tensor Decompositions and Applications. SIAM Review, 2009. M. Law and A. Chung. Three Dimensional Curvilinear Structure
[21]
[22]
[23]
[24]
[25]
[26]
[27]
[28]
[29]
[30]
[31]
[32]
[33]
[34]
[35]
[36] Detection Using Optimally Oriented Flux. In ECCV, 2008. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-Based Learning Applied to Document Recognition. PIEEE, 1998. Y. LeCun, L. Bottou, G. Orr, and K.-R. M ¨uller. Efficient Backprop. Springer, 1998. H. Lee, R. Grosse, R. Ranganath, and A. Ng. Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical Representations. In ICML, 2009. J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman. Non-Local Sparse Models for Image Restoration. In ICCV, 2009. F. Mamalet and C. Garcia. Simplifying Convnets for Fast Learning. In ICANN, 2012. V. Mnih and G. Hinton. Learning to Detect Roads in High-Resolution Aerial Images. In ECCV, 2010. B. Olshausen and D. Field. Sparse Coding with an Overcomplete Basis Set: A Strategy Employed by V1? Vision Research, 1997. P. Perona. Deformable Kernels for Early Vision. PAMI, 1995. H. Pirsiavash and D. Ramanan. Steerable Part Models. In CVPR, 2012. R. Rigamonti, M. Brown, and V. Lepetit. Are Sparse Representations Really Relevant for Image Classification? In CVPR, 2011. R. Rigamonti, E. T ¨uretken, G. Gonz a´lez, P. Fua, and V. Lepetit. Filter Learning for Linear Structure Segmentation. Technical report, EPFL, 2011. R. Rubinstein, M. Zibulevsky, and M. Elad. Double Sparsity: Learning Sparse Dictionaries for Sparse Signal Approximation. SP, 2010. A. Santamar ı´a-Pang, C. Colbert, P. Saggau, and I. Kakadiaris. Automatic Centerline Extraction of Irregular Tubular Structures Using Probability Volumes from Multiphoton Imaging. In MICCAI, 2007. J. Staal, M. Abramoff, M. Niemeijer, M. Viergever, and B. van Ginneken. Ridge Based Vessel Segmentation in Color Images of the Retina. TMI, 2004. S. Treitel and J. Shanks. The Design of Multistage Separable Planar Filters. IEEE Transactions on Geoscience Electronics, 197 1. C. van Rijsbergen. Foundation of Evaluation. Journal of Documentation, 1974.
[37] M. A. O. Vasilescu and D. Terzopoulos. Multilinear Analysis of Image Ensembles: Tensorfaces. In ECCV, 2002.
[38] J. Wright, Y. Ma, J. Mairal, G. Sapiro, T. S. Huang, and S. Yan. Sparse Representation for Computer Vision and Pattern Recognition. Proc. IEEE, 2010.
[39] M. Zeiler, D. Krishnan, G. Taylor, and R. Fergus. Deconvolutional Networks. In CVPR, 2010. 222777556199