iccv iccv2013 iccv2013-257 iccv2013-257-reference knowledge-graph by maker-knowledge-mining

257 iccv-2013-Log-Euclidean Kernels for Sparse Representation and Dictionary Learning


Source: pdf

Author: Peihua Li, Qilong Wang, Wangmeng Zuo, Lei Zhang

Abstract: The symmetric positive de?nite (SPD) matrices have been widely used in image and vision problems. Recently there are growing interests in studying sparse representation (SR) of SPD matrices, motivated by the great success of SR for vector data. Though the space of SPD matrices is well-known to form a Lie group that is a Riemannian manifold, existing work fails to take full advantage of its geometric structure. This paper attempts to tackle this problem by proposing a kernel based method for SR and dictionary learning (DL) of SPD matrices. We disclose that the space of SPD matrices, with the operations of logarithmic multiplication and scalar logarithmic multiplication de?ned in the Log-Euclidean framework, is a complete inner product space. We can thus develop a broad family of kernels that satis?es Mercer’s condition. These kernels characterize the geodesic distance and can be computed ef?ciently. We also consider the geometric structure in the DL process by updating atom matrices in the Riemannian space instead of in the Euclidean space. The proposed method is evaluated with various vision problems and shows notable per- formance gains over state-of-the-arts.


reference text

[1] V. Arsigny, P. Fillard, X. Pennec, and N. Ayache. Geometric means in a novel vector space structure on symmetric positive-de?nite matrices. SIAM J. on Matrix Analysis and Applications, 2006.

[2] C. Berg, J. P. R. Christensen, and P. Ressel. Harmonic Analysis on Semigroups : Theory of Positive De?nite and Related Functions. Springer, 1984.

[3] J. Bigun and G. Granlund. Optimal orientation detection of linear symmetry. In ICCV, pages 433–438, 1987.

[4] D. L. Bihan, J. Mangin, C. Poupon, C. Clark, S. Pappata, and N. Molko. Diffusion tensor imaging: Concepts and applications. J. Magn. Reson. Imaging, 13(4):534–546, 2001.

[5] J. Carreira, R. Caseiro, J. Batista, and C. Sminchisescu. Semantic segmentation with second-order pooling. In ECCV, pages 430–443, 2012.

[6] R. Caseiro, J. F. Henriques, P. Martins, and J. Batista. A nonparametric Riemannian framework on tensor ?eld with application to foreground segmentation. In ICCV, pages 1– 8, 2011.

[7] C.-C. Chang and C.-J. Lin. LIBSVM: A library for support vector machines. ACM Trans. Intell. Syst. Technol., 2(3):27: 1–27:27.

[8] M. Elad. Sparse and Redundant Representations: From Theory to Applications in Signal and Image Processing. Springer, 2010.

[9] W. T. Freeman and M. Roth. Orientation histograms for hand

[10]

[11]

[12]

[13]

[14]

[15]

[16]

[17]

[18]

[19]

[20] gesture recognition. In International Workshop on Automatic Face and Gesture Recognition, pages 296–301, 1994. S. Gao, I. Tsang, and L.-T. Chia. Sparse representation with kernels. TIP, 22(2):423–434, 2013. K. Guo, P. Ishwar, and J. Konrad. Action recognition using sparse representation on covariance manifolds of optical ?ow. In AVSS, pages 188–195, 2010. M. T. Harandi, C. Sanderson, R. Hartley, and B. C. Lovell. Sparse coding and dictionary learning for symmetric positive de?nite matrices: a kernel approach. In ECCV(2), 2012. T. Hofmann, B. Sch o¨lkopf, and A. J. Smola. Kernel methods in machine learning. Annals of Statistics, 36(3): 1171–1220, 2008. S. Jayasumana, R. Hartley, M. Salzmann, H. Li, and M. Harandi. Kernel methods on the riemannian manifold of symmetric positive de?nite matrices. In CVPR, 2013. B. Kulis, M. A. Sustik, and I. S. Dhillon. Low-rank kernel learning with bregman matrix divergences. JMLR, 10:341 376, 2009. S. Lazebnik, C. Schmid, and J. Ponce. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In CVPR, 2006. L. Liu and P. Fieguth. Texture classi?cation from random features. PAMI, 34:574 – 586, 2012. Y. Pang, Y. Yuan, and X. Li. Gabor-based region covariance matrices for face recognition. TCSVT, 18(7):989–993, 2008. X. Pennec, P. Fillard, and N. Ayache. A Riemannian framework for tensor computing. IJCV, 66(1):41–66, 2006. P. J. Phillips, H. Moon, S. A. Rizvi, and P. J. Rauss. The feret evaluation methodology for face-recognition algorithms. PAMI, 22(10): 1090–1 104, 2000.

[21] T. Randen and J. Husoy. Filtering for texture classi?cation: a comparative study. PAMI, 21(4):291–3 10, 1999.

[22] R. Sivalingam, D. Boley, V. Morellas, and N. Papanikolopoulos. Tensor sparse coding for region covariances. In ECCV (4), pages 722–735, 2010.

[23] R. Sivalingam, D. Boley, V. Morellas, and N. Papanikolopoulos. Positive de?nite dictionary learning for region covariances. In ICCV, pages 1013–1019, 2011.

[24] S. Sra. Positive de?nite matrices and the symmetric stein divergence. arXiv:1110.1773, 2012.

[25] S. Sra and A. Cherian. Generalized dictionary learning for symmetric positive de?nite matrices with application to nearest neighbor retrieval. In ECML PKDD(3), pages 3 18–332, 2011.

[26] A. E. Taylor and D. C. Lay. Introduction to functional analysis, 2nd ed. Krieger Publishing Co., Inc., 1986.

[27] O. Tuzel, F. Porikli, and P. Meer. Region covariance: A fast descriptor for detection and classi?cation. In ECCV, pages 589–600, 2006.

[28] R. Vemulapalli, J. Pillai, and R. Chellappa. Kernel learning for extrinsic classi?cation of manifold features. In CVPR, 2013.

[29] J. Weichert and H. Hagen, editors. Visualization and image processing of tensor ?elds. Springer, 2006.

[30] J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma. Robust face recognition via sparse representation. PAMI, 31(2):210–227, 2009.

[31] Y. Xie, B. C. Vemuri, and J. Ho. Statistical analysis of tensor ?elds. In MICCAI’10, pages 682–689, 2010.

[32] J. Yang, K. Yu, Y. Gong, and T. Huang. Linear spatial pyramid matching using sparse coding for image classi?cation. In CVPR, 2009.

[33] M. Yang and L. Zhang. Gabor feature based sparse representation for face recognition with gabor occlusion dictionary. In ECCV, pages 448–461, 2010.

[34] C. Yuan, W. Hu, X. Li, S. Maybank, and G. Luo. Action recognition using sparse representation on covariance manifolds of optical ?ow. In ACCV, pages 343–353, 2009. 11660088