nips nips2013 nips2013-256 nips2013-256-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Miaomiao Zhang, P.T. Fletcher
Abstract: Principal geodesic analysis (PGA) is a generalization of principal component analysis (PCA) for dimensionality reduction of data on a Riemannian manifold. Currently PGA is defined as a geometric fit to the data, rather than as a probabilistic model. Inspired by probabilistic PCA, we present a latent variable model for PGA that provides a probabilistic framework for factor analysis on manifolds. To compute maximum likelihood estimates of the parameters in our model, we develop a Monte Carlo Expectation Maximization algorithm, where the expectation is approximated by Hamiltonian Monte Carlo sampling of the latent variables. We demonstrate the ability of our method to recover the ground truth parameters in simulated sphere data, as well as its effectiveness in analyzing shape variability of a corpus callosum data set from human brain images. 1
[1] F. R. Bach and M. I. Jordan. A probabilistic interpretation of canonical correlation analysis. Technical Report 608, Department of Statistics, University of California, Berkeley, 2005.
[2] A. Bhattacharya and D. B. Dunson. Nonparametric bayesian density estimation on manifolds with applications to planar shapes. Biometrika, 97(4):851–865, 2010.
[3] C. M. Bishop. Bayesian PCA. Advances in neural information processing systems, pages 382–388, 1999.
[4] S. Byrne and M. Girolami. Geodesic Monte Carlo on embedded manifolds. arXiv preprint arXiv:1301.6064, 2013.
[5] N. Courty, T. Burger, and P. F. Marteau. Geodesic analysis on the Gaussian RKHS hypersphere. In Machine Learning and Knowledge Discovery in Databases, pages 299–313, 2012.
[6] M. do Carmo. Riemannian Geometry. Birkh¨ user, 1992. a
[7] A. Edelman, T. A Arias, and S. T Smith. The geometry of algorithms with orthogonality constraints. SIAM journal on Matrix Analysis and Applications, 20(2):303–353, 1998.
[8] P. T. Fletcher. Geodesic regression and the theory of least squares on Riemannian manifolds. International Journal of Computer Vision, pages 1–15, 2012.
[9] P. T. Fletcher and S. Joshi. Principal geodesic analysis on symmetric spaces: statistics of diffusion tensors. In Workshop on Computer Vision Approaches to Medical Image Analysis (CVAMIA), 2004. 8
[10] P. T. Fletcher, C. Lu, and S. Joshi. Statistics of shape via principal geodesic analysis on Lie groups. In Computer Vision and Pattern Recognition, pages 95–101, 2003.
[11] S. Huckemann and H. Ziezold. Principal component analysis for Riemannian manifolds, with an application to triangular shape spaces. Advances in Applied Probability, 38(2):299–319, 2006.
[12] I. T. Jolliffe. Principal Component Analysis, volume 487. Springer-Verlag New York, 1986.
[13] S. Jung, I. L. Dryden, and J. S. Marron. Analysis of principal nested spheres. Biometrika, 99(3):551–568, 2012.
[14] D. G. Kendall. Shape manifolds, Procrustean metrics, and complex projective spaces. Bulletin of the London Mathematical Society, 16:18–121, 1984.
[15] N. D. Lawrence. Gaussian process latent variable models for visualisation of high dimensional data. Advances in neural information processing systems, 16:329–336, 2004.
[16] K. V. Mardia. Directional Statistics. John Wiley and Sons, 1999.
[17] X. Pennec. Intrinsic statistics on Riemannian manifolds: basic tools for geometric measurements. Journal of Mathematical Imaging and Vision, 25(1), 2006.
[18] S. Roweis. EM algorithms for PCA and SPCA. Advances in neural information processing systems, pages 626–632, 1998.
[19] S. Said, N. Courty, N. Le Bihan, and S. J. Sangwine. Exact principal geodesic analysis for data on SO(3). In Proceedings of the 15th European Signal Processing Conference, pages 1700–1705, 2007.
[20] B. Sch¨ lkopf, A. Smola, and K. R. M¨ ller. Nonlinear component analysis as a kernel eigeno u value problem. Neural Computation, 10(5):1299–1319, 1998.
[21] S. Sommer, F. Lauze, S. Hauberg, and M. Nielsen. Manifold valued statistics, exact principal geodesic analysis and the effect of linear approximations. In Proceedings of the European Conference on Computer Vision, pages 43–56, 2010.
[22] M. E. Tipping and C. M. Bishop. Probabilistic principal component analysis. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 61(3):611–622, 1999.
[23] P. Turaga, A. Veeraraghavan, A. Srivastava, and R. Chellappa. Statistical computations on Grassmann and Stiefel manifolds for image and video-based recognition. IEEE Trans. Pattern Analysis and Machine Intelligence, 33(11):2273–2286, 2011.
[24] O. Tuzel, F. Porikli, and P. Meer. Pedestrian detection via classification on Riemannian manifolds. IEEE Trans. Pattern Analysis and Machine Intelligence, 30(10):1713–1727, 2008.
[25] M. Zhang, N. Singh, and P. T. Fletcher. Bayesian estimation of regularization and atlas building in diffeomorphic image registration. In Information Processing in Medical Imaging, pages 37– 48. Springer, 2013. 9