nips nips2003 nips2003-138 nips2003-138-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Jakob J. Verbeek, Sam T. Roweis, Nikos A. Vlassis
Abstract: We propose a non-linear Canonical Correlation Analysis (CCA) method which works by coordinating or aligning mixtures of linear models. In the same way that CCA extends the idea of PCA, our work extends recent methods for non-linear dimensionality reduction to the case where multiple embeddings of the same underlying low dimensional coordinates are observed, each lying on a different high dimensional manifold. We also show that a special case of our method, when applied to only a single manifold, reduces to the Laplacian Eigenmaps algorithm. As with previous alignment schemes, once the mixture models have been estimated, all of the parameters of our model can be estimated in closed form without local optima in the learning. Experimental results illustrate the viability of the approach as a non-linear extension of CCA. 1
[1] J.B. Tenenbaum, V. de Silva, and J.C. Langford. A global geometric framework for nonlinear dimensionality reduction. Science, 290(5500):2319–2323, December 2000.
[2] S.T. Roweis and L.K. Saul. Nonlinear dimensionality reduction by locally linear embedding. Science, 290(5500):2323–2326, December 2000.
[3] B. Sch¨ lkopf, A.J. Smola, and K. M¨ ller. Nonlinear component analysis as a kernel eigenvalue o u problem. Neural Computation, 10:1299–1319, 1998.
[4] M. Belkin and P. Niyogi. Laplacian eigenmaps and spectral techniques for embedding and clustering. In Advances in Neural Information Processing Systems, volume 14, 2002.
[5] C. Bregler and S.M. Omohundro. Surface learning with applications to lipreading. In Advances in Neural Information Processing Systems, volume 6, 1994.
[6] S.T. Roweis, L.K. Saul, and G.E. Hinton. Global coordination of local linear models. In Advances in Neural Information Processing Systems, volume 14, 2002.
[7] Y.W. Teh and S.T. Roweis. Automatic alignment of local representations. In Advances in Neural Information Processing Systems, volume 15, 2003.
[8] M. Brand. Charting a manifold. In Advances in Neural Information Processing Systems, volume 15, 2003.
[9] C.M. Bishop, M. Svens´ n, and C.K.I Williams. GTM: the generative topographic mapping. e Neural Computation, 10:215–234, 1998.
[10] T. Kohonen. Self-organizing maps. Springer, 2001.
[11] J.H. Ham, D.D. Lee, and L.K. Saul. Learning high dimensional correspondences from low dimensional manifolds. In ICML’03, workshop on the continuum from labeled to unlabeled data in machine learning and data mining, 2003.
[12] G. Peters, B. Zitova, and C. von der Malsburg. How to measure the pose robustness of object views. Image and Vision Computing, 20(4):249–256, 2002.