nips nips2006 nips2006-127 nips2006-127-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Zhenyue Zhang, Jing Wang
Abstract: The locally linear embedding (LLE) is improved by introducing multiple linearly independent local weight vectors for each neighborhood. We characterize the reconstruction weights and show the existence of the linearly independent weight vectors at each neighborhood. The modified locally linear embedding (MLLE) proposed in this paper is much stable. It can retrieve the ideal embedding if MLLE is applied on data points sampled from an isometric manifold. MLLE is also compared with the local tangent space alignment (LTSA). Numerical examples are given that show the improvement and efficiency of MLLE. 1
[1] D. Donoho and C. Grimes. Hessian Eigenmaps: new tools for nonlinear dimensionality reduction. Proceedings of National Academy of Science, 5591-5596, 2003 2 The data set can be downloaded at http://www.cs.toronto.edu/ roweis/data.html. LLE MLLE 5 3 4 2.5 3 2 2 1.5 1 1 0 0.5 −1 0 −2 −0.5 −3 −1 −4 −5 −1.5 −1 −0.5 0 0.5 1 1.5 2 2.5 −1.5 −1.5 −1 −0.5 0 0.5 1 1.5 2 2.5 Figure 5: Embedding results of N = 4400 handwritten digits by LLE(left) and MLLE(right). Figure 6: Images of faces mapped into the embedding described by the first two coordinates of MLLE, using the parameters k = 14 and d = 3.
[2] M. Brand. Charting a manifold. Advances in Neural Information Processing Systems, 15, MIT Press, 2003
[3] Jihun Ham, Daniel D. Lee, Sebastian Mika, Bernhard Scholkopf. A kernel view of the dimensionality reduction of manifolds. International Conference On Machine Learning 21, 2004.
[4] G. H. Golub and C. F Van Loan. Matrix Computations. Johns Hopkins University Press, Baltimore, Maryland, 3nd edition, 1996.
[5] S. Roweis and L Saul. Nonlinear dimensionality reduction by locally linear embedding. Science, 290: 2323–2326, 2000.
[6] L. Saul and S. Roweis. Think globally, fit locally: unsupervised learning of nonlinear manifolds. Journal of Machine Learning Research, 4:119-155, 2003.
[7] J Tenenbaum, V. De Silva and J. Langford. A global geometric framework for nonlinear dimension reduction. Science, 290:2319–2323, 2000
[8] J. Wang, Z. Zhang and H. Zha. Adaptive Manifold Learning. Advances in Neural Information Processing Systems 17, edited by Lawrence K. Saul and Yair Weiss and L´ on Bottou, MIT e Press, Cambridge, MA, pp.1473-1480, 2005.
[9] Z. Zhang and H. Zha. Principal Manifolds and Nonlinear Dimensionality Reduction via Tangent Space Alignment. SIAM J. Scientific Computing, 26(1):313–338, 2004.
[10] H. Zha and Z. Zhang. Spectral Analysis of Alignment in Manifold Learning. Submitted, 2006.
[11] M. Vlachos, C. Domeniconi, D. Gunopulos, G. Kollios, and N. Koudas Non-Linear Dimensionality Reduction Techniques for Classification and Visualization Proc. Eighth ACM SIGKDD Int’l Conf. Knowledge Discovery and Data Mining, July 2002.