nips nips2002 nips2002-97 nips2002-97-reference knowledge-graph by maker-knowledge-mining

97 nips-2002-Global Versus Local Methods in Nonlinear Dimensionality Reduction


Source: pdf

Author: Vin D. Silva, Joshua B. Tenenbaum

Abstract: Recently proposed algorithms for nonlinear dimensionality reduction fall broadly into two categories which have different advantages and disadvantages: global (Isomap [1]), and local (Locally Linear Embedding [2], Laplacian Eigenmaps [3]). We present two variants of Isomap which combine the advantages of the global approach with what have previously been exclusive advantages of local methods: computational sparsity and the ability to invert conformal maps.


reference text

[1] Tenenbaum, J.B., de Silva, V. & Langford, J.C (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290: 2319–2323.

[2] Roweis, S. & Saul, L. (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290: 2323–2326.

[3] Belkin, M. & Niyogi, P. (2002) Laplacian eigenmaps and spectral techniques for embedding and clustering. In T.G. Dietterich, S. Becker and Z. Ghahramani (eds.), Advances in Neural Information Processing Systems 14. MIT Press.

[4] Bishop, C., Svensen, M. & Williams, C. (1998) GTM: The generative topographic mapping. Neural Computation 10(1).

[5] Kohonen, T. (1984) Self Organisation and Associative Memory. Springer-Verlag, Berlin.

[6] Bregler, C. & Omohundro, S.M. (1995) Nonlinear image interpolation using manifold learning. In G. Tesauro, D.S. Touretzky & T.K. Leen (eds.), Advances in Neural Information Processing Systems 7: 973–980. MIT Press.

[7] DeMers, D. & Cottrell, G. (1993) Non-linear dimensionality reduction In S. Hanson, J. Cowan & L. Giles (eds.), Advances in Neural Information Processing Systems 5: 580–590. Morgan-Kaufmann.

[8] Bernstein, M., de Silva, V., Langford, J.C. & Tenenbaum, J.B. (December 2000) Graph approximations to geodesics on embedded manifolds. Preprint may be downloaded at the URL: http://isomap.stanford.edu/BdSLT.pdf

[9] Torgerson, W.S. (1958) Theory and Methods of Scaling. Wiley, New York.

[10] Cox, T.F. & Cox M.A.A. (1994) Multidimensional Scaling. Chapman & Hall, London.

[11] de Silva, V. & Tenenbaum, J.B. (in preparation) Sparse multidimensional scaling using landmark points.