nips nips2009 nips2009-146 nips2009-146-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Wei Bian, Dacheng Tao
Abstract: In this paper, we study the manifold regularization for the Sliced Inverse Regression (SIR). The manifold regularization improves the standard SIR in two aspects: 1) it encodes the local geometry for SIR and 2) it enables SIR to deal with transductive and semi-supervised learning problems. We prove that the proposed graph Laplacian based regularization is convergent at rate root-n. The projection directions of the regularized SIR are optimized by using a conjugate gradient method on the Grassmann manifold. Experimental results support our theory.
[1] Belkin, M. & Niyogi, P. (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Computation, 15(6): 1373-1396.
[2] Belkin, M., Niyogi, P. & Sindhwani, V. (2006) Manifold regularization: Ageometric framework for learning from labeled and unlabeled examples. Journal of Machine Learning Research, 1: 1-48.
[3] Cook, R.D.(2004) Testing predictor contributions in sufficient dimension reduction. Annals of Statistics, 32: 1061-1092.
[4] Edelman, A., Arias, T.A., & Smith, S.T. (1998) The geometry of algorithms with orthogonality constraints. SIAM J. Matrix Anal. Appl., 20(2):303-353.
[5] Hastie, T., Buja, A., & Tibshirani, R. (1995) Penalized discriminant analysis. Annals of Statistics, 2: 73-102.
[6] He, X., Deng, C., & Min, W. (2005) Statistical and computational analysis of locality preserving projection. In 22th International Conference on Machine Learning (ICML).
[7] Li, K. (1991) Sliced inverse regression for dimension reduction (with discussion). J. Amer. Statist. Assoc., 86:316-342.
[8] Li, L. (2007). Sparse sufficient dimension reduction. Biometrika 94(3): 603-613.
[9] Li, L., & YIN, X. (2008). Sliced inverse regression with regularizations. Biometrics 64: 124-131.
[10] Nene, S.A., Nayar, S.K., & Murase, H. (1996) Columbia object image library: COIL-20. Technical Report No. CUCS-006-96, Dept. of Computer Science, Columbia University.
[11] Saracco, J. (1997). An asymptotic theory for sliced inverse regression. Comm. Statist. Theory Methods 26: 2141-2171.
[12] Wu, Q., Mukherjee, S., & Liang, F. (2008) Localized sliced inverse regression. Advances in neural information processing systems 20, Cambridge, MA: MIT Press.
[13] von Luxburg, U., Bousquet, O., & Belkin, M. (2005) Limits of spectral clustering. In L. K. Saul, Y. Weiss and L. Bottou (Eds.), Advances in neural information processing systems 17, Cambridge, MA: MIT Press.
[14] Zhong, W., Zeng, P., Ma, P., Liu, J. S., & Zhu, Y. (2005) RSIR: Regularized sliced inverse regression for motif discovery. Bioinformatics 21: 4169-4175.
[15] Zhu, L.X., & NG, K.W. (1995) Asymptotics of sliced inverse regression. Statistica Sinica 5: 727-736. 9