nips nips2002 nips2002-111 nips2002-111-reference knowledge-graph by maker-knowledge-mining

111 nips-2002-Independent Components Analysis through Product Density Estimation


Source: pdf

Author: Trevor Hastie, Rob Tibshirani

Abstract: We present a simple direct approach for solving the ICA problem, using density estimation and maximum likelihood. Given a candidate orthogonal frame, we model each of the coordinates using a semi-parametric density estimate based on cubic splines. Since our estimates have two continuous derivatives , we can easily run a second order search for the frame parameters. Our method performs very favorably when compared to state-of-the-art techniques. 1


reference text

Bach, F . & Jordan, M. (2001), Kernel independent component analysis, Technical Report UCBjCSD-01-1166, Computer Science Division, University of California, Berkeley. Efron, B. & Tibshirani, R. (1996), 'Using specially designed exponential families for density estimation' , Annals of Statistics 24(6), 2431-246l. Hastie, T. & Tibshirani, R. (1990), Generalized Additive Models, Chapman and Hall. Hastie, T., Tibshirani, R. & Friedman, J. (2001), The Elements of Statistical Learning; Data mining, Inference and Prediction, Springer Verlag, New York. Hyvarinen, A., Karhunen, J. & Oja, E. (2001), Independent Component Analysis, Wiley, New York. Hyvarinen, A. & Oja, E. (1999), 'Independent component analysis: Algorithms and applications' , Neural Networks . Mardia, K., Kent, J. & Bibby, J. (1979), Multivariate Analysis, Academic Press. Silverman, B. (1982), 'On the estimation of a probability density function by the maximum penalized likelihood method', Annals of Statistics 10(3),795-810. Silverman, B. (1986), Density Estimation for Statistics and Data Analysis, Chapman and Hall.