nips nips2002 nips2002-96 nips2002-96-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Geoffrey J. Gordon
Abstract: We introduce the Generalized 2 Linear 2 Model, a statistical estimator which combines features of nonlinear regression and factor analysis. A (GL)2M approximately decomposes a rectangular matrix X into a simpler representation j(g(A)h(B)). Here A and Bare low-rank matrices, while j, g, and h are link functions. (GL)2Ms include many useful models as special cases, including principal components analysis, exponential-family peA, the infomax formulation of independent components analysis, linear regression, and generalized linear models. They also include new and interesting special cases, one of which we describe below. We also present an iterative procedure which optimizes the parameters of a (GL)2M. This procedure reduces to well-known algorithms for some of the special cases listed above; for other special cases, it is new. 1
[1] T. K. Landauer, P . W . Foltz , and D. Laham . Introduction to latent semantic analysis . Discourse Processes, 25:259- 284, 1998.
[2] Jon M. Kleinberg. Authoritative sources in a hyperlinked environment. Journal of the ACM, 46(5) :604-632, 1999.
[3] M. Turk and A. Pentland. Eigenfaces for recognition. Journal of Cognitive Neuroscience, 3(1) :71-86, 1991.
[4] Carlo Tomasi and Takeo Kanade. Shape and motion from image streams under orthography: a factorization method. Int. J. Computer Vision , 9(2):137- 154, 1992.
[5] D. P. O'Leary and S. Peleg. Digital image compression by outer product expansion. IEEE Trans . Communications, 31:441-444, 1983.
[6] P . McCullagh and J. A. Neider. Generalized Linear Models. Chapman & Hall, London, 2nd edition, 1983.
[7] Peter Auer, Mark Hebster, and Manfred K. Warmuth. Exponentially many local minima for single neurons. In NIPS, vol. 8. MIT Press, 1996.
[8] R. Tyrell Rockafellar. Convex Analysis. Princeton University Press, New Jersey, 1970.
[9] Geoffrey J. Gordon. Approximate Solutions to Markov Decision Processes. thesis, Carnegie Mellon University, 1999. PhD
[10] Daniel Lee and H. Sebastian Seung. Algorithms for nonnegative matrix factorization. In NIPS, vol. 13. MIT Press, 2001.
[11] Nathan Srebro. Personal communication, 2002.
[12] Anthony J . Bell and Terrence J. Sejnowski. The 'independent components' of natural scenes are edge filters. Vision Research, 37(23) :3327- 3338, 1997.
[13] Michael Collins, Sanjoy Dasgupta, and Robert Schapire. A generalization of principal component analysis to the exponential family. In NIPS, vol. 14. MIT Press, 2002 .
[14] D. Fox, W. Burgard, F . Dellaert , and S. Thrun. Monte Carlo localization: Efficient position estimation for mobile robots. In AAAI, 1999.
[15] Nicholas Roy and Geoffrey J. Gordon. Exponential family PCA for belief compression in POMDPs. In NIPS, vol. 15 . MIT Press, 2003.
[16] Sam Roweis. EM algorithms for PCA and SPCA. In NIPS, vol. 10. MIT Press, 1998.