nips nips2002 nips2002-87 nips2002-87-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Anitha Kannan, Nebojsa Jojic, Brendan J. Frey
Abstract: Dimensionality reduction techniques such as principal component analysis and factor analysis are used to discover a linear mapping between high dimensional data samples and points in a lower dimensional subspace. In [6], Jojic and Frey introduced mixture of transformation-invariant component analyzers (MTCA) that can account for global transformations such as translations and rotations, perform clustering and learn local appearance deformations by dimensionality reduction. However, due to enormous computational requirements of the EM algorithm for learning the model, O( ) where is the dimensionality of a data sample, MTCA was not practical for most applications. In this paper, we demonstrate how fast Fourier transforms can reduce the computation to the order of log . With this speedup, we show the effectiveness of MTCA in various applications - tracking, video textures, clustering video sequences, object recognition, and object detection in images. ¡ ¤ ¤ ¤ ¤
[1] Everitt, B.S. An Introduction to Latent variable models Chapman and Hall, New York NY 1984
[2] Frey, B.J. , Colmenarez, A. & Huang, T.S. Mixtures of local linear subspaces for face recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1998 IEEE Computer Society Press: Los Alamitos, CA.
[3] Frey, B.J. & Jojic, N. Fast, large-scale transformation-invariant clustering. In Advances in Neural Information Processing Systems 14. Cambridge, MA: MIT Press 2002
[4] Ghahramani, Z. & Hinton, G. The EM Algorithm for Mixtures of Factor Analyzers University of Toronto Technical Report CRG-TR-96-1, 1996
[5] Hinton, G., Dayan, P. & Revow, M. Modeling the manifolds of images of handwritten digits In IEEE Transactions on Neural Networks 1997
[6] Jojic, N. & Frey, B.J. Topographic transformation as a discrete latent variable In Advances in Neural Information Processing Systems 13. Cambridge, MA: MIT Press 1999
[7] Jolliffe,I.T. Principal Component Analysis Springer-Verlag, New York NY, 1986.
[8] Li, S.Z., Zhu.L , Zhang, Z.Q. & Zhang,H.J. Learning to Detect Multi-View Faces in Real-Time In Proceedings of the 2nd International Conference on Development and Learning, June, 2002.
[9] Neumaier, A. & Schneider,T. Estimation of parameters and eigenmodes of multivariate autoregressive models In ACM Transactions on Math Software 2001.
[10] Schdl,A. Szeliski,R.,Salesin,D.& Irfan Essa Video textures In Proceedings of SIGGRAPH2000
[11] Simard, P. , LeCun, Y. & Denker, J. Efficient pattern recognition using a new transformation distance In Advances in Neural Information Processing Systems 1993
[12] Turk, M. & Pentland, A. Face recognition using eigenfaces In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition Maui, Hawaii, 1991
[13] Wolberg,G. & Zokai,S. Robust image registration using log-polar transform In Proceedings IEEE Intl. Conference on Image Processing, Canada 2000.