nips nips2009 nips2009-177 nips2009-177-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Raman Arora
Abstract: An algorithm is presented for online learning of rotations. The proposed algorithm involves matrix exponentiated gradient updates and is motivated by the von Neumann divergence. The multiplicative updates are exponentiated skew-symmetric matrices which comprise the Lie algebra of the rotation group. The orthonormality and unit determinant of the matrix parameter are preserved using matrix logarithms and exponentials and the algorithm lends itself to intuitive interpretation in terms of the differential geometry of the manifold associated with the rotation group. A complexity reduction result is presented that exploits the eigenstructure of the matrix updates to simplify matrix exponentiation to a quadratic form. 1
[1] Rich Wareham, Jonathan Cameron, and Joan Lasenby, “Applications of conformal geometric algebra in computer vision and graphics,” in IWMM/GIAE, 2004, pp. 329–349.
[2] C. Doran, D. Hestenes, F. Sommen, and N. Van Acker, “Lie groups as spin groups,” Journal of Mathematical Physics, vol. 34, no. 8, pp. 36423669, August 1993.
[3] Grace Wahba, “Problem 65-1, a least squares estimate of satellite attitude,” SIAM Review, vol. 7, no. 3, July 1965. 8
[4] P. Schonemann, “A generalized solution of the orthogonal Procrustes problem,” Psychometrika, vol. 31, no. 1, pp. 3642–3669, March 1966.
[5] P. Besl and N. McKay, “A method for registration of 3D shapes,” . IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 14, pp. 239–256, 1992. ¨
[6] Hannes Edvardson and Orjan Smedby, “Compact and efficient 3D shape description through radial function approximation,” Computer Methods and Programs in Biomedicine, vol. 72, no. 2, pp. 89–97, 2003.
[7] D.W. Eggert, A. Lorusso, and R.B. Fisher, “Estimating 3D rigid body transformations: a comparison of four major algorithms,” Machine Vision and Applications, Springer, vol. 9, no. 5-6, Mar 1997.
[8] R. Sala Llonch, E. Kokiopoulou, I. Tosic, and P. Frossard, “3D face recognition with sparse spherical representations,” Preprint, Elsiever, 2009.
[9] Ameesh Makadia and Kostas Daniilidis, “Rotation recovery from spherical images without correspondences,” IEEE Trans. Pattern Analysis Machine Intelligence, vol. 28, no. 7, pp. 1170–1175, 2006.
[10] Raman Arora and Harish Parthasarathy, “Navigation using a spherical camera,” in International Conference on Pattern Recognition (ICPR), Tampa, Florida, Dec 2008.
[11] Philip R. Evans, “Rotations and rotation matrices,” Acta Cryst., vol. D57, pp. 1355–1359, 2001.
[12] Richard L. Liboff, Introductory Quantum Mechanics, Addison-Wesley, 2002.
[13] Adam Smith and Manfred Warmuth, “Learning rotations,” in Conference on Learning Theory (COLT), Finland, Jun 2008.
[14] Koji Tsuda, Gunnar Ratsch, and Manfred K Warmuth, “Matrix exponentiated gradient updates for on-line learning and Bregman projection,” Journal of Machine Learning Research, vol. 6, Jun 2005.
[15] Manfred K Warmuth, “Winnowing subspaces,” in Proc. 24th Int. Conf. on Machine Learning, 2007.
[16] T.E. Abrudan, J. Eriksson, and V. Koivunen, “Steepest descent algorithms for optimization under unitary matrix constraint,” Signal Processing, IEEE Transactions on, vol. 56, no. 3, pp. 1134–1147, March 2008.
[17] M. A. Nielsen and I. L. Chuang, Quantum Computation and Quantum Information, Cambridge, 2000.
[18] Kaare Brandt Petersen and Michael Syskind Pedersen, “The matrix cookbook,” http:// matrixcookbook.com, November 14, 2008.
[19] Michael Artin, Algebra, Prentice Hall, 1991.
[20] John A. Thorpe, Elementary topics in Differential Geometry, Springer-Verlag, 1994.
[21] J. Kivinen andM. K.Warmuth, “Exponentiated gradient versus gradient descent for linear predictors,” Information and Computation, vol. 132, no. 1, pp. 1–63, Jan 1997.
[22] L. J. Butler, Applications of Matrix Theory to Approximation Theory, MS Thesis, Texas Tech University, Aug. 1999.
[23] J. Gallier and D. Xu, “Computing exponentials of skew-symmetric matrices and logarithms of orthogonal matrices,” International Journal of Robotics and Automation, vol. 17, no. 4, 2002.
[24] Raman Arora, Group theoretical methods in signal processing: learning similarities, transformation and invariants, Ph.D. thesis, University of Wisconsin-Madison, Madison, August 2009.
[25] E. Polak, Optimization: Algorithms and Consistent Approximations, Springer-Verlag, 1997.
[26] Stanford University Computer Graphics Laboratory, “The Stanford 3D scanning repository,” http://graphics.stanford.edu/data/.
[27] Raman Arora, “Tracking rotations of 3D Stanford bunny,” http://www.cae.wisc.edu/ ˜sethares/links/raman/LearnROT/vids.html, 2009. 9