nips nips2003 nips2003-106 nips2003-106-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Lorenzo Torresani, Aaron Hertzmann, Christoph Bregler
Abstract: This paper presents an algorithm for learning the time-varying shape of a non-rigid 3D object from uncalibrated 2D tracking data. We model shape motion as a rigid component (rotation and translation) combined with a non-rigid deformation. Reconstruction is ill-posed if arbitrary deformations are allowed. We constrain the problem by assuming that the object shape at each time instant is drawn from a Gaussian distribution. Based on this assumption, the algorithm simultaneously estimates 3D shape and motion for each time frame, learns the parameters of the Gaussian, and robustly fills-in missing data points. We then extend the algorithm to model temporal smoothness in object shape, thus allowing it to handle severe cases of missing data. 1
[1] A. Blake and M. Isard. Active Contours. Springer-Verlag, 1998.
[2] V. Blanz and T. Vetter. A Morphable Model for the Synthesis of 3D Faces. In Proceedings of SIGGRAPH 99, Computer Graphics Proceedings, pages 187–194, Aug. 1999.
[3] M. Brand. Morphable 3D models from video. In Proc. CVPR 2001, 2001.
[4] C. Bregler, A. Hertzmann, and H. Biermann. Recovering Non-Rigid 3D Shape from Image Streams. In Proc. CVPR 2000, 2000.
[5] T. F. Cootes and C. J. Taylor. Statistical models of appearance for medical image analysis and computer vision. In Proc. SPIE Medical Imaging, 2001.
[6] Z. Ghahramani and G. E. Hinton. The EM Algorithm for Mixtures of Factor Analyzers. Technical Report CRG-TR-96-1, University of Toronto, 1996.
[7] A. Gruber and Y. Weiss. Factorization with Uncertainty and Missing Data: Exploiting Temporal Coherence. In Proc. NIPS 2003, 2003. In these proceedings.
[8] D. W. Jacobs. Linear Fitting with Missing Data for Structure-From-Motion. Computer Vision and Image Understanding, 82:57–82, 2001.
[9] H. Shum, K. Ikeuchi, and R. Reddy. Principal Component Analysis with Missing Data and Its Applications to Polyhedral Object Modeling. IEEE Trans. PAMI, 17(9):854–867, 1995.
[10] R. H. Shumway and D. S. Stoffer. An approach to time series smoothing and forecasting using the em algorithm. J. Time Series Analysis, 3(4):253–264, 1982.
[11] S. Soatto and A. J. Yezzi. Deformotion: Deforming Motion, Shape Averages, and the Joint Registration and Segmentation of Images. In Proc. ECCV 2002, May 2002.
[12] C. Tomasi and T. Kanade. Shape and motion from image streams under orthography: A factorization method. Int. J. of Computer Vision, 9(2):137–154, 1992.
[13] L. Torresani, D. Yang, G. Alexander, and C. Bregler. Tracking and Modeling Non-Rigid Objects with Rank Constraints. In Proc. CVPR, 2001.