nips nips2003 nips2003-35 nips2003-35-reference knowledge-graph by maker-knowledge-mining

35 nips-2003-Attractive People: Assembling Loose-Limbed Models using Non-parametric Belief Propagation


Source: pdf

Author: Leonid Sigal, Michael Isard, Benjamin H. Sigelman, Michael J. Black

Abstract: The detection and pose estimation of people in images and video is made challenging by the variability of human appearance, the complexity of natural scenes, and the high dimensionality of articulated body models. To cope with these problems we represent the 3D human body as a graphical model in which the relationships between the body parts are represented by conditional probability distributions. We formulate the pose estimation problem as one of probabilistic inference over a graphical model where the random variables correspond to the individual limb parameters (position and orientation). Because the limbs are described by 6-dimensional vectors encoding pose in 3-space, discretization is impractical and the random variables in our model must be continuousvalued. To approximate belief propagation in such a graph we exploit a recently introduced generalization of the particle filter. This framework facilitates the automatic initialization of the body-model from low level cues and is robust to occlusion of body parts and scene clutter. 1


reference text

[1] M. Burl, M. Weber and P. Perona . A probabilistic approach to object recognition using local photometry and global geometry, ECCV, pp. 628–641, 1998.

[2] C. Bregler and J. Malik. Tracking people with twists and exponential maps, CVPR, pp. 8–15, 1998.

[3] J. Coughlan and S. Ferreira. Finding deformable shapes using loopy belief propagation, ECCV Vol. 3, pp. 453–468, 2002.

[4] J. Deutscher, M. Isard and J. MacCormick. Automatic camera calibration from a single manhattan image, ECCV, pp. 175–188, 2002.

[5] J. Deutscher, A. Davison and I. Reid. Automatic partitioning of high dimensional search spaces associated with articulated body motion capture, CVPR, pp. 669–676, 2001.

[6] J. Deutscher, B. North, B. Bascle and A. Blake. Tracking through singularities and discontinuities by random sampling, ICCV, pp. 1144–1149, 1999.

[7] A. Douce, N. de Freitas and N. Gordon. Sequantial Monte Carlo methods in practice, Statistics for Engineering and Information Sciences, pp. 3–14, Springer Verlag, 2001.

[8] P. Felzenszwalb and D. Huttenlocher. Efficient matching of pictorial structures, CVPR, Vol. 2, pp. 66–73, 2000.

[9] M. Fischler and R. Elschlager. The representation and matching of pictorial structures. IEEE. Trans. Computers, 22(1):67–92, 1973.

[10] J. Gao and J. Shi, Inferring human upper body motion, Tech report CMU-RI-TR-03-05, 2003.

[11] S. Ioffe and D. Forsyth. Probabilistic methods for finding people, IJCV 43(1):45–68, 2001.

[12] M. Isard. PAMPAS: Real-valued graphical models for computer vision, CVPR, Vol. 1, pp. 613– 620, 2003.

[13] M. Jordan, T. Sejnowski and T. Poggio. Graphical models: Foundations of neural computation, MIT Press, 2001.

[14] S. Ju, M. Black and Y. Yacoob. Cardboard people: A parameterized model of articulated motion. Int. Conf. on Automatic Face and Gesture Recognition, pp. 38–44, 1996.

[15] J. MacCormick and M. Isard. Partitioned sampling, articulated objects, and interface-quality hand tracking. ECCV (2), pp. 3–19, 2000.

[16] V. Pavolvi´ , J. Rehg, T-J. Cham and K. Murphy. A dynamic Bayesian network approach to c figure tracking using learned dynamic models, ICCV, pp. 94–101, 1999.

[17] D. Ramanan and D. Forsyth. Finding and tracking people from the bottom up, CVPR, Vol. II, pp. 467–716, 2003.

[18] H. Sidenbladh and M. Black. Learning image statistics for Bayesian tracking, ICCV, Vol. II, pp. 709–716, 2001.

[19] H. Sidenbladh, M. Black and D. Fleet. Stochastic tracking of 3D human figures using 2D image motion, ECCV, vol. 2, pp. 702–718, 2000.

[20] B. Sigelman. Video-Based Tracking of 3D Human Motion Using Multiple Cameras, Brown Univ., Dept. of Comp. Sci., Technical Report, CS-03-08, 2003.

[21] C. Sminchisescu and B. Triggs. Covariance scaled sampling for monocular 3D body tracking, CVPR, vol. 1 pp. 447–454, 2001.

[22] E. Sudderth, A. Ihler, W. Freeman and A. Willsky. Nonparametric belief propagation, CVPR, Vol. 1, pp. 605–612, 2003; (see also MIT AI Lab Memo 2002-020).

[23] Y. Wu, G. Hua and T. Yu, Tracking articulated body by dynamic Markov network, ICCV, pp. 1094–1101, 2003.

[24] J. Yedidia, W. Freeman and Y. Weiss. Generalized belief propagation, Advances in Neural Info. Proc. Sys. 13, pp. 689–695, 2000.

[25] S. Yu, R. Gross, and J. Shi. Object segmentation by graph partitioning Concurrent object recognition and segmentation by graph partitioning, Advances in Neural Info. Proc. Sys. 15, pp. 1407–1414, 2003.