cvpr cvpr2013 cvpr2013-152 cvpr2013-152-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Brandon M. Smith, Li Zhang, Jonathan Brandt, Zhe Lin, Jianchao Yang
Abstract: In this work, we propose an exemplar-based face image segmentation algorithm. We take inspiration from previous works on image parsing for general scenes. Our approach assumes a database of exemplar face images, each of which is associated with a hand-labeled segmentation map. Given a test image, our algorithm first selects a subset of exemplar images from the database, Our algorithm then computes a nonrigid warp for each exemplar image to align it with the test image. Finally, we propagate labels from the exemplar images to the test image in a pixel-wise manner, using trained weights to modulate and combine label maps from different exemplars. We evaluate our method on two challenging datasets and compare with two face parsing algorithms and a general scene parsing algorithm. We also compare our segmentation results with contour-based face alignment results; that is, we first run the alignment algorithms to extract contour points and then derive segments from the contours. Our algorithm compares favorably with all previous works on all datasets evaluated.
[1] P. N. Belhumeur, D. W. Jacobs, D. J. Kriegman, and N. Kumar. Localizing parts of faces using a consensus of exemplars. In CVPR, 2011.
[2] R. H. Byrd, M. E. Hribar, and J. Nocedal. An interior point algorithm for large-scale nonlinear programming. SIAM Journal on Optimization, 1999.
[3] R. Gross, I. Matthews, J. Cohn, T. Kanade, and S. Baker. Multipie. In Proc. Int. Conf. Autom. Face Gesture Recognit. , 2010.
[4] L. Gu and T. Kanade. A generative shape regularization model for robust face alignment. In ECCV, 2008.
[5] D. Guo and T. Sim. Digital face makeup by example. In CVPR, 2009.
[6] G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller. Labeled faces in the wild: A database for studying face recognition in unconstrained environments. Technical Report 07-49, University of Massachusetts, Amherst, 2007.
[7] P. Kontschieder, S. R. Bul o`, H. Bischof, and M. Pelillo. Structured class-labels in random forests for semantic image labelling. In ICCV, 2011.
[8] D. Kuettel and V. Ferrari. Figure-ground segmentation by trans-
[9]
[10]
[11]
[12]
[13]
[14]
[15]
[16]
[17]
[18]
[19]
[20]
[21]
[22] ferring window masks. In CVPR, 2012. V. Le, J. Brandt, Z. Lin, L. Bourdev, and T. S. Huang. Interactive facial feature localization. In ECCV, 2012. A. Levin, D. Lischinski, and Y. Weiss. Colorization using optimization. In SIGGRAPH, 2004. A. Levin, A. Rav-Acha, and D. Lischinski. Spectral matting. In PAMI, October 2008. C. Liu, J. Yuen, and A. Torralba. Nonparametric scene parsing via label transfer. In PAMI, December 2011. C. Liu, J. Yuen, and A. Torralba. Sift flow: Dense correspondence across scenes and its applications. In PAMI, May 2011. D. Lowe. Distinctive image features from scale-invariant keypoints. IJCV, 2003. P. Luo, X. Wang, and X. Tang. Hierarchical face parsing via deep learning. In CVPR, 2012. C. Rousset and P. Coulon. Frequential and color analysis for hair mask segmentation. In ICIP, October 2008. D. Ruprecht and H. M ¨uller. Image warping with scattered data interpolation. IEEE Comp. Graphics and Applications, 1995. J. M. Saragih, S. Lucey, and J. F. Cohn. Face alignment through subspace constrained mean-shifts. In CVPR, 2009. J. Tighe and S. Lazebnik. Superparsing: Scalable nonparametric image parsing with superpixels. In ECCV, 2010. P. Viola and M. J. Jones. Robust real-time face detection. IJCV, 57(2):137–154, 2004. J. Warrell and S. J. Prince. Labelfaces: Parsing facial features by multiclass labeling with an epitome prior. In ICIP, 2009. X. Zhu and D. Ramanan. Face detection, pose estimation and landmark localization in the wild. In CVPR, 2012. 333444889199