iccv iccv2013 iccv2013-206 iccv2013-206-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Yi Sun, Xiaogang Wang, Xiaoou Tang
Abstract: This paper proposes a hybrid convolutional network (ConvNet)-Restricted Boltzmann Machine (RBM) model for face verification in wild conditions. A key contribution of this work is to directly learn relational visual features, which indicate identity similarities, from raw pixels of face pairs with a hybrid deep network. The deep ConvNets in our model mimic the primary visual cortex to jointly extract local relational visual features from two face images compared with the learned filter pairs. These relational features are further processed through multiple layers to extract high-level and global features. Multiple groups of ConvNets are constructed in order to achieve robustness and characterize face similarities from different aspects. The top-layerRBMperforms inferencefrom complementary high-level features extracted from different ConvNet groups with a two-level average pooling hierarchy. The entire hybrid deep network is jointly fine-tuned to optimize for the task of face verification. Our model achieves competitive face verification performance on the LFW dataset.
[1] T. Ahonen, A. Hadid, and M. Pietikainen. Face description with local binary patterns: Application to face recognition. 11449955 Figure 11: ROC comparison of our hybrid ConvNet-RBM model and the state-of-the-art methods relying on outside training data. PAMI, 28:2037–2041, 2006. 1
[2] Y. Bengio. Learning deep architectures for AI. Foundations and Trends in Machine Learning, 2: 1–127, 2009. 1
[3] T. Berg and P. Belhumeur. Tom-vs-pete classifiers and
[4]
[5]
[6]
[7]
[8]
[9]
[10]
[11]
[12]
[13] identity-preserving alignment for face verification. In Proc. BMVC, 2012. 1, 2, 7 T. Berg and P. Belhumeur. Poof: Part-based one-vs-one features for fine-grained categorization, face verification, and attribute estimation. In Proc. CVPR, 2013. 1, 2 Z. Cao, Q. Yin, X. Tang, and J. Sun. Face recognition with learning-based descriptor. In Proc. CVPR, 2010. 1, 2 D. Chen, X. Cao, L. Wang, F. Wen, and J. Sun. Bayesian face revisited: A joint formulation. In Proc. ECCV, 2012. 1, 2, 5, 7 D. Chen, X. Cao, F. Wen, and J. Sun. Blessing of dimensionality: High-dimensional feature and its efficient compression for face verification. In Proc. CVPR, 2013. 1, 2, 7 S. Chopra, R. Hadsell, and Y. LeCun. Learning a similarity metric discriminatively, with application to face verification. In Proc. CVPR, 2005. 1, 2 D. Ciresan, U. Meier, and J. Schmidhuber. Multi-column deep neural networks for image classification. In Proc. CVPR, 2012. 2 M. Guillaumin, J. Verbeek, and C. Schmid. Is that you? metric learning approaches for face identification. In Proc. ICCV, 2009. 1, 2 G. Hinton and S. Osindero. A fast learning algorithm for deep belief nets. Neural Comput., 18: 1527–1554, 2006. 2 C. Huang, S. Zhu, and K. Yu. Large scale strongly supervised ensemble metric learning, with applications to face verification and retrieval. NEC Technical Report TR115, 2011. 1, 2 G. B. Huang, H. Lee, and E. Learned-Miller. Learning hierarchical representations for face verification with convo- lutional deep belief networks. 4 In Proc. CVPR, 2012. 1, 2,
[14] G. B. Huang, M. Ramesh, T. Berg, and E. LearnedMiller. Labeled faces in the wild: A database for studying face recognition in unconstrained environments. Technical Report 07-49, University of Massachusetts, Amherst, 2007. 5
[15] A. Krizhevsky, I. Sutskever, and G. Hinton. Imagenet classification with deep convolutional neural networks. In Proc. NIPS, 2012. 2, 4
[16] N. Kumar, A. C. Berg, P. N. Belhumeur, and S. K. Nayar. Attribute and simile classifiers for face verification. In Proc. ICCV, 2009. 1, 2, 5
[17] H. Larochelle, M. Mandel, R. Pascanu, and Y. Bengio. Learning algorithms for the classification restricted boltzmann machine. JMLR, 13:643–669, 2012. 3
[18] Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradientbased learning applied to document recognition. Proceedings of the IEEE, 1998. 2
[19] H. Lee, R. Grosse, R. Ranganath, and A. Y. Ng. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In Proc. ICML, 2009. 2
[20] P. Li, S. Prince, Y. Fu, U. Mohammed, and J. Elder. Probabilistic models for inference about identity. PAMI, 34:144–157, 2012. 1, 2, 7
[21] D. G. Lowe. Distinctive image features from scale-invariant keypoints. IJCV, 60:91–1 10, 2004. 2
[22] H. V. Nguyen and L. Bai. Cosine similarity metric learning for face verification. In Proc. ACCV, 2010. 1, 2
[23] T. Ojala, M. Pietik¨ ainen, and T. Ma¨ enp a¨ a¨. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. PAMI, 24:971–987, 2002. 2
[24] N. Pinto and D. D. Cox. Beyond simple features: A large-scale feature search approach to unconstrained face recognition. In FG, 2011. 1, 2
[25] K. Simonyan, O. M. Parkhi, A. Vedaldi, and A. Zisserman. Fisher vector faces in the wild. In Proc. BMVC, 2013. 1, 2, 7
[26] Y. Sun, X. Wang, and X. Tang. Deep convolutional network cascade for facial point detection. In Proc. CVPR, 2013. 2
[27] Y. Taigman, L. Wolf, and T. Hassner. Multiple one-shots for utilizing class label information. In Proc. BMVC, 2009. 2
[28] X. Wang and X. Tang. Dual-space linear discriminant analysis for face recognition. In Proc. CVPR, 2004. 1
[29] X. Wang and X. Tang. A unified framework for subspace face recognition. PAMI, 26: 1222–1228, 2004. 1
[30] X. Wang and X. Tang. Random sampling for subspace face recognition. IJCV, 70:91–104, 2006. 1
[31] L. Wiskott, J.-M. Fellous, N. Krger, and C. V. D. Malsburg. Face recognition by elastic bunch graph matching. PAMI, 19:775–779, 1997. 2
[32] L. Wolf, T. Hassner, and Y. Taigman. Descriptor based methods in the wild. In Workshop on Faces Real-Life Images at ECCV, 2008. 2
[33] Q. Yin, X. Tang, and J. Sun. An associate-predict model for face recognition. In Proc. CVPR, 2011. 1, 2, 7
[34] Z. Zhu, P. Luo, X. Wang, and X. Tang. Deep learning identity-preserving face space. In Proc. ICCV, 2013. 1, 2 11449966