nips nips2003 nips2003-59 nips2003-59-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Haifeng Li, Tao Jiang, Keshu Zhang
Abstract: A new feature extraction criterion, maximum margin criterion (MMC), is proposed in this paper. This new criterion is general in the sense that, when combined with a suitable constraint, it can actually give rise to the most popular feature extractor in the literature, linear discriminate analysis (LDA). We derive a new feature extractor based on MMC using a different constraint that does not depend on the nonsingularity of the within-class scatter matrix Sw . Such a dependence is a major drawback of LDA especially when the sample size is small. The kernelized (nonlinear) counterpart of this linear feature extractor is also established in this paper. Our preliminary experimental results on face images demonstrate that the new feature extractors are efficient and stable. 1
[1] R. A. Fisher. The use of multiple measurements in taxonomic problems. Annual of Eugenics, 7:179–188, 1936.
[2] M. Loog, R. P. W. Duin, and R. Haeb-Umbach. Multiclass linear dimension reduction by weighted pairwise fisher criteria. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(7):762–766, 2001.
[3] K. Fukunaga. Introduction to Statistical Pattern Recognition. Academic Press, New York, 2nd edition, 1990.
[4] Q. Tian, M. Barbero, Z. Gu, and S. Lee. Image classification by the foley-sammon transform. Optical Engineering, 25(7):834–840, 1986.
[5] Z. Hong and J. Yang. Optimal discriminant plane for a small number of samples and design method of classifier on the plane. Pattern Recognition, 24(4):317–324, 1991.
[6] G. W. Stewart. Introduction to Matrix Computations. Academic Press, New York, 1973.
[7] K. Liu, Y. Cheng, and J. Yang. A generalized optimal set of discriminant vectors. Pattern Recognition, 25(7):731–739, 1992.
[8] L. Chen, H. Liao, M .Ko, J. Lin, and G. Yu. A new LDA-based face recognition system which can solve the small sample size problem. Pattern Recognition, 33(10):1713–1726, 2000.
[9] S. Mika, G. R¨ tsch, J. Weston, B. Sch¨ lkopf, and K.-R. M¨ ller. Fisher discriminant analysis a o u with kernels. In Y.-H. Hu, J. Larsen, E. Wilson, and S. Douglas, editors, Neural Networks for Signal Processing IX, pages 41–48. IEEE, 1999.
[10] V. N. Vapnik. Statistical Learning Theory. John Wiley & Sons, New York, 1998.
[11] F. Samaria and A. Harter. Parameterisation of a stochastic model for human face identification. In Proceedings of 2nd IEEE Workshop on Applications of Computer Vision, Sarasota, FL, 1994.