nips nips2000 nips2000-110 nips2000-110-reference knowledge-graph by maker-knowledge-mining
Source: pdf
Author: Alex J. Smola, Zoltán L. Óvári, Robert C. Williamson
Abstract: In this paper we give necessary and sufficient conditions under which kernels of dot product type k(x, y) = k(x . y) satisfy Mercer's condition and thus may be used in Support Vector Machines (SVM), Regularization Networks (RN) or Gaussian Processes (GP). In particular, we show that if the kernel is analytic (i.e. can be expanded in a Taylor series), all expansion coefficients have to be nonnegative. We give an explicit functional form for the feature map by calculating its eigenfunctions and eigenvalues. 1
[1] C. J. C. Burges. Geometry and invariance in kernel based methods. In B. SchOlkopf, C. J . C. Burges, and A. J . Smola, editors, Advances in Kernel Methods - Support Vector Learning, pages 89-116, Cambridge, MA, 1999. MIT Press.
[2] I. S. Gradshteyn and I. M. Ryzhik. Table of integrals, series, and products. Academic Press, New York, 1981.
[3] J. Mercer. Functions of positive and negative type and their connection with the theory of integral equations. Philos. Trans. Roy. Soc. London, A 209:415-446, 1909.
[4] C. Millier. Analysis of Spherical Symmetries in Euclidean Spaces, volume 129 of Applied Mathematical Sciences. Springer, New York, 1997.
[5] N. Oliver, B. Scholkopf, and A.J. Smola. Natural regularization in SVMs. In A.J. Smola, P .L. Bartlett, B. Scholkopf, and D. Schuurmans, editors, Advances in Large Margin Classifiers, pages 51 - 60, Cambridge, MA, 2000. MIT Press.
[6] Z. Ovari. Kernels, eigenvalues and support vector machines. Honours thesis, Australian National University, Canberra, 2000.
[7] I. Schoenberg. Positive definite functions on spheres. Duke Math. J., 9:96-108, 1942.
[8] A. Smola, B. Scholkopf, and K.-R. Miiller. The connection between regularization operators and support vector kernels. Neural Networks, 11:637-649, 1998.
[9] G. Wahba. Spline Models for Observational Data, volume 59 of CBMS-NSF Regional Conference Series in Applied Mathematics. SIAM, Philadelphia, 1990.
[10] C. K. I. Williams. Prediction with Gaussian processes: From linear regression to linear prediction and beyond. In M. I. Jordan, editor, Learning and Inference in Graphical Models. Kluwer, 1998.